GroundTruth tools & technology: applications in real world

ABSTRACT

The process of creating digital archive from paper based document is gaining popularity. Automated systems/frameworks for document analysis techniques have been developed, but still lack in achieving the required accuracy goals in terms of text, article identification etc. Rendering problems, such as missing graphical components, wrong reading ordering in multi columned journals/magazine, missing indentation and broken text lines, hyphenation issues, are basically due to poor layout information extracted from the scanned document during the OCR process. Also lacking are the tools to take the output of these processes and be able to create highly accurate content with associated metadata from the original. The term "Ground Truth" in the current context is used to refer to the process (automatic and manual collectively) by which we ensure that the end result of the process are highly accurate and complete rich text content (articles, papers, etc) generated from the original scanned version of content.We present to the audience PerfectDoc - A suite of tools for manual GroundTruthing. The suite consist of tools to create highly accurate GroundTruth, GT editors and tools to take this data and deliver output suitable for web based viewing.

REFERENCES

• 1: Sherif Yacoub , Vinay Saxena , Sayeed Nusrulla Sami, PerfectDoc: A Ground Truthing Environment for Complex Documents, Proceedings of the Eighth International Conference on Document Analysis and Recognition, p.452-457, August 31-September 01, 2005 [doi>10.1109/ICDAR.2005.187]
• 2: Vasu Sankhavaram, Vinay Saxena: Work Flow for Printed Media Digitization - Hewlett-Packard TechCon 2005.
• 3: Yacoub, S., P. Faraboschi, J. Burns, D. Ortega, J. Abad, J.A. Sanchez. Chronos: A Document Understanding System for Historical Magazine Collections. 2005 International Journal on Document Analysis and Recognition IJDAR.
• 4: Sherif Yacoub , John Burns , Paolo Faraboschi , Daniel Ortega , Jose Abad Peiro , Vinay Saxena, Document digitization lifecycle for complex magazine collection, Proceedings of the 2005 ACM symposium on Document engineering, November 02-04, 2005, Bristol, United Kingdom [doi>10.1145/1096601.1096650]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Document analysis

Additional Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Graphics recognition and interpretation; Scanning; Optical character recognition (OCR)

General Terms:
Algorithms, Design, Human Factors, Measurement, Reliability, Verification

Keywords:
document analysis and understanding, document digitization, document engineering, preservation of historical content