The effect of OCR errors on stylistic text classification

ABSTRACT

Recently, interest is growing in non-topical text classification tasks such as genre classification, sentiment analysis, and authorship profiling. We study to what extent OCR errors affect stylistic text classification from scanned documents. We find that even a relatively high level of errors in the OCRed documents does not substantially affect stylistic classification accuracy.

REFERENCES

• 1: Kazem Taghva , Jeffrey Coombs, Hairetes: A Search Engine for OCR Documents, Proceedings of the 5th International Workshop on Document Analysis Systems V, p.412-422, August 19-21, 2002
• 2: V. Levenshtein. Binary codes capable of correcting spurious insertions and deletions of ones. Problems of Information Transmission, 1:8--17, 1965.
• 3: D. Lewis , G. Agam , S. Argamon , O. Frieder , D. Grossman , J. Heard, Building a test collection for complex document information processing, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148307]
• 4: B. K. O. Uzuner. A comparative study of language models for book and author recognition. Springer-Verlag GmbH, page 969, 2005.
• 5: Ian H. Witten , Eibe Frank, Data mining: practical machine learning tools and techniques with Java implementations, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Linguistic processing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Experimentation

Keywords:
OCR, OCR errors, text classification