Metadata and data structures for the historical newspaper digital library

ABSTRACT

We examine metadata and data-structure issues for the Historical Newspaper Digital Library. This project proposes to digitize and then do OCR and linguisting processing on several years worth of historical newspapers. Newspapers are very complex information objects so developing a rich description of their content is challenging. In addition to frameworks for the logical structure and physical layout, we propose metadata relevant to the image processing and to the historians who will use this collection. Finally, we consider how the metadata infrastructure might be managed as it evolves with improved text processing capabilities and how an infrastructure might be developed to support a community of users.

REFERENCES

• 1: Working Group 3: Structural and administrative metadata in page-image conversion projects: Discussion summary and recommendations. In TEI and XML in Digital Libraries. Washington, DC.
• 2: ALAM, H., CHANG, C. H., SHI, Z., AND Tu- PAJ, S. Extracting tables from printed documents. In Symposium on Document Image Understanding and Technology (1995), pp. 113-124.
• 3: BASKETTE, F. K., SISSORS, 3. Z., AND BROOKS, J. S. The Art of Editing. Allyn and Bacon, 1996.
• 4: BUNKE, H., AND WANG, P. S. P. Handbook on Character Recognition and Document Image Analysis. World Scientific, 1997.
• 5: María José Aramburu Cabo , Rafael Berlanga Llavori, An approach to a digital library of newspapers, Information Processing and Management: an International Journal, v.33 n.5, p.645-661, Sept. 1997 [doi>10.1016/S0306-4573(97)00023-X]
• 6: DOCUMENT PROCESSING GROUP. Page decomposition and related research at the University of Maryland. In Symposium on Document Image Understanding and Technology (1995), pp. 39-55.
• 7: HARROWER, T. The Newspaper Designer's Handbook. McGraw Hill, 1997.
• 8: KANUNGO, T., AND ALLEN, R. B. Full-text access to historical newspapers. Tech. Rep. CS-TR- 4014, Laboratory for Language and Media Processing, University of Maryland, Apr. 1999.
• 9: LIBRARY OF CONGRESS. Thesaurus for Graphical Objects. 1995.
• 10: SCHROTH, R. A. The Eagle and Brooklyn: A Community Newspaper, 1841-1955. Greenwood Press, Westport CT, 1974.
• 11: YANIKOGLU, B. A., AND VINCENT, L. Pink Panther: A complete environment for ground-truthing and benchmarking document page segmentation. Pattern Recognition 31 (September 1998), 1191- 204.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.7 COMPUTERS IN OTHER SYSTEMS
      Subjects: Publishing

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Textual databases
  H.3 INFORMATION STORAGE AND RETRIEVAL

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Optical character recognition (OCR)

General Terms:
Design, Documentation, Human Factors, Management, Measurement, Performance, Theory

Keywords:
OCR, digital libraries, history, metadata, newspapers