Robust technologies for automated ingestion and long-term preservation of digital information

ABSTRACT

In this summary, we present an overview of our DIGARCH project and report on a number of significant advances achieved thus far. In particular, we highlight our contributions to the development of a novel architecture for the Global Digital Format Registry, the design of a highly reliable and scalable deep archive, and the development of the underpinnings of a policy-driven management of preservation processes. Challenges and future plans are briefly outlined.

REFERENCES

• 1: Abrams, S. L., and Seaman, D. Towards a Global Format Registry, IFLA 2003. http://www.ifla.org/IV/ifla69/papers/128eAbramsSeaman.pdf
• 2: JHOVE, JSTOR/Harvard Object Validation Environment http://hul.harvard.edu/jhove/
• 3: Global Digital Format Registry: FRED, http://tome.library.upenn.edu/fred/
• 4: PRONOM, UK National Archives http://www.records.pro.gov.uk/pronom/
• 5: Smorul, M., and JaJa, J. PAWN: A Novel Ingestion Workflow Technology for Digital Preservation. Invited talk, ERPANET Workshop on Workflow, Oct. 13--15, 2004, Budapest, Hungary.
• 6: Joesph JaJa , Mike Smorul , Fritz McCall , Yang Wang, Scalable, Reliable Marshalling and Organization of Distributed Large Scale Data Onto Enterprise Storage Environments, Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST'05), p.197-201, April 11-14, 2005 [doi>10.1109/MSST.2005.29]
• 7: Reagan W. Moore , Joseph F. JaJa , Robert Chadduck, Mitigating Risk of Data Loss in Preservation Environments, Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST'05), p.39-48, April 11-14, 2005 [doi>10.1109/MSST.2005.20]
• 8: Geremew, M., Song, S., and JaJa, J. Using Scalable and Secure Web Technologies to Design a Global Digital Format Registry Prototype: Architecture, Implementation, and Testing, to appear in Proceedings of Archiving 2006 Conference, May 23--26, 2006, Ottawa, Canada.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries

Additional Classification:
  E. Data
  E.2 DATA STORAGE REPRESENTATIONS

Keywords:
automated ingestion, digital archiving, digital preservation, format registry, management of preservation processes