Query parameters for harvesting digital video and associated contextual information

ABSTRACT

Video is increasingly important to digital libraries and archives as both primary content and as context for the primary objects in collections. Services like YouTube not only offer large numbers of videos but also usage data such as comments and ratings that may help curators today make selections and aid future generations to interpret those selections. A query-based harvesting strategy is presented and results from daily harvests for six topics defined by 145 queries over a 20-month period are discussed with respect to, query specification parameters, topic, and contribution patterns. The limitations of the strategy and these data are considered and suggestions are offered for curators who wish to use query-based harvesting.

REFERENCES

• 1: Blue Ribbon Task Force on Sustainable Digital Preservation and Access. (2009). Sustaining the Digital Investment: Issues and Challenges of Economically Sustainable Digital Preservation. http://brtf.sdsc.edu/biblio/BRTF_Interim_Report.pdf
• 2: Robert G. Capra , Christopher A. Lee , Gary Marchionini , Terrell Russell , Chirag Shah , Fred Stutzman, Selection and context scoping for digital video collections: an investigation of youtube and blogs, Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries, June 16-20, 2008, Pittsburgh PA, PA, USA [doi>10.1145/1378889.1378925]
• 3: Clemens, R., Capra, R., Lee, C., and Sheble, L. (2009). Contextual Information from Blogs in Video Digital Curation. Proceedings of Society of American Archivists 2008 Research Forum.
• 4: Conway, P. (2000). Overview: Rational for digitization and preservation. In Handbook for digital projects: A management tool for preservation and access. Northeast Document Conservation Center, Andover, MA. http://www.nedcc.org/digital/dman.pdf.
• 5: Lavoie, B. & Dempsey, L. (2004). Thirteen ways of looking at..digital preservation. D-Lib Magazine, 10(7/8). http://www.dlib.org/dlib/july04/lavoie/07lavoie.html.
• 6: Lee, C. 2007. "Taking Context Seriously: A Framework for Contextual Information in Digital Collections." UNC SILS TR-2007-04.
• 7: Maslov, A., Mikeal, A., & Leggett, J. (2009). Cooperation or Control? Web 2.0 and the Digital Library. Journal of Digital Information, 10(1), https://journals.tdl.org/jodi/issue/view/65.
• 8: Marc Najork , Janet L. Wiener, Breadth-first crawling yields high-quality pages, Proceedings of the 10th international conference on World Wide Web, p.114-118, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.371965]
• 9: Gautam Pant , Padmini Srinivasan, Learning to crawl: Comparing classification schemes, ACM Transactions on Information Systems (TOIS), v.23 n.4, p.430-462, October 2005 [doi>10.1145/1095872.1095875]
• 10: Saharon Rosset , Einat Neumann , Uri Eick , Nurit Vatnik , Yizhak Idan, Customer lifetime value modeling and its use for customer retention planning, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775097]
• 11: Shah, C., and Marchionini, G. 2007. Preserving 2008 US Presidential Election Videos. In the Proceedings of International Web Archiving Workshop (IWAW) 2007.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Design, Documentation, Management

Keywords:
digital curation, harvesting, video mining