Using event segmentation to improve indexing of consumer photographs

ABSTRACT

Automatic albuming --- the automatic organization of photographs, either as an end in itself or for use in other applications -- is an application that promises to be of great assistance to photographers. Relatively sophisticated image content analysis techniques have been used for image indexing, organization and retrieval. In this paper, we describe a method of organizing photographs into events using spoken photograph captions. The results of this process can be used to improve image indexing and retrieval.

REFERENCES

• 1: Andrei Mikheev , Claire Grover , Marc Moens, XML tools and architecture for Named Entity recognition, Markup Languages, v.1 n.3, p.89-113, June 1999 [doi>10.1162/10996629952104386]
• 2: Proceedings of the Fifth Message Understanding Conference, Baltimore, MD, August 1993. Morgan Kaufman.
• 3: C. Doran, D. Egedi, B. Hockey, B. Srinivas, and M. Zaidel. XTAG system - a wide coverage grammar for english. In Proceedings of COLING, Copenhagen, Denmark, August 1995.
• 4: Sharon Flank, A layered approach to NLP-based information retrieval, Proceedings of the 17th international conference on Computational linguistics, August 10-14, 1998, Montreal, Quebec, Canada
• 5: R. Gaizauskas and Y. Wilks. Information extraction: Beyond document retrieval. Computational Linguistics and Chinese Language Processing, 3(2), 1998.
• 6: L. Hirschman, J. Burger, D. Palmer, and P. Robinson. Evaluating content extraction from audio sources. In Proceedings of the ESCA ETRW Workshop: Accessing Information in Spoken Audio, Cambridge, UK, April 1999.
• 7: J. Hobbs, D. Appelt, J. Bear, D. Israel, M. Kameyama, M. Stickel, and M. Tyson. FASTUS: A cascaded finite-state transducer for extracting information from natural-language text. In T. Roche and Y. Schabes, editors, Finite State Devices for Natural Language Processing. MIT Press, Cambridge, MA, 1996.
• 8: H. Lieberman, E. Rosenzweig, and P. Singh. An agent for integrated annotation and retrieval of images. in progress, 2000.
• 9: A. Loui and A. Savakis. Automatic image event segmentation and quality screening for albuming applications. In Proceedings of the IEEE International Conference on Multimedia and Expo, New York, NY, July 2000.
• 10: Alexander C. Loui , Mark D. Wood, A software system for automatic albuming of consumer pictures, Proceedings of the seventh ACM international conference on Multimedia (Part 2), p.159-162, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319878.319921]
• 11: S. Peck. The American Family: Their photographs, and the stories they tell. PhD thesis, Temple University, 1999.
• 12: D. Penrose, editor. TIPSTER Text Program: Phase 3; Proceedings. Morgan Kaufman, 1999.
• 13: J. Platt. AutoAlbum: Clustering digital photographs using probabilistic model merging. In IEEE International Conference on Computer Vision and Pattern Recognition, 2000.
• 14: M. Porter. An algorithm for suffix stripping. Program, 14(3), 1980.
• 15: W. Qi, L. Gu, H. Jiang, X. Chen, and H. Zhang. Integrating visual, audio and text analysis for news video browsing. In Proceedings of the IEEE International Conference on Image Processing (ICIP), Vancouver, Canada, September 2000.
• 16: K. Rodden. How do people organise their photographs? In Proceedings of the BCS IRSG 21st Annual Colloquium on Information Retrieval Research, Glasgow, Scotland, April 1999.
• 17: T. Rose, D. Elworthy, A. Kotcheff, A. Clare, and P. Tsonis. ANVIL : a system for the retrieval of captioned images using NLP techniques. In Proceedings of the Third UK Conference on Image Retrieval, Brighton, UK, May 2000.
• 18: K. Sparck-Jones. What is the role of NLP in text retrieval? In Natural Language Information Retrieval. Kluwer, 1999.
• 19: Nina Wacholder , Yael Ravin , Misook Choi, Disambiguation of proper names in text, Proceedings of the fifth conference on Applied natural language processing, p.202-208, March 31-April 03, 1997, Washington, DC [doi>10.3115/974557.974587]
• 20: S. Young and P. Woodland. Hidden markov model toolkit. http://htk.eng.cam.ac.uk/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models; Search process

General Terms:
Algorithms, Design, Experimentation, Performance