Automatic organization for digital photographs with geographic coordinates

ABSTRACT

We describe PhotoCompas, a system that utilizes the time and location information embedded in digital photographs to automatically organize a personal photo collection PhotoCompas produces browseable location and event hierarchies for the collection. These hierarchies are created using algorithms that interleave time and location to produce an organization that mimics the way people think about their photo collections. In addition, our algorithm annotates the generated hierarchy with geographical names. We tested our approach in case studies of three real--world collections and verified that the results are meaningful and useful for the collection owners.

REFERENCES

• 1: Doug Beeferman , Adam Berger , John Lafferty, Statistical Models for Text Segmentation, Machine Learning, v.34 n.1-3, p.177-210, Feb. 1999 [doi>10.1023/A:1007506220214]
• 2: Matthew Cooper , Jonathan Foote , Andreas Girgensohn , Lynn Wilcox, Temporal event clustering for digital photo collections, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957093]
• 3: David Frohlich , Allan Kuchinsky , Celine Pering , Abbe Don , Steven Ariss, Requirements for photoware, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587102]
• 4: U. Gargi, Consumer media capture: Time-based analysis and event clustering Technical Report HPL-2003--165, HP Laboratories, August 2003.
• 5: Aristides Gionis , Heikki Mannila, Finding recurrent sources in sequences, Proceedings of the seventh annual international conference on Research in computational molecular biology, p.123-130, April 10-14, 2003, Berlin, Germany [doi>10.1145/640075.640091]
• 6: Google inc http://www.google.com
• 7: Adrian Graham , Hector Garcia-Molina , Andreas Paepcke , Terry Winograd, Time as essence for photo browsing through personal digital libraries, Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, July 14-18, 2002, Portland, Oregon, USA [doi>10.1145/544220.544301]
• 8: Susumu Harada , Mor Naaman , Yee Jiun Song , QianYing Wang , Andreas Paepcke, Lost in memories: interacting with photo collections on PDAs, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996425]
• 9: L. L. Hill, J. Frew, and Q. Zheng Geographic names - the implementation of a gazetteer in a georeferenced digital library CNRI D-Lib Magazine, January 1999.
• 10: Christopher B. Jones , R. Purves , A. Ruas , M. Sanderson , M. Sester , M. van Kreveld , R. Weibel, Spatial information retrieval and geographical ontologies an overview of the SPIRIT project, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564457]
• 11: A. Loui and A. E. Savakis Automatic image event segmentation and quality screening for albuming applications. In IEEE International Conference on Multimedia and Expo, 2000.
• 12: M. Naaman, S. Harada, Q. Wang, and A. Paepcke Adventures in space and time: Browsing personal collections of geo--referenced digital photographs Technical report, Stanford University, April 2004 Submitted for Publication.
• 13: M. Naaman, A. Paepcke, and H. Garcia-Molina From where to what: Metadata sharing for digital photographs with geographic coordinates. In 10th International Conference on Cooperative Information Systems (CoopIS), 2003.
• 14: Lev Pevzner , Marti A. Hearst, A critique and improvement of an evaluation metric for text segmentation, Computational Linguistics, v.28 n.1, p.19-36, March 2002 [doi>10.1162/089120102317341756]
• 15: J. C. Platt, M., and B. A. Field Phototoc: Automatic clustering for browsing personal photographs Technical Report MSR-TR-2002--17, Microsoft Research, February 2002.
• 16: Kerry Rodden , Kenneth R. Wood, How do people manage their digital photographs?, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642682]
• 17: G. Schwarz Estimating the dimension of a model. The Annals of Statistic, 6:461--464, 1978.
• 18: Diomidis D. Spinellis, Position-Annotated Photographs: A Geotemporal Web, IEEE Pervasive Computing, v.2 n.2, p.72-79, April 2003 [doi>10.1109/MPRV.2003.1203756]
• 19: Kentaro Toyama , Ron Logan , Asta Roseway, Geographic location tags on digital images, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957046]
• 20: W. Wagenaar My memory: A study of autobiographical memory over six years Cognitive psychology, 18:225--252, 1986.
• 21: Ka-Ping Yee , Kirsten Swearingen , Kevin Li , Marti Hearst, Faceted metadata for image search and browsing, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642681]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries
          Subjects: Systems issues

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

General Terms:
Algorithms, Human Factors

Keywords:
GPS, geo-referenced photos, personal photo collection, photo browser