Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

The use of digital cameras is prevalent. Although the cost of digital photographs is low, managing numerous digital photos is burdensome to most users. An intelligent management tool for digital photos is needed. We propose a novel clustering algorithm for concurrent digital photos obtained from multiple cameras. Since previous photo clustering methods can be applied to a single camera, a group of photos obtained from different cameras cannot be classified to meet user preference. We newly define temporal/spatial combined clustering for the set of group photos taken from different cameras to solve this situation. We define a new spatial similarity using block alignment for two independent photos. If a user submits photo clustering that shows preference between spatial and temporal clustering, then we can cluster other photo sets according to the reference clustering characteristics. In this method, the EXIF metadata plays an essential role. We tested more than one thousand photos taken by tourist groups. The final result was satisfactory compared to previous methods based on temporal (spatial) criteria only.

REFERENCES

• 1: ACDSee Photo Software Homepage. http://www.acdsee.com/.
• 2: Susanne Boll , Philipp Sandhaus , Ansgar Scherp , Utz Westermann, Semantics, content, and structure of many for the creation of personal photo albums, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291385]
• 3: M. Boutell and J. Luo. Bayesian fusion of camera metadata cues in semantic scene classification. In CVPR '04, volume 2, pages 623--630, 2004.
• 4: Matthew Boutell , Jiebo Luo, Photo Classification by Integrating Image Content and Camera Metadata, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4, p.901-904, August 23-26, 2004 [doi>10.1109/ICPR.2004.693]
• 5: Jun-Cheng Chen , Wei-Ta Chu , Jin-Hau Kuo , Chung-Yi Weng , Ja-Ling Wu, Tiling slideshow, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180653]
• 6: Wei-Ta Chu , Jun-Cheng Chen , Ja-Ling Wu, Tiling Slideshow: An Audiovisual Presentation Method for Consumer Photos, IEEE MultiMedia, v.14 n.3, p.36-45, July 2007 [doi>10.1109/MMUL.2007.66]
• 7: Matthew Cooper , Jonathan Foote , Andreas Girgensohn , Lynn Wilcox, Temporal event clustering for digital photo collections, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.1 n.3, p.269-288, August 2005 [doi>10.1145/1083314.1083317]
• 8: Adrian Graham , Hector Garcia-Molina , Andreas Paepcke , Terry Winograd, Time as essence for photo browsing through personal digital libraries, Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, July 14-18, 2002, Portland, Oregon, USA [doi>10.1145/544220.544301]
• 9: C.-J. Jang, J.-Y. Lee, J.-W. Lee, and H.-G. Cho. Smart management system for digital photographs using temporal and spatial features with exif metadata. In ICDIM '07, pages 110--115, 2007.
• 10: Japan Electronics and Information Technology Industries Assoc. Exif version 2.2 digital still camera image file format standard (Exif) version 2.2, 2002.
• 11: J.-Y. Lee. A method of measuring clearness of images for artificial classification of digital photos. Master's thesis, Pusan National University, 2007.
• 12: A. Loui and A. Savakis. Automatic event clustering and quality screening of comsumer pictures for digital albuming. Multimedia, IEEE Transactions on, 5(3):390--402, 2003.
• 13: T. J. Mills, D. Pye, D. Sinclair, and K. R. Wood. Shoebox: A digital photo management system. Technical report, AT&T Laboratories Cambridge, 2000.
• 14: Mor Naaman , Yee Jiun Song , Andreas Paepcke , Hector Garcia-Molina, Automatic organization for digital photographs with geographic coordinates, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996366]
• 15: Picasa Homepage. http://picasa.google.com/.
• 16: John C. Platt, AutoAlbum: Clustering Digital Photographs using Probabilistic Model Merging, Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL'00), p.96, June 16-16, 2000
• 17: Till Quack , Bastian Leibe , Luc Van Gool, World-scale mining of objects and events from community photo collections, Proceedings of the 2008 international conference on Content-based image and video retrieval, July 07-09, 2008, Niagara Falls, Canada [doi>10.1145/1386352.1386363]
• 18: Pinaki Sinha , Ramesh Jain, Classification and annotation of digital photos using optical context data, Proceedings of the 2008 international conference on Content-based image and video retrieval, July 07-09, 2008, Niagara Falls, Canada [doi>10.1145/1386352.1386394]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications

Keywords:
EXIF, clustering, digital camera, digital photo, image retrieval, photo album, photo clustering