Personal photo album summarization

ABSTRACT

Photo album summarization is the process of selecting a subset of photos from a larger collection which best preserves the information in the entire set and is semantically coherent. In this paper we propose a system which uses heterogeneous information sources associated with digital photos and generates a summary. Our algorithm adapts itself based on the type of event it is summarizing (Yearbook, Week or Single Day Event) We model the summarization problem as a retrieval problem based on different types of queries. We propose some evaluation metrics for the summary. We use an intuitive web based interface to present the results so that users can further explore the summary in an interactive way. This system is our submission to the CeWe Challenge for the Next Generation of Tangible Multimedia Products.

REFERENCES

• 1: B. Frey and D. Dueck. Clustering by passing messages between data points. Science, 315(5814):972, 2007.
• 2: J. Li, J. Lim, and Q. Tian. Automatic summarization for personal digital photos. In ICSP, Pacific Rim Conf in Multimedia, volume 3, 2003.
• 3: A. Oliva and A. Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope. IJCV, 42(3):145--175, 2001.
• 4: P. Sinha. http://esl.ics.uci.edu/photosummary.html.
• 5: P. Sinha and R. Jain. Classification and annotation of digital photos using optical context data. In Proc of CIVR, pages 309--318. ACM New York, NY, USA, 2008.
• 6: S. Uchihashi, J. Foote, A. Girgensohn, and J. Boreczky. Video Manga: generating semantically meaningful video summaries. In Proc of ACM Multimedia (Part 1), pages 383--392. ACM New York, NY, USA, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

General Terms:
Algorithms, Design

Keywords:
CeWe, multimedia grand challenge, photo album summarization, summary