Event recognition from photo collections via PageRank

ABSTRACT

We propose a method of mining most informative features for the event recognition from photo collections. Our goal is to classify different event categories based on the visual content of a group of photos that constitute the event. Such photo groups are typical in a personal photo collection of different events. Visual features are extracted from the images, yet the features from individual images are often noisy and not all of them represent the distinguishing characteristics of an event. We employ the PageRank technique to mine the most informative features from the images that belong to the same event. Subsequently, we classify different event categories using the multiple images of the same event because we argue that they are more informative about the content of an event rather than any single image. We compare our proposed approach with the standard bag of features method (BOF) and observe considerable improvements in recognition accuracy.

REFERENCES

• 1: L. Zelnik-Manor and M. Irani. Event-based analysis of video, CVPR 2001.
• 2: D. Xu and S.-F. Chang. Video event recognition using kernel methods with multilevel temporal alignment, PAMI 2008.
• 3: S. Ebadollahi, L. Xie, S.-F. Chang, J. R. Smith. Visual event detection using multi-dimensional concept dynamics, ICME 2006.
• 4: J. Liu , Y. Zhai, et al. University of Central Florida at TRECVID 2006: High-Level Feature Extraction and Video Search, TRECVID 2006.
• 5: J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videos in the wild, CVPR 2009.
• 6: W. Jiang and A. C. Loui. Semantic event detection based on visual concept prediction, ICME 2008.
• 7: A. Oliva and A. Torralba. Modeling the shape of the scene: a holistic representation of the spatial envelope, IJCV 2001.
• 8: G. Kim, C. F. and M. Hebert. Unsupervised modeling of object categories using link analysis techniques, CVPR 2008.
• 9: Y. Wu, J.-Y. Bouguet, A. Nefian, and I. Kozintsev. Learning concept templates from web images to query personal image databases, ICME 2007.
• 10: L. Cao, J. Luo, H. Kautz and T. S. Huang. Annotating collections of photos using hierarchical event and scene models, CVPR 2008.
• 11: J. Yuan, J. Luo and Y. Wu. Mining compositional features, CVPR 2008.
• 12: J. Liu, Y. Yang and M. Shah. Learning Semantic Visual Vocabularies Using Diffusion Distance, CVPR 2009.
• 13: Y. Jing and S. Baluja. VisualRank: Applying PageRank to large-scale image search, PAMI 2008.
• 14: D. G. Lowe. Distinctive image features from scale invariant keypoints, IJCV 2004.
• 15: M. Leordeanu and M. Hebert. A spectral technique for correspondence problems using pair wise constraints, ICCV 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Image databases
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Experimentation

Keywords:
CBIR, event category recognition, pagerank