Tracking users' capture intention: a novel complementary view for home video content analysis

ABSTRACT

In this paper, we present a novel view to home video content analysis, which aims at tracking the capture intention of camcorder users. Based on the study of intention mechanism in psychology, a set of domain-specific capture intention concepts are defined. A comprehensive and extensible scheme consisting of video structuring, intention oriented feature analysis, as well as intention unit segmentation and classification is proposed to mine the users' capture intention. Experiments were carried on home video sequences of 90 hours in total, taken by 16 persons in recent 20 years. Both the user study and objective evaluations indicate that our proposed intention-based approach is an effective complement to existing home video content analysis schemes.

REFERENCES

• 1: M. E. Bratman. Intention, Plans, and Practical Reason. Harvard University Press, 1987.
• 2: R. Cai, L. Lu, H.-J. Zhang, and L.-H. Cai. Improve audio representation by using feature structure patterns. In Proceedings of ICASSP, 2004.
• 3: R. J. Gerrig and P. G. Zimbardo. Psychology and Life (16 Edition). Allyn & Bacon, 2001.
• 4: Andreas Girgensohn , John Boreczky , Patrick Chiu , John Doherty , Jonathan Foote , Gene Golovchinsky , Shingo Uchihashi , Lynn Wilcox, A semi-automatic approach to home video editing, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.81-89, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354415]
• 5: X.-S. Hua, L. Lu, and H.-J. Zhang. Optimization-based automated home video editing system. IEEE Trans. on Circuit and System for Video Technology, 14(5):572--583, May 2004.
• 6: J. G. Kim, H. S. Chang, J. Kim, and H. M. Kim. Efficient camera motion characterization for mpeg video indexing. In Proceedings of ICME, 2000.
• 7: R. Lienhart. Dynamic video summarization of home video. In Proceedings of SPIE Storage and Retrieval for Media Databases, 2000.
• 8: Yu-Fei Ma , Lie Lu , Hong-Jiang Zhang , Mingjing Li, A user attention model for video summarization, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641116]
• 9: Yu-Fei Ma , Hong-Jiang Zhang, Contrast-based image attention analysis by using fuzzy growing, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957094]
• 10: T. Mei, X.-S. Hua, H.-Q. Zhou, and S. Li. To mine the capture intention of camcorder users. In Proceedings of VCIP, 2005.
• 11: R. Oami, A. B. Benitez, S.-F. Chang, and N. Dimitrova. Understanding and modeling user interests in consumer videos. In Proceedings of ICME, 2004.
• 12: Y. Rui and P. Anandan. Segmenting visual actions based on spatio-temporal motion patterns. In Proceedings of CVPR, 2000.
• 13: Robert E. Schapire, Theoretical Views of Boosting and Applications, Proceedings of the 10th International Conference on Algorithmic Learning Theory, p.13-25, December 06-08, 1999
• 14: P. Wu. A semi-automatic approach to detect highlights for home video annotation. In Proceedings of ICASSP, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis

General Terms:
Algorithms, Human Factors

Keywords:
attention detection, capture intention, video content analysis