Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

In this paper, we describe our approach to the TRECVID 2007 BBC Rushes Summarization task. Our processing is composed of several steps. First the video is segmented into shots. Then, one-second video segments are clustered into similarity classes. The most important non-redundant shots are selected such that they maximize the coverage of those similarity classes. Then shots are dynamically accelerated according to their motion activity to maximize the content per time unit. Finally they are optimally grouped by sets of four to be presented using split-screen display. The summaries produced have been evaluated in the TRECVID campaign. We present a first attempt at automating the evaluation process.

REFERENCES

• 1: R. L. A. Hanjalic and J. Biemond. Automated high-level movie segmentation for advanced video retrieval systems. In IEEE Trans. Circ. Syst. Video Technolo. 9, 4 June, 580--588, 1999.
• 2: M. Cooper and J. Foote. Summarizing video using non-negative similarity matrix factorization. In IEEE Workshop on Multimedia Signal Processing, 2002.
• 3: Y. Gong and X. Liu. Summarizing video by minimizing visual content redundancies. In Proceedings of the International Conference on Multimedia and Expo, 2001.
• 4: Yihong Gong, Summarizing audiovisual contents of a video program, EURASIP Journal on Applied Signal Processing, v.2003 n.1, p.160-169, January 2003 [doi>10.1155/S1110865703211082]
• 5: S. Lee and M. Haye. An application for interactive video abstraction. In Proceedings of the ICASSP Conference, 2004.
• 6: Yu-Fei Ma , Lie Lu , Hong-Jiang Zhang , Mingjing Li, A user attention model for video summarization, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641116]
• 7: B. Merialdo and B. Huet. Automatic video summarization. Chapter in "Interactive Video, Algorithms and Technologies" by Hammoud, Riad (Ed.), 2006, XVI, 250 p, ISBN: 3-540-33214-6.
• 8: Arthur G. Money , Harry Agius, Video summarisation: A conceptual framework and survey of the state of the art, Journal of Visual Communication and Image Representation, v.19 n.2, p.121-143, February, 2008 [doi>10.1016/j.jvcir.2007.04.002]
• 9: Chong-Wah Ngo , Yu-Fei Ma , Hong-Jiang Zhang, Automatic Video Summarization by Graph Modeling, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.104, October 13-16, 2003
• 10: J. Oh and P. Sankuratri. Computation of motion activity descriptors in video sequences. In Proc. of the 2nd WSEAS International Conference on Multimedia, Internet and Video Technologies, pages 139--144, Skiathos Island, Greece, 2002.
• 11: Paul Over , Alan F. Smeaton , Philip Kelly, The trecvid 2007 BBC rushes summarization evaluation pilot, Proceedings of the international workshop on TRECVID video summarization, p.1-15, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290032]
• 12: S. Pfeiffer, R. Lienhart, S. Fischer, and W. Effelsberg. Abstracting digital movies automatically. In Journal of Visual Communication and Image Representation, 1996.
• 13: Henry A. Rowley , Shumeet Baluja , Takeo Kanade, Neural Network-Based Face Detection, Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96), p.203, June 18-20, 1996
• 14: M. Shi Lu King, I.Lyu. Video summarization by video structure analysis and graph optimization. In Proceedings of the International Conference on Multimedia and Expo, 2004.
• 15: Ba Tu Truong , Svetha Venkatesh, Video abstraction: A systematic review and classification, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.3 n.1, p.3-es, February 2007 [doi>10.1145/1198302.1198305]
• 16: T. Volkmer, S. Tahaghoghi, and H. E. Williams. RMIT University at TREC 2004. In E. M. Voorhees and L. P. Buckland, editors, Proceedings of the TRECVID 2004 Workshop, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

General Terms:
Algorithms, Performance