Video rushes summarization by adaptive acceleration and stacking of shots

ABSTRACT

When witnessing the great increase of video data available, it becomes clear that summarization is one of the great challenges ahead. One particular problem is the summarization of video rushes.

In this paper we present a straightforward approach that addresses this specific challenge. It combines two complementary actions: shot selection by stacking and adaptive acceleration of the playback.

This simple approach provides excellent results, compared at TRECVid 2007. In particular, it offers easy to understand summaries that keep most of the original information, that meet the target compression rate, that have average scores of redundancy perception and that show playing times (by the judges) almost equal to the summaries duration.

REFERENCES

• 1: T. Bärecke, E. Kijak, A. Nürnberger, and M. Detyniecki. Summarizing video information using self-organizing maps. In Proceedings of the IEEE International Conference on Fuzzy Systems - FUZZ--IEEE, pages 540--546, Vancouver, Canada, July 2006.
• 2: N. Boujemaa, J. Fauqueur, and V. Gouet. What's beyond query by example? In L. Shapiro, H. Kriegel, and R. Veltkamp, editors, Trends and Advances in Content-Based Image and Video Retrieval, LNCS. Springer Verlag, 2004.
• 3: Y. Li, S.-H. Lee, C.-H. Yeh, and C.-C. J. Kuo. Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques. IEEE Signal Processing Magazine, pages 79--89, 2006.
• 4: Chin-Yew Lin , Eduard Hovy, From single to multi-document summarization: a prototype system and its evaluation, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073160]
• 5: I. Mani. Automatic Summarization. John Benjamins Pub Co, 2001. ISBN: 978-1588110602.
• 6: Kathleen McKeown , Rebecca J. Passonneau , David K. Elson , Ani Nenkova , Julia Hirschberg, Do summaries help?, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076072]
• 7: Paul Over , Alan F. Smeaton , Philip Kelly, The trecvid 2007 BBC rushes summarization evaluation pilot, Proceedings of the international workshop on TRECVID video summarization, p.1-15, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290032]
• 8: K. Peker and A. Divakaran. Adaptive fast playback based video skimming using a compressed-domain visual complexity measure. In IEEE International Conference on Multimedia and Expo 2004 (ICME'04), volume 3, pages 2055--2058, 2004.
• 9: K. A. Peker, A. Divakaran, and S. Huifang. Constant pace skimming and temporal sub-sampling of video using motion activity. In Proc. of the International Conference on Image Processing, volume 3, pages 414--417, Thessaloniki, Greece, October 2001.
• 10: Frank Shipman , Andreas Girgensohn , Lynn Wilcox, Generation of interactive multi-level video summaries, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957096]
• 11: Alan F. Smeaton , Paul Over , Wessel Kraaij, Evaluation campaigns and TRECVid, Proceedings of the 8th ACM international workshop on Multimedia information retrieval, October 26-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178677.1178722]
• 12: Anastasios Tombros , Mark Sanderson, Advantages of query biased summaries in information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.2-10, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290947]
• 13: Ziyou Xiong , Regunathan Radhakrishnan , Ajay Divakaran , Yong Rui , Thomas S. Huang, A Unified Framework for Video Summarization, Browsing & Retrieval: with Applications to Consumer and Surveillance Video, Academic Press, Inc., Orlando, FL, 2005

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

General Terms:
Algorithms, Experimentation, Performance

Keywords:
TRECVID 2007, adaptive acceleration, skimming, video summarization