A simplified approach to rushes summarization

ABSTRACT

In this paper we describe methods for video summarization in the context of the TRECVID 2008 BBC Rushes Summarization task. Color, motion, and audio features are used to segment, filter, and cluster the video. We experiment with varying the segment similarity measure to improve the joint clustering of segments with and without camera motion. Compared to our previous effort for TRECVID 2007 we have reduced the complexity of the summarization process as well as the visual complexity of the summaries themselves. We find our objective (inclusion) performance to be competitive with systems exhibiting similar subjective performance.

REFERENCES

• 1: J.-Y. Bouget. Pyramidal implementation of the lucas kanade feature tracker. description of the algorithm. Technical report, Intel Corporation Microprocessor Research Lab, 2000.
• 2: Francine Chen , Matthew Cooper , John Adcock, Video summarization preserving dynamic content, Proceedings of the international workshop on TRECVID video summarization, p.40-44, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290038]
• 3: M. Cooper and J. Foote. Scene boundary detection via video self-similarity analysis. In Proc. IEEE International Conference on Image Processing (ICIP), pages 378--81, 2001.
• 4: Marcin Detyniecki , Christophe Marsala, Video rushes summarization by adaptive acceleration and stacking of shots, Proceedings of the international workshop on TRECVID video summarization, p.65-69, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290043]
• 5: Alexander G. Hauptmann , Michael G. Christel , Wei-Hao Lin , Bryan Maher , Jun Yang , Robert V. Baron , Guang Xiang, Clever clustering vs. simple speed-up for summarizing rushes, Proceedings of the international workshop on TRECVID video summarization, p.20-24, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290034]
• 6: Jim Kleban , Anindya Sarkar , Emily Moxley , Stephen Mangiat , Swapna Joshi , Thomas Kuo , B. S. Manjunath, Feature fusion and redundancy pruning for rush video summarization, Proceedings of the international workshop on TRECVID video summarization, p.84-88, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290047]
• 7: B. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision. In IJCAI81, pages 674--679, 1981.
• 8: Open source computer vision library. http://www.intel.com/technology/computing/- opencv/.
• 9: Paul Over , Alan F. Smeaton , Philip Kelly, The trecvid 2007 BBC rushes summarization evaluation pilot, Proceedings of the international workshop on TRECVID video summarization, p.1-15, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290032]
• 10: Paul Over , Alan F. Smeaton , George Awad, The trecvid 2008 BBC rushes summarization evaluation, Proceedings of the 2nd ACM TRECVid Video Summarization Workshop, p.1-20, October 31-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1463563.1463564]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods

General Terms:
Algorithms, Experimentation, Performance

Keywords:
clustering, presentation, segmentation, video summarization