NTU TRECVID-2007 fast rushes summarization system

ABSTRACT

Rushes are the raw materials used to produce a video. They often contain redundant and repetitive contents. Rushes summarization aims to provide a quick overview for a rushes video. As part of TRECVID 2007, NIST initiates a rushes summarization task. This paper reports on the design of NTU rushes summarization system for this task. Our system consists of three components, shot segmentation, redundant shot detection and summary creation. To tackle the bulky rushes, we focus on efficient but effective feature representations (local color histograms and compressed-domain motion vectors) and summarization methods. In addition, we proposed a novel approach to detect clapper shots which are not only relevant to concise summarizes but also essential for indexing numerous camera takes in the rushes. Even practically efficient and requiring only 40% of the video time for computation, the proposed system achieved satisfying results in TRECVID 2007 rushes summarization task.

REFERENCES

• 1: http://www-nlpir.nist.gov/projects/tv2007/.
• 2: I. Koprinska and S. Carrato. Temporal video segmentation: A survey. 16:477--500, 2001.
• 3: G. Lupatini , C. Saraceno , R. Leonardi, Scene Break Detection: A Comparison, Proceedings of the Workshop on Research Issues in Database Engineering, p.34, February 23-24, 1998
• 4: Paul Over , Alan F. Smeaton , Philip Kelly, The trecvid 2007 BBC rushes summarization evaluation pilot, Proceedings of the international workshop on TRECVID video summarization, p.1-15, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290032]
• 5: I. K. Sethi and N. V. Patel. Statistical approach to scene change detection. In Storage and Retrieval for Image and Video Databases (SPIE), pages 329--338, 1995.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

General Terms:
Algorithms, Design

Keywords:
clapper board, rushes summarization, shot detection