Video rushes summarization utilizing retake characteristics

ABSTRACT

This paper describes the details of NHK's approach to the rushes summarization task in TRECVID 2008. From a broadcaster's point of view, removing redundancy and attaining a pleasant tempo/rhythm, as well as the recall ratio, are important. Here, we introduce a novel means of representative image selection for comparison which can be applied to remove redundancy. Specifically, we make best use of normal behavior of shooting i.e., being motionless until start trigger, and after the trigger performer and camera move almost the same way (same motion.) We have built and tested a summarization system based on this technique. Although the recall ratio in our evaluation was only 33%, the reduction of duplication and the quality of tempo/rhythm were good. Improvements that can be made to our system are discussed based on the results of this evaluation.

REFERENCES

• 1: Paul Over , Alan F. Smeaton , Philip Kelly, The trecvid 2007 BBC rushes summarization evaluation pilot, Proceedings of the international workshop on TRECVID video summarization, p.1-15, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290032]
• 2: http://www.nhk.or.jp/strl/mpf/.
• 3: Y. Kawai, H. Sumiyoshi, and N. Yagi. Shot boundary detection at TRECVID 2007. http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html.
• 4: Daragh Byrne , Peter Kehoe , Hyowon Lee , Ciarán Ó. Conaire , Alan F. Smeaton , Noel E. O'Connor , Gareth J.F. Jones, A user-centered approach to rushes summarisation via highlight-detected keyframes, Proceedings of the international workshop on TRECVID video summarization, p.35-39, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290037]
• 5: Werner Bailer , Felix Lee , Georg Thallinger, Skimming rushes video using retake detection, Proceedings of the international workshop on TRECVID video summarization, p.60-64, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290042]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods

General Terms:
Algorithms, Experimentation

Keywords:
redundancy detection, trecvid, video summarization