The COST292 experimental framework for rushes summarization task in TRECVID 2008

ABSTRACT

In this paper, the method used for Rushes Summarization task by the COST 292 consortium is reported. The approach proposed this year differs significantly from the one proposed in the previous years because of the introduction of new processing steps, like repetition detection in scenes. The method starts with junk frames removal and follows with clustering and scene detection; then for each scene, repetitions are detected in order to extract once the real scene; the following step consists in face detections (faces are considered semantically relevant) and in pan, tilt and zoom detections (other camera motions are usually related to technical operations in the backstage); finally the summary is extracted.

REFERENCES

• 1: Opencv. http://opencvlibrary. sourceforge. net, 2007.
• 2: A. Don, L. Carminati, and J. Benois-Pineau. Detection of visual dialog scenes in video content based on structural and semantic features. In Proc. CBMI'05 Létonie, 2005.
• 3: E. Kasutani and A. Yamada. The mpeg-7 color layout descriptor: a compact image feature description of high-speed image/video segment retrieval. In ICIP 2001 Greece, 2001.
• 4: P. Kraemer, J. Benois-Pineau, and M. Gràcia Pla. Indexing camera motion integrating knowledge of quality of the encoded video. In Proc. SAMT'06 2006.
• 5: M. Meila and J. Shi. Learning segmentation by random walks. In NIPS 2000.
• 6: M. Meila and J. Shi. A random walks view of spectral segmentation, 2001.
• 7: Paul Over , Alan F. Smeaton , George Awad, The trecvid 2008 BBC rushes summarization evaluation, Proceedings of the 2nd ACM TRECVid Video Summarization Workshop, p.1-20, October 31-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1463563.1463564]
• 8: X. Qian, G. Liu, and R. Su. Effective fades and flashlight detection based on accumulating histogram difference. IEEE Transactions On Circuits And Systems For Video Technology 16(10), 2001.
• 9: Jianbo Shi , Jitendra Malik, Normalized Cuts and Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.888-905, August 2000 [doi>10.1109/34.868688]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Algorithms, Experimentation

Keywords:
mid-level features, normalized cuts, repetition detection, spectral clustering