THU-ICRC at rush summarization of TRECVID 2007

ABSTRACT

In this paper, we describe the THU-ICRC system for the rush summarization task of TRECVID07. Our main objective is to abstract a minimal length rush video by removing useless (or low-quality) and redundant frames and reserving important objects and events by video parsing, cast indexing and important factor analysis. In detail, by video parsing and cast indexing, our approach first constructs story boards to let user know about the main scenes and main actors in the video. Then it detects and removes useless frames, e.g. color bar, near-monochrome/ abrupt/shaking frames, and clap boards etc. Finally, we construct the video skimming by key frame clustering, important factor analysis and repetitive segment detection. Particularly, by the two-stage redundancy removing in both key frame level and video sequence level, we achieve a better performance to shorten the video length. Extensive experiments were carried out on 42 testing videos. Good results demonstrate the effectiveness of the proposed method.

REFERENCES

• 1: Chen, X.R., Yuille1, A.L., Detecting and Reading Text in Natural Scenes, IEEE Proc. of CVPR 2004.
• 2: Yong Gao , Tao Wang , Jianguo Li , YangZhou Du , Wei Hu , Yimin Zhang , HaiZhou Ai, Cast indexing for videos by NCuts and page ranking, Proceedings of the 6th ACM international conference on Image and video retrieval, p.441-447, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282345]
• 3: Gong, Y.H., Liu, X., Video Summarization with Minimal Visual Content Redundancies, IEEE Proc. of ICIP 2001, 362--365.
• 4: Li, Y., Ai, H.Z., Huang, C., et. al., Robust Head Tracking with Particles Based on Multiple Cues Fusion, ECCV 2006, 29--39.
• 5: Li, Z., Schuster, G.M., Katsaggelos, A.K., Rate-Distortion Optimial Video Summary Generation, IEEE Trans. on Image Processing, 14(10), 2005.
• 6: Otsuka, I., Nakane, K., Divakaran, A., et. al., A Highlight Scene Detection and Video Summarization System using Audio Feature for a Personal Video Recorder. IEEE Trans. on Consumer Electronics, 51(1):112--116, 2005.
• 7: Paul Over , Alan F. Smeaton , Philip Kelly, The trecvid 2007 BBC rushes summarization evaluation pilot, Proceedings of the international workshop on TRECVID video summarization, p.1-15, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290032]
• 8: Rasheed, Z., Shah, M, Scene Detection in Hollywood Movies and TV shows, IEEE Proc. of CVPR 2003.
• 9: Rasheed, Z., Shah, M., Detection and Representation of Scenes in Videos, IEEE Trans. on Multimedia, 7(6): 1097--1105, Dec. 2005.
• 10: Temple, F. Smith and Michael, S. Waterman. Identification of Common Molecular Subsequences, Journal of Molecular Biology, 147:195--197, 1981.
• 11: Shingo Uchihashi , Jonathan Foote , Andreas Girgensohn , John Boreczky, Video Manga: generating semantically meaningful video summaries, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.383-392, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319654]
• 12: Wu, S., Ma, Y.F., Zhang, H.J., Video Quality Classification Based Home Video Segmentation, IEEE Proc. of ICME 2005.
• 13: Yuan, J.H., Zheng, W.J., Chen, L., etc. Tsinghua University at TRECVID 2004: shot boundary detection and high-level feature extraction, In NIST workshop of TRECVID 2004.
• 14: Zhao, Y.J., Wang, T., Wang, P. et. al., Scene Segmentation and Categorization Using NCuts, IEEE SLAM workshop of CVPR07.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods

General Terms:
Algorithms, Design, Experimentation, Management

Keywords:
cast indexing, important factor, key frame clustering, repetitive segment detection, scene segmentation, video summarization