Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

In order to help the user to grasp the long video content quickly, this paper proposes a novel video summarization approach based on redundancy removal and content ranking. By video parsing and cast indexing, the approach first constructs a story board to let user know about the main scenes and the main actors in the video. Then it generates a "story-constraint summary" by key frame clustering and repetitive segment detection. To shorten the video summary length to a target length, our approach constructs a "time-constraint summary" by important factor based content ranking. Extensive experiments are carried out on TV series, movies, and cartoons. Good results demonstrate the effectiveness of the proposed method.

REFERENCES

• 1: Yong Gao , Tao Wang , Jianguo Li , YangZhou Du , Wei Hu , Yimin Zhang , HaiZhou Ai, Cast indexing for videos by NCuts and page ranking, Proceedings of the 6th ACM international conference on Image and video retrieval, p.441-447, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282345]
• 2: Gong, Y. H., Liu, X., Video Summarization with Minimal Visual Content Redundancies, IEEE Proc. of ICIP 2001.
• 3: Li, Y., Ai, H. Z., Huang, C., et. al., Robust Head Tracking with Particles Based on Multiple Cues Fusion, ECCV 2006.
• 4: Li, Z., Schuster, G. M., Katsaggelos, A. K., Rate-Distortion Optimial Video Summary Generation, IEEE Trans. on Image Processing, 14(10), 2005.
• 5: Otsuka, I., Nakane, K., Divakaran, A., et. al., A Highlight Scene Detection and Video Summarization System using Audio Feature for a Personal Video Recorder. IEEE Trans. on Consumer Electronics, 51(1):112--116, 2005.
• 6: Rasheed, Z., Shah, M, Scene Detection in Hollywood Movies and TV shows, IEEE Proc. of CVPR 2003.
• 7: Rasheed, Z., Shah, M., Detection and Representation of Scenes in Videos, IEEE Trans. on Multimedia, 7(6): 1097--1105, Dec. 2005.
• 8: Temple, F. Smith and Michael, S. Waterman. Identification of Common Molecular Subsequences, Journal of Molecular Biology, 147:195--197, 1981.
• 9: Shingo Uchihashi , Jonathan Foote , Andreas Girgensohn , John Boreczky, Video Manga: generating semantically meaningful video summaries, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.383-392, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319654]
• 10: Yuan, J. H., Zheng, W. J., Chen, L., etc. Tsinghua University at TRECVID 2004: shot boundary detection and high-level feature extraction, In NIST workshop of TRECVID 2004.
• 11: Zhao, Y. J., Wang, T., Wang, P. et. al., Scene Segmentation and Categorization Using NCuts, IEEE SLAM workshop of CVPR07.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods

General Terms:
Algorithms, Design, Experimentation, Management

Keywords:
cast indexing, content ranking, key frame clustering, repetitive segment detection, scene segmentation, video summarization