Video redundancy detection in rushes collection

ABSTRACT

The rushes is a collection of raw material videos. There are various redundancies, such as rainbow screen, clipboard shot, white/black view, and unnecessary re-take. This paper develops a set of solutions to remove these video redundancies as well as an effective system for video summarisation. We regard manual editing effects, e.g. clipboard shots, as differentiators in the visual language. A rushes video is therefore divided into a group of subsequences, each of which stands for a re-take instance. A graph matching algorithm is proposed to estimate the similarity between re-takes and suggests the best instance for content presentation. The experiments on the Rushes 2008 collection show that a video can be shortened to 4%-16% of the original size by redundancy detection. This significantly reduces the complexity in content selection and leads to an effective and efficient video summarisation system.

REFERENCES

• 1: W. Bailer, F. Lee, and G. Thallinger. Detecting and clustering multiple takes of one scene. In MMM, pages 80--89, 2008.
• 2: A. Bensaid, L. Hall, J. Bezdek, L. Clarke, M. Silbiger, J. Arrington, and R. Murtagh. Validity-guided (re)clustering with applications to image segmentation. IEEE Transactions on Fuzzy Systems, 4(3):112--123, 1996.
• 3: I. P. Gunawan and M. Ghanbari. Reduced-reference picture quality estimation by using local harmonic amplitude information. In in Proc. London Communications Symposium, pages 137--140, University College London, UK, September 2003.
• 4: R. Lienhart. Comparisons of automatic shot boundary detection algorithms. In Proc of SPIE Storage and Retrieval for Image and Video Database, volume 3656, pages 290--301, 1999.
• 5: Paul Over , Alan F. Smeaton , George Awad, The trecvid 2008 BBC rushes summarization evaluation, Proceedings of the 2nd ACM TRECVid Video Summarization Workshop, p.1-20, October 31-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1463563.1463564]
• 6: Reede Ren , Punitha Puttu Swamy , Joemon M. Jose , Jana Urban, Attention-based video summarisation in rushes collection, Proceedings of the international workshop on TRECVID video summarization, p.89-93, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290048]
• 7: L. Xie, L. Kennedy, S.-F. Chang, A. Divakaran, H. Sun, and C.-Y. Lin. Discovering meaningful multimedia patterns with audio-visual concepts and associated text. In ICIP, Singapore, Oct 2004.
• 8: Xuanli Lisa Xie , Gerardo Beni, A Validity Measure for Fuzzy Clustering, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.8, p.841-847, August 1991 [doi>10.1109/34.85677]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.0 General

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.2 Information Storage

General Terms:
Algorithms, Theory

Keywords:
attention-based content selection, edit effect detection, re-take detection, rushes collection