Rushes summarization by IRIM consortium: redundancy removal and multi-feature fusion

ABSTRACT

In this paper, we present the first participation of a consortium of French laboratories, IRIM, to the TRECVID 2008 BBC Rushes Summarization task. Our approach resorts to video skimming. We propose two methods to reduce redundancy, as rushes include several takes of scenes. We also take into account low and mid-level semantic features in an ad-hoc fusion method in order to retain only significant content

REFERENCES

• 1: Paul Over , Alan F. Smeaton , George Awad, The trecvid 2008 BBC rushes summarization evaluation, Proceedings of the 2nd ACM TRECVid Video Summarization Workshop, p.1-20, October 31-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1463563.1463564]
• 2: Emilie Dumont , Bernard Merialdo, Split-screen dynamically accelerated video summaries, Proceedings of the international workshop on TRECVID video summarization, p.55-59, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290041]
• 3: Alexander G. Hauptmann , Michael G. Christel , Wei-Hao Lin , Bryan Maher , Jun Yang , Robert V. Baron , Guang Xiang, Clever clustering vs. simple speed-up for summarizing rushes, Proceedings of the international workshop on TRECVID video summarization, p.20-24, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290034]
• 4: Feng Wang , Chong-Wah Ngo, Rushes video summarization by object and event understanding, Proceedings of the international workshop on TRECVID video summarization, p.25-29, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290035]
• 5: Ayache, S., Quénot, G. and Gensel, J. 2006 CLIPS-LSR Experiments at TRECVID 2006. TRECVID'2006 Workshop. Gaithersburg, MD, USA.
• 6: G. Camara-Chavez, M. Cord, S. Philipp-Foliguet, F. Precioso and A. de Albuquerque Araujo, "Robust Scene Cut Detection by Supervised Learning", in Proceedings of EUSIPCO 2006, Firenze, Italy, 2006
• 7: Praat, http://www.fon.hum.uva.nl /praat/
• 8: Kihl, O., Tremblais, B., and Augereau, B. 2008. Multivariate orthogonal polynomials to extract singular points. In Proceedings of ICIP'06, San Diego, USA, October 2008
• 9: OpenCV, http://opencvlibrary.sourceforge.net
• 10: Don, A. and Carminati, L. 2005. Detection of Visual Dialog Scenes in Video Content Based on Structural and Semantic Features. In proceedings of CBMI'2005.
• 11: Kraemer, P., Benois-Pineau, J. and Gracia Pla, M. 2006. Indexing Camera Motion Integrating Knowledge of Quality of the Encoded Video. Proceedings of 1 st International Conference on Semantic and Digital Media Technologies (SAMT).
• 12: A. Andoni, M. Datar, N. Immorlica, P. Indyk, and V. Mirrokni, "Locality-Sensitive Hashing Scheme Based on p-Stable Distributions", in the book "Nearest Neighbor Methods in Learning and Vision: Theory and Practice", T. Darrell and P. Indyk and G. Shakhnarovich (eds.), MIT Press, 2006
• 13: S. Benini, A. Bianchetti, R. Leonardi and P. Migliorati, ''Extraction of Significant Video Summaries by Dendrogram Analysis,'' in Proceedings of ICIP'06, Atlanta, GA, USA, October 8--11, 2006
• 14: Li, Y. and Kuo, C. C. J., 2003. Video Content Analysis using Multimodal Information. Kluwer Academic Publishers.
• 15: Jim Kleban , Anindya Sarkar , Emily Moxley , Stephen Mangiat , Swapna Joshi , Thomas Kuo , B. S. Manjunath, Feature fusion and redundancy pruning for rush video summarization, Proceedings of the international workshop on TRECVID video summarization, p.84-88, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290047]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Algorithms, Experimentation

Keywords:
approximate k-nn clustering, audio activity, camera motion, face detection, ha clustering, information fusion, mid-level-features, motion features, sbd