Regim, research group on intelligent machines, tunisia, at TRECVID 2008, BBC rushes summarization

ABSTRACT

In this paper, we describe our system used to summarize BBC rushes, the TRECVID database. Our summarization process starts with shot boundary detection. Then we filter obtained shots to retain only useful ones. After that we try to localize from every retained shot the important parts (sub-shots). Finally, we select some of them to formulate the skim. The selection of sub-shots must respond to many criteria as redundancy removing, covering all important events of the original video sequence and not exceeding the upper duration. Genetic algorithms are naturally suited for doing incremental selection. We use it to do the selection of relevant subs-shots. We consider the summarization process as an optimization problem which takes into consideration all evoked criteria. The obtained results are encouraging.

REFERENCES

• 1: David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
• 2: Paul Over , Alan F. Smeaton , George Awad, The trecvid 2008 BBC rushes summarization evaluation, Proceedings of the 2nd ACM TRECVid Video Summarization Workshop, p.1-20, October 31-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1463563.1463564]
• 3: Ba Tu Truong , Svetha Venkatesh, Video abstraction: A systematic review and classification, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.3 n.1, p.3-es, February 2007 [doi>10.1145/1198302.1198305]
• 4: Ellouze, M., Karray, H. and Alimi, A., M. Genetic Algorithm For Summarizing News Stories. In Proceedings of international conference on computer vision theory and applications, pp. 303--308, March 2006.
• 5: Feng Wang , Chong-Wah Ngo, Rushes video summarization by object and event understanding, Proceedings of the international workshop on TRECVID video summarization, p.25-29, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290031.1290035]
• 6: David E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 7: NIST, http://www-nlpir.nist.gov, Last Visited July 2008

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods

General Terms:
Algorithms, Experimentation, Measurement, Performance

Keywords:
bbc rushes, genetic algorithm, optimisation, summarization, trecvid evaluation, video, video skim