The CPR model for summarizing video

ABSTRACT

Most past work on video summarization has been based on selecting key frames from videos. We propose a model of video summarization based on three important parameters: Priority (of frames), Continuity (of the summary), and non-Repetition (of the summary). In short, a summary must include high priority frames, must be continuous and non-repetitive. An optimal summary is one that maximizes an objective function based on these three parameters. We develop formal definitions of all these concepts and provide algorithms to find optimal summaries. We briefly report on the performance of these algorithms.

REFERENCES

• 1: Sibel Adali , K. Selçuk Candan , Su-Shing Chen , Kutluhan Erol , V. S. Subrahmanian, The advanced video information system: data structures and query processing, Multimedia Systems, v.4 n.4, p.172-186, Aug. 1996 [doi>10.1007/s005300050021]
• 2: Thomas H. Cormen , Clifford Stein , Ronald L. Rivest , Charles E. Leiserson, Introduction to Algorithms, McGraw-Hill Higher Education, 2001
• 3: Daniel DeMenthon , Vikrant Kobla , David Doermann, Video summarization by curve simplification, Proceedings of the sixth ACM international conference on Multimedia, p.211-218, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290773]
• 4: Liwei He , Elizabeth Sanocki , Anoop Gupta , Jonathan Grudin, Auto-summarization of audio-video presentations, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.489-498, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319691]
• 5: S. Ju, M. Black, S. Minneman, and D. Kimber. Summarization of Videotaped Presentations: Automatic Analysis of Motion and Gesture. IEEE Trans. on Circuits and Systems for Video Technology, Vol. 8(5), 1998, pp. 686--696.
• 6: Yu-Fei Ma , Lie Lu , Hong-Jiang Zhang , Mingjing Li, A user attention model for video summarization, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641116]
• 7: H.Martin and R.Lozano. Dynamic Generation of Video Abstracts Using an Object Oriented Video DBMS. Networking and Information Systems Journal, Vol. 3(1), 2000, pp. 53--75.
• 8: H.R. Naphide and T.S. Huang. A Probabilistic Framework for Semantic Video Indexing, Filtering, and Retrieval. IEEE Transactions on Multimedia, Vol. 3(1), 2001, pp. 141--151.
• 9: E. Oomoto , K. Tanaka, OVID: Design and Implementation of a Video-Object Database System, IEEE Transactions on Knowledge and Data Engineering, v.5 n.4, p.629-643, August 1993 [doi>10.1109/69.234775]
• 10: Chris Stauffer , W. Eric L. Grimson, Learning Patterns of Activity Using Real-Time Tracking, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.747-757, August 2000 [doi>10.1109/34.868677]
• 11: V. S. Subrahmanian, Principles of multimedia database systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 12: D. Zhong and S.F. Chang. Video Object Model and Segmentation for Content-Based Video Indexing. IEEE Intern. Conf. on Circuits and Systems, June, 1997, Hong Kong.
• 13: Wensheng Zhou , Asha Vellaikal , C. C. Jay Kuo, Rule-based video classification system for basketball video indexing, Proceedings of the 2000 ACM workshops on Multimedia, p.213-216, October 30-November 03, 2000, Los Angeles, California, United States [doi>10.1145/357744.357941]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Multimedia databases

General Terms:
Algorithms, Human Factors, Measurement, Theory

Keywords:
multimedia, summarization, video