Action movies segmentation and summarization based on tempo analysis

ABSTRACT

With the advances of digital video analysis and storage technologies, also the progress of entertainment industry, movie viewers hope to gain more control over what they see. Therefore, tools that enable movie content analysis are important for accessing, retrieving, and browsing information close to a human perceptive and semantic level. We proposed an action movie segmentation and summarization framework based on movie tempo, which represents as the delivery speed of important segments of a movie. In the tempo-based system, we combine techniques of the film domain related knowledge (film grammar), shot change detection, motion activity analysis, and semantic context detection based on audio features to grasp the concept of tempo for story unit extraction, and then build a system for action movies segmentation and summarization. We conduct some experiments on several different action movie sequences, and demonstrate an analysis and comparison according to the satisfactory experimental results

REFERENCES

• 1: Howhard D. Wactlar. The Challenges of Continuous Capture: Contemporaneous Analysis and Customized Summarization of Video Content. CMU, USA.
• 2: Brett Adams, Chitra Dorai, and Svetha Venkatesh. Toward Automatic Extraction of Expressive Elements From Motion Pictures: Tempo. IEEE Trans. on Multimedia, Vol. 4, No. 4, December 2002.
• 3: Arijon, D.. Grammar of the Film Language. Silman-James Press, 1976.
• 4: Media Computing: Computational Media Aesthetics, Kluwer Academic Publishers, Norwell, MA, 2002
• 5: Leo Braudy and Marshall Cohen. Film Theory and Criticism: Introductory Readings. Oxford University Press, 1999.
• 6: Jeroen Vendirg and Marcel Worring. Systematic Evaluation of Logical Story Unit Segmentation. IEEE Trans. on Multimedia, Vol. 4, No. 4, December 2002, pp. 492--499.
• 7: Jeroen Vendrig , Marcel Worring, Interactive Adaptive Movie Annotation, IEEE MultiMedia, v.10 n.3, p.30-37, July 2003 [doi>10.1109/MMUL.2003.1218254]
• 8: Zeeshan Rasheed and Mubarak Shah. Scene Detection in Hollywood Movies and TV Shows. In Proc. of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
• 9: Extraction and Use of MPEG-7 Descriptions, ISO/IEC TR 15938-8:2002(E).
• 10: Bin Yu, Wei-Ying Ma, Klara Nahrstedt, and Hong-Jiang Zhang. Video Summarization Based on User Log Enhanced Link Analysis

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

General Terms:
Management

Keywords:
film grammar, movie content analysis, movie segmentation, movie summarization, story unit, tempo analysis