Hierarchical topical segmentation in instructional films based on cinematic expressive functions

ABSTRACT

In this paper, we propose a novel solution for segmenting an instructional video into hierarchical topical sections. Incorporating the knowledge of education-oriented film theory with our previous study of expressive functions namely the content density and the thematic functions, we develop an algorithm to effectively structuralize an instructional video into a two-tiered hierarchy of topical sections at the main and sub-topic levels. Our experimental results on a set of ten industrial instructional videos demonstrate the validity of the detection scheme.

REFERENCES

• 1: B. Adams, C. Dorai, and S. Venkatesh. Role of shot length in characterizing tempo and dramatic story sections in motion pictures. In IEEE Pacific Rim Conference on Multimedia 2000, pages 54--57, Sydney, Australia, December 2000.
• 2: S. R. Cartwright. Designing and Producing Media-Based Training. Focal Press, August 1999.
• 3: CMA. http://www.cs.curtin.edu.au/~svetha/cma-current/index.html.
• 4: Carlo Colombo , Alberto Del Bimbo , Pietro Pala, Retrieval of Commercials by Semantic Content: The Semiotic Perspective, Multimedia Tools and Applications, v.13 n.1, p.93-118, January 2001 [doi>10.1023/A:1009681324605]
• 5: R. Deriche. Recursively implementing the gaussian and it's derivatives. In Proc. 2nd Singapore Int. Conf. on Image Processing, pages 263--267, 1992.
• 6: L. Herman. Educational Films: Writing, Directing, and Producing for Classroom, Television, and Industry. Crown Publishers, INC., New York, 1965.
• 7: Tiecheng Liu , John R. Kender, A Hidden Markov Model Approach to the Structure of Documentaries, Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL'00), p.111, June 16-16, 2000
• 8: Z. Liu and Q. Huang. Detecting news reporting using audio/visual information. In International Conference on Image Processing, pages 24--28, Kobe, Japan, October 1999.
• 9: MOCHA. http://www.informatik.uni-mannheim.de/informatik/pi4/projects/MoCA.
• 10: Dinh Q. Phung , Svetha Venkatesh , Chitra Dorai, High level segmentation of instructional videos based on content density, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641068]
• 11: D. Q. Phung, S. Venkatesh, and C. Dorai. On extraction of thematic and dramatic functions in educational films. In IEEE International Conference on Multimedia and Expo, Baltimore, New York, USA, 6-9 July 2003.
• 12: Tanveer Syeda-Mahmood , S. Srinivasan, Detecting topical events in digital video, Proceedings of the eighth ACM international conference on Multimedia, p.85-94, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.354433]
• 13: L. Xie, S.-F. Chang, A. Divakaran, and H. Sun. Learning hierarhical hidden markov models for unsupervised structure discovery from video. Technical report, Columbia University, New York, December 2002.
• 14: H. Zettl. Sight, Sound, Motion: Applied Media Aesthetics. Wadsworth Publishing Company, 3rd edition, 1999.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.m MISCELLANEOUS

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

General Terms:
Algorithms, Experimentation, Measurement

Keywords:
cinematic expressive functions, instructional films, media aesthetics, narrative structure, topic detection/segmentation