Synchronization of lecture videos and electronic slides by video text analysis

ABSTRACT

An essential goal of structuring lecture videos captured in live presentation is to provide a synchronized view of video clips and electronic slides. This paper presents an automatic approach to match video clips and slides based on the analysis of text embedded in lecture videos. We describe a method to reconstruct high-resolution video texts from multiple keyframes for robust OCR recognition. A two-stage matching algorithm based on the title and content similarity measures between video clips and slides is also proposed.

REFERENCES

• 1: Gregory D. Abowd , Christopher G. Atkeson , Ami Feinstein , Cindy Hmelo , Rob Kooper , Sue Long , Nitin Sawhney , Mikiya Tani, Teaching and learning as multimedia authoring: the classroom 2000 project, Proceedings of the fourth ACM international conference on Multimedia, p.187-198, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244191]
• 2: H. Aradhye et. al., "Study of Embedded Font Context and Kernel Space Methods for Improved Videotext Recognition," IBM Research Report RC 22064, 2001.
• 3: Xilin Chen , Jie Yang , Jing Zhang , Alex Waibel, Automatic Detection of Signs with Affine Transformation, Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision, p.32, December 03-04, 2002
• 4: S. G. Deshpande & J.-N. Hwang, "A Real-time Interactive Virtual Classroom Multimedia Distance Learning System," IEEE Trans on Multimedia, vol. 3, no. 4, pp. 432--444, 2001.
• 5: Dinh Q. Phung , Svetha Venkatesh , Chitra Dorai, High level segmentation of instructional videos based on content density, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641068]
• 6: Liwei He , Elizabeth Sanocki , Anoop Gupta , Jonathan Grudin, Auto-summarization of audio-video presentations, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.489-498, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319691]
• 7: S. X. Ju et. al, "Summarization of Videotaped Presentations: Automatic Analysis of Motion and Gesture," IEEE Trans on CSVT, vol. 8, no. 5, pp. 686--696, 1998.
• 8: T. F. S. -Mahmood, "Indexing for topics in videos using foils," Int. Conf. CVPR, pp. 312--319, 2000.
• 9: Sugata Mukhopadhyay , Brian Smith, Passive capture and structuring of lectures, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.477-487, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319690]
• 10: C. W. Ngo, T. C. Pong & T. S. Huang, "Detection of Slide Transition for Topic Indexing," Proc. ICME, 2002.
• 11: L. A. Rowe & J. M. Gonzlez, "BMRC Lecture Browser," http://bmrc.berkeley.edu/frame/projects/lb/index.html
• 12: Esko Ukkonen, Algorithms for approximate string matching, Information and Control, v.64 n.1-3, p.100-118, Jan./Feb./March 1985 [doi>10.1016/S0019-9958(85)80046-2]
• 13: OmniPage Pro 12, http://www.scansoft.com/omnipage/

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis

General Terms:
Algorithms, Design, Experimentation, Management

Keywords:
lecture videos, synchronization, video text analysis