Automatic creation of indexed presentations from classroom lectures

ABSTRACT

This paper describes a system designed to automatically capture classroom events as videos and images. This content is delivered in several ways, most commonly as indexed multimedia presentations but also in real time as notes of classroom events. This content creation system identifies when significant events occur, e.g., material presented by computer and projected on a screen or written on a standard whiteboard, and saves these events as enhanced images. In parallel with the whiteboard capture, a digitally-zoomed video of the speaker is created. The significant event images (from cameras and computers) are used to create an index into the video and the images, video and index are complied into a Flash presentation. These presentations are used by on-campus or distance students. The event images can also be stored and exported to a Ubiquitous Presenter-style server that provides students with real-time, in-class access. The event images and video are recorded transparently to the lecturer. The lecturer need not make any modifications to teaching style or modality (whiteboard, computer-based presentation, or a combination). The primary focus of this paper is on event image and video capture techniques. The lecture capture system has great benefits for education and we report some initial experience using it in support of computer science curricula.

REFERENCES

• 1: Richard J. Anderson , Ruth Anderson , Tammy VanDeGriff , Steven A. Wolfman , Ken Yasuhara, Classroom presentation from the tablet PC, Proceedings of the 8th annual conference on Innovation and technology in computer science education, June 30-July 02, 2003, Thessaloniki, Greece
• 2: Jason A. Brotherton , Gregory D. Abowd, Lessons learned from eClass: Assessing automated capture and access in the classroom, ACM Transactions on Computer-Human Interaction (TOCHI), v.11 n.2, p.121-155, June 2004 [doi>10.1145/1005361.1005362]
• 3: Roger B. Dannenberg and Peter Capell. Are just-in-time lectures effective at teaching? Webpage, Carnegie Mellon University, 1997.
• 4: Paul Dickson , W. Richards Adrion , Allen Hanson, Automatic Capture of Significant Points in a Computer Based Presentation, Proceedings of the Eighth IEEE International Symposium on Multimedia, p.921-926, December 11-13, 2006 [doi>10.1109/ISM.2006.35]
• 5: Wolfgang Hürst , Gabriela Maass , Rainer Müller , Thomas Ottmann, The "Authoring on the Fly" system for automatic presentation recording, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634072]
• 6: Sugata Mukhopadhyay , Brian Smith, Passive capture and structuring of lectures, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.477-487, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319690]
• 7: Sugata Mukhopadhyay , Brian Smith, Passive capture and structuring of lectures, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.477-487, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319690]
• 8: SonicFoundry. Mediasite.com. http://www.Mediasite.com/, Apr 2006.
• 9: TechSmith. Camtasia studio screen recorder for demos, presentations and training. http://www.techsmith.com/camtasia.asp, Dec 2007.
• 10: Markus Wienecke , Gernot A. Fink , Gerhard Sagerer, Towards Automatic Video-based Whiteboard Reading, Proceedings of the Seventh International Conference on Document Analysis and Recognition, p.87, August 03-06, 2003
• 11: Michelle Wilkerson , William G. Griswold , Beth Simon, Ubiquitous presenter: increasing student access and control in a digital lecturing environment, Proceedings of the 36th SIGCSE technical symposium on Computer science education, February 23-27, 2005, St. Louis, Missouri, USA
• 12: Zhengyou Zhang , Li-Wei He, Whiteboard scanning and image enhancement, Digital Signal Processing, v.17 n.2, p.414-432, March, 2007 [doi>10.1016/j.dsp.2006.05.006]
• 13: Peter Ziewer, Navigational Indices and Content Interlinkage on the Fly, Proceedings of the Eighth IEEE International Symposium on Multimedia, p.915-920, December 11-13, 2006 [doi>10.1109/ISM.2006.114]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Sampling

  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.0 General

General Terms:
Algorithms, Design

Keywords:
automatic capture, image processing, indexing, lecture recording, video creation