Towards virtual videography (poster session)

ABSTRACT

Videographers have developed an art of conveying events in video. Through choices made in cinematography, editing, and post-processing, effective video presentations can be created from events recorded with little or no intrusion. In this paper, we explore systems that bring videography to situations where cost or time issues preclude application of the art. Our goal is to develop virtual videography, that is, systems that can help automate the process of creating an effective video presentation from given footage. In this paper, we discuss how virtual videography systems can be constructed by combining image-based rendering to synthetically generate shots with image understanding to help choose what should be shown to the viewer. To this, visual effects can be added to enhance the presentation, lessening the degradation caused by the medium.

REFERENCES

• 1: Gregory D. Abowd , Christopher G. Atkeson , Ami Feinstein , Cindy Hmelo , Rob Kooper , Sue Long , Nitin Sawhney , Mikiya Tani, Teaching and learning as multimedia authoring: the classroom 2000 project, Proceedings of the fourth ACM international conference on Multimedia, p.187-198, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244191]
• 2: S. Avidan , A. Shashua, Novel view synthesis in tensor space, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1034, June 17-19, 1997
• 3: Ronald Baecker , Alan J. Rosenthal , Naomi Friedlander , Eric Smith , Andrew Cohen, A multimedia system for authoring motion pictures, Proceedings of the fourth ACM international conference on Multimedia, p.31-42, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244142]
• 4: M. Bianchi. Autoauditorium: a fully automatic, multi-camera system to televise auditorium presentations, 1998.
• 5: David Bordwell and Kristin Thompson. Film Art: An Introduction. The McGraw-Hill Companies, Inc., 1997.
• 6: G. Cruz , R. Hill, Capturing and playing multimedia events with STREAMS, Proceedings of the second ACM international conference on Multimedia, p.193-200, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192654]
• 7: Steven M. Drucker , David Zeltzer, CamDroid: a system for implementing intelligent camera control, Proceedings of the 1995 symposium on Interactive 3D graphics, p.139-144, April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199428]
• 8: Li-wei He , Michael F. Cohen , David H. Salesin, The virtual cinematographer: a paradigm for automatic real-time camera control and directing, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.217-224, August 1996 [doi>10.1145/237170.237259]
• 9: M. Hunke and A. Waibel. Face locating and tracking for human-computer interaction, 1994.
• 10: John D. Gould , John Conti , Todd Hovanyecz, Composing letters with a simulated listening typewriter, Proceedings of the 1982 conference on Human factors in computing systems, p.367-370, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801813]
• 11: P. Karp and S. Feiner. Automated presentation planning of animation using task decomposition with heuristic reasoning. Graphics Interface '93, pages 118-127, May 1993.
• 12: S. Katz. Film Directing Shot by Shot: Visualizing from Concept to Screen. Michael Wiese Productions, 1991.
• 13: J. F. Kelley, An iterative design methodology for user-friendly natural language office information applications, ACM Transactions on Information Systems (TOIS), v.2 n.1, p.26-41, Jan. 1984 [doi>10.1145/357417.357420]
• 14: Russell A. Manning , Charles R. Dyer, Dynamic view interpolation without affine reconstruction, Confluence of computer vision and computer graphics, Kluwer Academic Publishers, Norwell, MA, 2000
• 15: Sugata Mukhopadhyay , Brian Smith, Passive capture and structuring of lectures, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.477-487, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319690]
• 16: Steven Maxwell Seitz , Charles R. Dyer, Image-based transformation of viewpoint and scene appearance, 1997
• 17: R. Szeliski. Image mosaicing for tele-reality applications. In WACV94, pages 44-53, 1994.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION

General Terms:
Experimentation, Verification

Keywords:
automatic presentation, educational technology, videography