Active capture: automatic direction for automatic movies

ABSTRACT

The Active Capture demonstration is part of a new computational media production paradigm that transforms media production from a manual mechanical process into an automated computational one that can produce mass customized and personalized media integrating video of non-actors. Active Capture leverages media production knowledge, computer vision and audition, and user interaction design to automate direction and cinematography and thus enables the automatic production of annotated, high quality, reusable media assets. The implemented system automates the process of capturing a non-actor performing two simple reusable actions ("screaming" and "turning her head to look at the camera") and automatically integrates those shots into various commercials and movie trailers.

REFERENCES

• 1: Marc Davis, Editing out Video Editing, IEEE MultiMedia, v.10 n.2, p.54-64, March 2003 [doi>10.1109/MMUL.2003.1195161]
• 2: M. Davis. Active Capture: Integrating Human-Computer Interaction and Computer Vision/Audition to Automate Media Capture. In: Proceedings of ICME 2003 in Baltimore, Maryland, IEEE Computer Society Press, Vol. II, 185--188, 2003.
• 3: Marc Davis, Active capture: automatic direction for automatic movies, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957141]
• 4: Frank Nack , Wolfgang Putz, Designing annotation before it's needed, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500180]
• 5: Barry, B. and Davenport, G., Documenting Life: Videography and Common Sense. In: Proceedings of ICME 2003 in Baltimore, Maryland, IEEE Computer Society Press, 2003.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI); Audio input/output
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

  J. Computer Applications
  J.5 ARTS AND HUMANITIES

General Terms:
Algorithms, Design, Human Factors

Keywords:
active capture, automated direction, human-in-the-loop, metadata, recognition, video capture