CAMEO - camera, audio and motion with emotion orchestration for immersive cinematography

ABSTRACT

This paper introduces a system for an automatic 3D animation production, CAMEO, which offers various kinds of direction knowledge from the real world in a unified manner. To accumulate direction knowledge, we have worked in cooperation with real world experts and developed a system which orchestrates direction knowledge into computer algorithm and data. We also defined a set of XML schema to represent 3D animation contents in XML format. The advantage of our approach is the harmony of direction factors which enables users to write the narrative and expect 3D animation reflected with all direction factors automatically.

REFERENCES

• 1: A. Arya and S. DiPaola. Face modeling and animation language for mpeg-4 xmt framework. IEEE Trans. on Multimedia, 15(5):795--825, October 2007.
• 2: Pedro Cano , Markus Koppenberger , Nicolas Wack, Content-based music audio recommendation, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101181]
• 3: D. K. Elson and M. O. Riedl. A lightweight intelligent virtual cinematography system for machinima production. In Proc. of AIIDE, pages 8--13. LNCS, March 2007.
• 4: J. H. Haag and H. R. Cole. The Complete Guide to Standard Script Formats: The Screenplay. CMC Publishing, Hollywood, 1980.
• 5: M. Hayashi, H. Ueda, T. Kurihara, and M. Yasumura. Tvml-automatic tv program generation from text-based script. In Proc. of Imagina, pages 84--89. LNCS, March 1999.
• 6: Li-wei He , Michael F. Cohen , David H. Salesin, The virtual cinematographer: a paradigm for automatic real-time camera control and directing, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.217-224, August 1996 [doi>10.1145/237170.237259]
• 7: Y. C. Huang and S. K. Jenor. An audio recommendation system based on audio signature description scheme in mpeg-7 audio. IEEE Int. Conference on Multimedia and Expo, 1:639--642, 2004.
• 8: Smil-animation. http://www.w3.org/TR/smil-animation/.
• 9: W3C Synchronized Multimedia. SMIL: The Synchronized Multimedia Integration Language.
• 10: Inscape. http://www.inscapers.com.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics

Keywords:
intelligent cinematography, virtual director, xml