System for authoring highly interactive, personality-rich interactive characters

ABSTRACT

We describe an innovative system for authoring expressive, fully autonomous interactive characters. The focus of our work is creating a system to allow rich authoring that captures as much of the artistic intent of the author in procedural form as we can, and that provides automatic support for expressive execution of that content. The system is composed of two parts: (1)a programming language with unusual language features including concurrency, reflection, backtracking, continuously monitored expressions, and a model of emotion, that was created for the expression of interactive self-animating characters; and (2) a motion synthesis system that combines hand-animated motion data with artistically authored procedures for generalizing the motion while preserving the artistic intent. This system has been used to create over a dozen interactive characters, which have been shown at juried venues, as well as being deployed commercially. We describe how artistic qualities important to interactive characters are encoded and supported using this system, and demonstrate the system with an implemented interactive character.

REFERENCES

• 1: Elisabeth André , Thomas Rist, Presenting through performing: on the use of multiple lifelike characters in knowledge-based presentation systems, Proceedings of the 5th international conference on Intelligent user interfaces, p.1-8, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325745]
• 2: Bruce Blumberg , Marc Downie , Yuri Ivanov , Matt Berlin , Michael Patrick Johnson , Bill Tomlinson, Integrated learning for interactive synthetic characters, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 3: Norman I. Badler , Cary B. Phillips , Bonnie Lynn Webber, Simulating humans: computer graphics animation and control, Oxford University Press, Inc., New York, NY, 1993
• 4: John Funge , Xiaoyuan Tu , Demetri Terzopoulos, Cognitive modeling: knowledge, reasoning and planning for intelligent characters, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.29-38, July 1999 [doi>10.1145/311535.311538]
• 5: Jonathan Gratch , Stacy Marsella, Tears and fears: modeling emotions and emotional behaviors in synthetic agents, Proceedings of the fifth international conference on Autonomous agents, p.278-285, May 2001, Montreal, Quebec, Canada [doi>10.1145/375735.376309]
• 6: Frank Sebastian Grassia , Andrew Witkin, Believable automatically synthesized motion by knowledge-enhanced motion transformation, 2000
• 7: Jessica K. Hodgins , Nancy S. Pollard, Adapting simulated behaviors for new characters, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.153-162, August 1997 [doi>10.1145/258734.258822]
• 8: {Joh95} Johnson M. P.: Exploiting Quaternions to Support Expressive Interactive Character Motion. PhD thesis, Massachusetts Institute of Technology, 1995.
• 9: Lucas Kovar , Michael Gleicher , Frédéric Pighin, Motion graphs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 10: {LB93} Loyall A. B., Bates J.: Real-time control of animated broad agents. In Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society (1993).
• 11: Aaron Bryan Loyall, Believable agents: building interactive personalities, 1997
• 12: James C. Lester , Luke S. Zettlemoyer , Joël P. Grégoire , William H. Bares, Explanatory lifelike avatars: performing user-centered tasks in 3D learning environments, Proceedings of the third annual conference on Autonomous Agents, p.24-31, April 1999, Seattle, Washington, United States [doi>10.1145/301136.301154]
• 13: {MS02} Mateas M., Stern A.: Architecture, Authorial Idioms and Early Observations of the Interactive Drama Facade. Tech. Rep. CMU-CS-02-198, Department of Computer Science, Carnegie Mellon University, 2002.
• 14: {MTT87} Magnenat-Thalmann N., Thalmann D.: The direction of synthetic actors in the film rendez-vous à montréal. IEEE Computer Graphics and Applications 7, 12 (1987).
• 15: {Nea96} Neal Reilly W. S.: Believable Social and Emotional Agents. PhD thesis, Computer Science Department, Carnegie Mellon, 1996.
• 16: Ken Perlin , Athomas Goldberg, Improv: a system for scripting interactive actors in virtual worlds, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.205-216, August 1996 [doi>10.1145/237170.237258]
• 17: Charles Rose , Michael F. Cohen , Bobby Bodenheimer, Verbs and Adverbs: Multidimensional Motion Interpolation, IEEE Computer Graphics and Applications, v.18 n.5, p.32-40, September 1998 [doi>10.1109/38.708559]
• 18: Craig W. Reynolds, Flocks, herds and schools: A distributed behavioral model, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.25-34, August 1987
• 19: {RJ99} Rickel J., Johnson W. L.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13 (1999), 343--382.
• 20: Phoebe Sengers , Joseph Bates, Antiboxology: agent design in cultural context, 1998
• 21: Andrew Witkin , Michael Kass, Spacetime constraints, ACM SIGGRAPH Computer Graphics, v.22 n.4, p.159-168, Aug. 1988
• 22: Andrew Witkin , Zoran Popovic, Motion warping, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.105-108, September 1995 [doi>10.1145/218380.218422]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General