Simulation of individual spontaneous reactive behavior

ABSTRACT

The context of this work is the search for realism and believability of Virtual Humans. Our contribution to achieve this goal is to enable Virtual Humans (VH) to react to spontaneous events in virtual environments (VE). In order to reflect the individuality of each VH, these reactions have to be expressive and unique. In this paper we present firstly a model of reaction based on personality traits. The model was defined using statistical analysis of real people reacting to unexpected events. We also consider that the emotional state is involved in the modulation of reactions, thus we integrate a model of emotion update. Secondly, we present a semantic-based methodology to compose reactive animation sequences using inverse kinematics (IK) and key frame (KF) interpolation animation techniques. Finally, we present an application that demonstrates how Virtual Humans can produce different movements as reaction to unexpected stimuli, depending on their personality traits and emotional state.

REFERENCES

• 1: Elisabeth André , Martin Klesen , Patrick Gebhard , Steve Allen , Thomas Rist, Integrating models of personality and emotions into lifelike characters, Affective interactions: towards a new generation of computer interfaces, Springer-Verlag New York, Inc., New York, NY, 2001
• 2: Benoît Le Callennec , Ronan Boulic, Interactive motion deformation with prioritized constraints, Graphical Models, v.68 n.2, p.175-193, March 2006 [doi>10.1016/j.gmod.2005.03.001]
• 3: Diane Chi , Monica Costa , Liwei Zhao , Norman Badler, The EMOTE model for effort and shape, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.173-182, July 2000 [doi>10.1145/344779.352172]
• 4: C. Darwin. The Expression of the Emotions in Man And Animals. Digireads. Com, 2005.
• 5: Arjan Egges , Sumedha Kshirsagar , Nadia Magnenat-Thalmann, Generic personality and emotion simulation for conversational agents: Research Articles, Computer Animation and Virtual Worlds, v.15 n.1, p.1-13, March 2004 [doi>10.1002/cav.v15:1]
• 6: P. Ekman. Facial expression and emotion. Am Psychologist, 48:384--392, 1993.
• 7: H. Eysenck. Handbook of personality: Theory and research, chapter Biological dimensions of personality, pages 244--276. New York: Guilford., 1990.
• 8: P. Faloutsos, M. van de Panne, and D. Terzopoulos. The virtual stuntman: dynamic characters with a repertoire of autonomous motor skills. Computers and Graphics, 25(6):933--953, 2001.
• 9: Alejandra García Rojas , Frédéric Vexo , Daniel Thalmann, Individualized reaction movements for virtual humans, Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia, November 29-December 02, 2006, Kuala Lumpur, Malaysia [doi>10.1145/1174429.1174442]
• 10: Taku Komura , Edmond S. L. Ho , Rynson W. H. Lau, Animating reactive motion using momentum-based inverse kinematics: Motion Capture and Retrieval, Computer Animation and Virtual Worlds, v.16 n.3-4, p.213-223, July 2005 [doi>10.1002/cav.v16:3/4]
• 11: Sumedha Kshirsagar , Nadia Magnenat-Thalmann, Virtual humans personified, Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1, July 15-19, 2002, Bologna, Italy [doi>10.1145/544741.544826]
• 12: Stacy Marsella , Jonathan Gratch, A step toward irrationality: using emotion to change belief, Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1, July 15-19, 2002, Bologna, Italy [doi>10.1145/544741.544821]
• 13: R. McCrae and O. John. An introduction to the five-factor model and its applications. Journal of Personality, 60(2):175--215, 1992.
• 14: A. Ortony, G. Clore, and A. Collins. The cognitive structure of emotion. Cambridge University Press., Cambridge, UK, 1988.
• 15: Catherine Pelachaud, Multimodal expressive embodied conversational agents, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101301]
• 16: A. Peternier, D. Thalmann, and F. Vexo. Mental vision: a computer graphics teaching platform. In Edutainment 2006, Technologies for E-Learning and Digital Entertainment. First International Conference, Edutainment 2006. Proceedings (Lecture Notes in Computer Science Vol.3942), pages 223--232, 2006. Virtual Reality Lab., Ecole Polytech. Fed. de Lausanne, Switzerland.
• 17: A. PhysX. Ageia physx system software. http://www.ageia.com/drivers/drivers.html.
• 18: J. Potter. The big five personality test. http://www.outofservice.com/bigfive/, (c) 1996-2007 Atof Inc.
• 19: M. Poznanski and P. Thagard. Changing personalities: towards realistic virtual characters. J. Exp. Theor. Artif. Intell., 17(3):221--241, 2005.
• 20: Protégé, (c) 2005 stanford medical informatics. http://protege.stanford.edu/index.html.
• 21: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 22: D. R. D. Silva, C. A. Siebra, J. L. F. Valadares, A. C. Frery, J. R. Falcão, and G. L. Ramalho. Synthetic actor model for long-term computer games. Virtual Reality, 5:1--10, 2001.
• 23: Wen-Poh Su , Binh Pham , Aster Wardhani, Personality and Emotion-Based High-Level Control of Affective Story Characters, IEEE Transactions on Visualization and Computer Graphics, v.13 n.2, p.281-293, March 2007 [doi>10.1109/TVCG.2007.44]
• 24: B. Tang, Z. Pan, L. Zheng, and M. Zhang. Simulating reactive motions for motion capture animation. In Advances in Computer Graphics, LNCS 4035, pages 531--537. Springer, 2006.
• 25: E. Tanguy, J. J. Bryson, and P. J. Willis. A Dynamic Emotion Representation Model Within a Facial. Animation System. The International Journal of Humanoid Robotics, 2006.
• 26: V. Vinayagamoorthy, M. Gillies, A. Steed, E. Tanguy, X. Pan, C. Loscos, and M. Slate. Building expression into virtual characters. In Eurographics Conference State of the Art Reports, 2006.
• 27: W3C. Owl web ontology language. http://www.w3.org/tr/owl-features/.
• 28: W3C. Owl web ontology language. http://www.w3.org/tr/rdf-sparql-query/.
• 29: H. G. Wallbott. Bodily expression of emotion. European Journal of Social Psychology, 28(6):879--896, December 1998.
• 30: C. M. Whissel. The dictionary of affect in language R. Plutchnik and H. Kellerman (Eds) Emotion: Theory, research and experience: vol 4, The measurement of emotions. Academic Press, New York, 1989.
• 31: Ian H. Witten , Eibe Frank, Data mining: practical machine learning tools and techniques with Java implementations, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000
• 32: Victor Brian Zordan , Jessica K. Hodgins, Motion capture-driven simulations that hit and react, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545276]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

Keywords:
animation, cognitive simulation, expressive animation, reactive behavior, semantics, virtual humans animation, virtual reality