ALMA: a layered model of affect

ABSTRACT

In this paper we introduce ALMA - A Layered Model of Affect. It integrates three major affective characteristics: emotions, moods and personality that cover short, medium, and long term affect. The use of this model consists of two phases: In the preparation phase appraisal rules and personality profiles for characters must be specified with the help of AffectML - our XML based affect modeling language. In the runtime phase, the specified appraisal rules are used to compute real-time emotions and moods as results of a subjective appraisal of relevant input. The computed affective characteristics are represented in AffectML and can be processed by sub-sequent modules that control the cognitive processes and physical behavior of embodied conversational characters. ALMA is part of the VirtualHuman project which develops interactive virtual characters that serve as dialog partners with human-like conversational skills. ALMA provides our virtual humans with a personality profile and with real-time emotions and moods. These are used by the multimodal behavior generation module to enrich the lifelike and believable qualities.

REFERENCES

• 1: R. Hill , J. Gratch , W. L. Johnson , C. Kyriakakis , C. LaBore , R. Lindheim , S. Marsella , D. Miraglia , B. Moore , J. Morie , J. Rickel , M. Thiébaux , L. Tuch , R. Whitney , J. Douglas , W. Swartout, Toward the holodeck: integrating graphics, sound, character and story, Proceedings of the fifth international conference on Autonomous agents, p.409-416, May 2001, Montreal, Quebec, Canada [doi>10.1145/375735.376390]
• 2: C. Rocchi , O. Stock , M. Zancanaro , M. Kruppa , A. Krüger, The museum visit: generating seamless personalized presentations on multiple devices, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964517]
• 3: Janet Horowitz Murray, Hamlet on the Holodeck: The Future of Narrative in Cyberspace, MIT Press, Cambridge, MA, 1998
• 4: Ryokai, K., Vaucelle, C., Cassell, J. Virtual peers as partners in storytelling and literacy learning. In: Journal of Computer Assisted Learning, 19, 2, 2003, 195--208.
• 5: McBreen H, Jack M Evaluating Humanoid Synthetic Agents in E-Retail Applications IEEE Trans. On Systems, Man, and Cybernetics-Part A: Systems and Humans, vol. 31, 5, 2001, 394--405.
• 6: Elmo M. A. Diederiks, Buddies in a box: animated characters in consumer electronics, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA [doi>10.1145/604045.604055]
• 7: Lester J., Voerman J. L., Towns S. G., and Callaway C. B.. Cosmo: A life-like animated pedagogical agent with deictic believability. In Proc. of the IJCAI97 Workshop on Animated Interface Agents: Making them Intelligent, Nagoya, 1997.
• 8: Jonathan Gratch, Émile: Marshalling passions in training and education, Proceedings of the fourth international conference on Autonomous agents, p.325-332, June 03-07, 2000, Barcelona, Spain [doi>10.1145/336595.337516]
• 9: Gene Ball , Jack Breese, Emotion and personality in a conversational agent, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 10: de Carolis B., Pelachaud C., Poggi I., and Steedman M. APML, a Markup Language for Believable Behavior Generation. In {30}, 65--85.
• 11: Ortony A., Clore G. L., and Collins A. The Cognitive Structure of Emotions. Cambridge University Press, Cambridge, MA, 1988.
• 12: Justine Cassell , Catherine Pelachaud , Norman Badler , Mark Steedman , Brett Achorn , Tripp Becket , Brett Douville , Scott Prevost , Matthew Stone, Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.413-420, July 1994 [doi>10.1145/192161.192272]
• 13: Nitta K., Hasegawa O., Akiba T., Kamishima T., Kurita T., Hayamizu S., Itoh K., Ishizuka M., Dohi H., and Okamura M. An experimental multimodal disputation system. In: Proc. of the IJCAI '97 Workshop on Intelligent Multimodal Systems, 1997.
• 14: André E., Rist T., van Mulken S., Klesen M., and Baldes S.. The automated design of believable dialogues for animated presentation teams. In {31}, 220--255.
• 15: Thomas Rist , Elisabeth Andrࡕ , Stephan Baldes, A flexible platform for building applications with life-like characters, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA [doi>10.1145/604045.604071]
• 16: Rickel J, Johnson W. L. Virtual Humans for Team Training in Virtual Reality. In: Proc of the Ninth International Conference on Artificial Intelligence in Education,. Amsterdam: IOS Press, 1999, 578--585.
• 17: David Traum , Jeff Rickel, Embodied agents for multi-party dialogue in immersive virtual worlds, Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, July 15-19, 2002, Bologna, Italy [doi>10.1145/544862.544922]
• 18: Prendinger H., Saeyor S., and Ishizuka M. MPML and SCREAM: Scripting the Bodies and Minds of Life-Like Characters. In {30}, 213--242.
• 19: Gebhard P., Kipp M., Klesen M., Rist T. Adding the Emotional Dimension to Scripting Character Dialogues In: Proc. of the 4th International Working Conference on Intelligent Virtual Agents (IVA'03), 2003, 48--56.
• 20: Gebhard P., Klesen M., Rist T. Coloring Multi-Character Conversations through the Expression of Emotions. In: Proc. of the Tutorial and Research Workshop on Affective Dialogue Systems (ADS'04), 2004, 128--141.
• 21: Davidson, R. J. On emotion, mood, and related affective constructs. In P. Ekman & R. J. Davidson (Eds.) The Nature of Emotion: Fundamental Questions. New York: Oxford University Press. 1994, 51--55.
• 22: Becker P. Structural and Relational Analyses of Emotion and Personality Traits. In: Zeitschrift für Differentielle und Diagnostische Psychologie, 22, 3, 2001, 155--172.
• 23: VirtualHuman, http://www.virtual-human.org
• 24: Avalon - A Virtual Reality System, <u>http://www.ini-graphics.net/~avalon.</u>
• 25: Loeckelt M. Dialogue Management in the SmartKom System. In: E. Buchberger (ed.): Proceedings of Konvens 2004, Schriftenreihe der Oesterreichischen Gesellschaft für Artificial Intelligence, Band 5, Wien, 2004.
• 26: Morris W. N. Mood: The frame of mind. New York: Springer-Verlag, 1989.
• 27: McCrae R. R. and John O. P., An introduction to the five-factor model and its implications. Journal of Personality, vol. 60, 1992, 171--215.
• 28: Mehrabian A. Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology, vol. 14, 1996, 261--292.
• 29: Mehrabian A. Analysis of the Big-five Personality Factors in Terms of the PAD Temperament Model. Australian Journal of Psychology, vol. 48, 2, 1996, 86--92.
• 30: Helmut Prendinger , Mitsuru Ishizuka, Life-Like Characters: Tools, Affective Functions, and Applications (Cognitive Technologies), SpringerVerlag, 2004
• 31: Cassell J., Sullivan J., Prevost S., and Churchill E. Embodied Conversational Agents. The MIT Press, Cambridge, Massachusetts, 2000.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

General Terms:
Algorithms, Human Factors, Theory

Keywords:
embodied conversational characters, emotion, mood, personality, simulation of affect