Distinctiveness in multimodal behaviors

ABSTRACT

While talking, people may move heavily their arms around, remain expressionless, or even display subtle facial movements... These differences may arise from personality, cultural, social factors and many more. In the present work, we are interested in defining a schema that characterizes distinctiveness in behaviors. Distinctiveness encompasses behaviors differences regarding (i) shape (which signals are performed) and (ii) quality (expressivity of movement, the way in which movements are performed). Thus, we aim to define embodied conversational agents (ECAs) that, given their communicative intention and behaviors tendencies definition, present distinctive behaviors.

REFERENCES

• 1: J. Allbeck and N. Badler. Toward representing agent behaviors modified by personality and emotion. In Workshop on Embodied Conversational Agents - Let's specify and evaluate them! ACM Press, 2002.
• 2: Elisabeth André , Thomas Rist , Jochen Müller, Integrating reactive and scripted behaviors in a life-like presentation agent, Proceedings of the second international conference on Autonomous agents, p.261-268, May 10-13, 1998, Minneapolis, Minnesota, United States [doi>10.1145/280765.280842]
• 3: M. Argyle. Bodily Communication. Methuen & Co., London, 2nd edition, 1988.
• 4: Gene Ball , Jack Breese, Emotion and personality in a conversational agent, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 5: P. E. Gallaher. Individual differences in nonverbal behavior: Dimensions of style. Journal of Personality and Social Psychology, 63(1):133--145, 1992.
• 6: J. Gross, O. John, and J. Richards. The dissociation of emotion expression from emotion experience: A personality perspective. Personality and Social Psychology Bulletin, (26):712--726, 2000.
• 7: B. Hartmann , M. Mancini , S. Buisine , C. Pelachaud, Design and evaluation of expressive gesture synthesis for embodied conversational agents, Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems, July 25-29, 2005, The Netherlands [doi>10.1145/1082473.1082640]
• 8: M. Kipp. Gesture Generation by Imitation. Dissertation.com, 2005.
• 9: M. Kipp. Creativity meets automation: Combining nonverbal action authoring with rules and machine learning. In Intelligent Virtual Agents, pages 230--242, 2006.
• 10: Maurizio Mancini , Catherine Pelachaud, Dynamic Behavior Qualifiers for Conversational Agents, Proceedings of the 7th international conference on Intelligent Virtual Agents, September 17-19, 2007, Paris, France [doi>10.1007/978-3-540-74997-4_11]
• 11: D. McNeill. Hand and mind: what gestures reveal about thought. University of Chicago Press, 1992.
• 12: H. Noot and Z. Ruttkay. Gesture in style. In A. Camurri and G. Volpe, editors, Gesture-Based Communication in Human-Computer Interaction - Gesture Workshop 2003, number 2915 in LNAI, pages 324--337. Springer, 2004.
• 13: I. Poggi. Mind markers. In N. Trigo, M. Rector, and I. Poggi, editors, Gestures. Meaning and use, Oporto, Portugal, 2002. University Fernando Pessoa Press.
• 14: Z. Ruttkay, C. Pelachaud, I. Poggi, and H. Noot. Exercises of style for virtual humans. In L. Canamero and R. Aylett, editors, Animating Expressive Characters for Social Interactions. J. Benjamins Publishing, to appear.
• 15: Kristinn R. Thorisson, Layered Modular Action Control for Communicative Humanoids, Proceedings of the Computer Animation, p.134, June 04-07, 1997
• 16: H. G. Wallbott and K. R. Scherer. Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51(4):690--699, 1986.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.8 Applications

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.5 Model Development

  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Algorithms, Human Factors

Keywords:
ECAs, distinctiveness, multimodal behavior