Design and evaluation of expressive gesture synthesis for embodied conversational agents

ABSTRACT

To increase the believability and life-likeness of Embodied Conversational Agents (ECAs), we introduce a behavior synthesis technique for the generation of expressive gesturing. A small set of dimensions of expressivity is used to characterize individual variability of movement. We empirically evaluate our implementation in two separate user studies. The results suggest that our approach works well for a subset of expressive behavior. However, animation fidelity is not high enough to realize subtle changes. Interaction effects between different parameters need to be studied further.

REFERENCES

• 1: B. DeCarolis, C. Pelachaud, I. Poggi, and M. Steedman. APML, a mark-up language for believable behavior generation. In H. Prendinger and M. Ishizuka, Eds., Life-Like Characters, Cognitive Technologies, Springer, 2004.
• 2: P. E. Gallaher. Individual differences in nonverbal behavior: Dimensions of style. Journal of Personality and Social Psychology, 63(1):133--145, 1992.
• 3: B. Hartmann, M. Mancini, and C. Pelachaud. Implementation of expressive eca gesture synthesis. Submitted to Gesture Workshop, 2005.
• 4: A. Bryan Loyall , Joseph Bates, Personality-rich believable agents that use language, Proceedings of the first international conference on Autonomous agents, p.106-113, February 05-08, 1997, Marina del Rey, California, United States [doi>10.1145/267658.267681]
• 5: C. Martell, P. Howard, C. Osborn, L. Britt, and K. Myers. Form2 kinematic gesture corpus. video recording and annotation, 2003.
• 6: Catherine Pelachaud , Valeria Carofiglio , Berardina De Carolis , Fiorella de Rosis , Isabella Poggi, Embodied contextual agent in information delivering application, Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, July 15-19, 2002, Bologna, Italy [doi>10.1145/544862.544921]
• 7: H. G. Wallbott. Bodily expression of emotion. European Journal of Social Psychology, 28:879--896, 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

General Terms:
Experimentation

Keywords:
embodied conversational agents