Modeling gaze behavior for a 3D ECA in a dialogue situation

ABSTRACT

This paper presents an approach to model the gaze behavior of an Embodied Conversational Agent in a real time multimodal dialogue interaction with users. The ECA's gaze control results from the fusion of a rational dialogue engine based on natural language interaction and a multi-users face tracker.

REFERENCES

• 1: A. Berthoz. Le Sens du Mouvement. Editions Odile Jacob, 1997.
• 2: M. Bilvi and C. Pelachaud. Modelling gaze behaviour for conversational agents. Intelligent Virtual Agent, pages 93--100, Kloster Irsee, Germany, 2003.
• 3: Sonu Chopra-Khullar , Norman I. Badler, Where to look? Automating attending behaviors of virtual human characters, Proceedings of the third annual conference on Autonomous Agents, p.16-23, April 1999, Seattle, Washington, United States [doi>10.1145/301136.301152]
• 4: N. Courty, G. Breton, and D. Pelé. Embodied in a look: bridging the gap between humans and avatars. Proceedings of IVA, Irsee, Germany, 2003.
• 5: D. Robinson. The mechanics of human saccadic eye movements. Journal of Physiology, 174:245--264, 1964.
• 6: O. E. Torres, J. Cassel, and S. Prevost. Modeling gaze behavior as a funtion of discourse structure. Workshop on Human-Computer Conversations, Bellagio, Italy, 1997.
• 7: Roel Vertegaal , Robert Slagter , Gerrit van der Veer , Anton Nijholt, Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes, Proceedings of the SIGCHI conference on Human factors in computing systems, p.301-308, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365119]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.8 Applications

General Terms:
Algorithms

Keywords:
3D ECA, dialogue, face tracking, gaze behavior