Greta: an interactive expressive ECA system

ABSTRACT

We have developed a general purpose use and modular architecture of an Embodied Conversational Agent (ECA) called Greta. Our 3D agent is able to communicate using verbal and nonverbal channels like gaze, head and torso movements, facial expressions and gestures. It follows the SAIBA framework [10] and the MPEG4 [6] standards. Our system is optimized to be used in interactive applications.

REFERENCES

• 1: Malek Baklouti , Serge Couvet , Eric Monacelli, Intelligent Camera Interface (ICI): A Challenging HMI for Disabled People, Proceedings of the First International Conference on Advances in Computer-Human Interaction, p.21-25, February 10-15, 2008 [doi>10.1109/ACHI.2008.49]
• 2: Heylen, D., Kopp, S., Marsella, S., Pelachaud, C., Vilhjalmsson, H. 2008. Why Conversational Agents do what they do? Functional Representations for Generating Conversational Agent Behavior. The First Functional Markup Language Workshop. Estoril, Portugal.
• 3: Maatman, R. M., Gratch, J., Marsella, S. 2005. Natural behavior of a listening agent. In: 5th International Conference on Interactive Virtual Agents. Kos, Greece.
• 4: Louis-Philippe Morency , Candace Sidner , Christopher Lee , Trevor Darrell, Contextual recognition of head gestures, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy [doi>10.1145/1088463.1088470]
• 5: Moubayed, S. A., Baklouti, M., Chetouani, M., Dutoit, T., Mahdhaoui, A., Martin, J.-C., Ondas, S., Pelachaud, C., Urbain, J., Yilmaz, M. 2008. Generating Robot and Agent Backchannels during a Storytelling Experiment. In ICRA, Pasadena, California.
• 6: Ostermann, J. 2002. Face Animation in MPEG-4, in: Pandzic, I. S., Forchheimer, R., (eds.), MPEG-4 Facial Animation - The Standard Implementation and Applications, Wiley, England, pages 17--55.
• 7: Peters, C., Asteriadis, S., Karpouzis, K., de Sevin, E. 2008. Towards a real-time gaze-based shared attention for a virtual agent. In: Workshop on Affective Interaction in Natural Environments (AFFINE), Crete, Greece.
• 8: Pure data. http://www.puredata.org.
• 9: Thórisson, K. R., List, T., Pennock, C., DiPirro, J. 2005. Whiteboards: Scheduling blackboards for interactive robots. In Twentieth National Conference on Artificial Intelligence.
• 10: Hannes Vilhjálmsson , Nathan Cantelmo , Justine Cassell , Nicolas E. Chafai , Michael Kipp , Stefan Kopp , Maurizio Mancini , Stacy Marsella , Andrew N. Marshall , Catherine Pelachaud , Zsofi Ruttkay , Kristinn R. Thórisson , Herwin Welbergen , Rick J. Werf, The Behavior Markup Language: Recent Developments and Challenges, Proceedings of the 7th international conference on Intelligent Virtual Agents, September 17-19, 2007, Paris, France [doi>10.1007/978-3-540-74997-4_10]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Algorithms

Keywords:
BML, ECA architecture, FML, SAIBA, multimodal behavior