EmoEmma: emotional speech input for interactive storytelling

ABSTRACT

Whilst techniques for narrative generation and agent behaviour have made significant progress in recent years, natural language processing remains a bottleneck hampering the scalability of Interactive Storytelling systems. This demonstrator introduces a novel interaction technique based solely on emotional speech recognition. It allows the user to use speech to interact with virtual actors without any constraints on style or expressivity, by mapping the recognised emotional categories to narrative situations and virtual characters feelings.

REFERENCES

• 1: Christian Hahn, A domain specific modeling language for multiagent systems, Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, May 12-16, 2008, Estoril, Portugal
• 2: Christian Hahn, A domain specific modeling language for multiagent systems, Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, May 12-16, 2008, Estoril, Portugal
• 3: Christian Hahn , Stefan Nesbigall , Stefan Warwas , Ingo Zinnikus , Klaus Fischer , Matthias Klusch, Integration of Multiagent Systems and Semantic Web Services on a Platform Independent Level, Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, p.200-206, December 09-12, 2008 [doi>10.1109/WIIAT.2008.321]
• 4: M. Luck, P. McBurney, and J. Gonzalez-Palacios. Agent-based computing and programming of agent systems. In Proceedings of Programming Multi-Agent Systems, Third International Workshop, ProMAS 2005, volume 3862 of Lecture Notes in Computer Science, pages 23--37, Berlin et al., 2006. Springer.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

General Terms:
Algorithms, Human Factors

Keywords:
embodied conversational agents, emotional speech recognition, interactive storytelling