A data-oriented approach to integrate emotions in adaptive dialogue management

ABSTRACT

During the past years the involvement of emotions in dialogue design has attracted much interest in current research on intelligent human-computer interfaces. We focus on the implementation of a flexible and robust dialogue system which integrates emotions and other influencing parameters in the dialogue flow. In order to achieve a higher degree of adaptability we propose a simplified stochastic approach to model the dialogue manager's behavior based on the user's input and dialogue-influencing parameters like emotions.

REFERENCES

• 1: E. André, M. Rehm, W. Minker, and D. Bühler. Endowing Spoken Language Dialogue Systems with Emotional Intelligence. In Tutorial and Research Workshop Affective Dialogue Systems, pages 178--187, Irsee, Germany, June 2004.
• 2: E. Levin, R. Pieraccini, and W. Eckert. A stochastic model of human machine interaction for learning dialog strategies. IEEE Transactions on Speech and Audio Processing, 8(1):11--23, January 2000.
• 3: Diane J. Litman , Michael S. Kearns , Satinder Singh , Marilyn A. Walker, Automatic optimization of dialogue management, Proceedings of the 18th conference on Computational linguistics, p.502-508, July 31-August 04, 2000, Saarbrücken, Germany [doi>10.3115/990820.990893]
• 4: Diane J. Litman , Shimei Pan, Designing and Evaluating an Adaptive Spoken Dialogue System, User Modeling and User-Adapted Interaction, v.12 n.2-3, p.111-137, 2002 [doi>10.1023/A:1015036910358]
• 5: Michael F. McTear, Spoken Dialogue Technology, SpringerVerlag, 2004
• 6: A. Pittermann and J. Pittermann. Getting Bored with HTK? Using HMMs for Emotion Recognition. In 8th International Conference on Signal Processing (ICSP), volume 1, pages 704--707, Guilin, China, November 2006.
• 7: J. Pittermann, A. Rittinger, and W. Minker. Flexible dialogue management in intelligent human-machine interfaces. In The IEE International Workshop on Intelligent Environments, Univ. of Essex, Colchester, United Kingdom, 2005.
• 8: Nicholas Roy , Joelle Pineau , Sebastian Thrun, Spoken dialogue management using probabilistic reasoning, Proceedings of the 38th Annual Meeting on Association for Computational Linguistics, p.93-100, October 03-06, 2000, Hong Kong [doi>10.3115/1075218.1075231]
• 9: J. Sun, X. Cui, Z. Wang, and Y. Liu. A language model adaptation approach based on text classification. In International Conference on Speech and Language Processing (ICSLP), 2000.
• 10: J. D. Williams, P. Poupart, and S. Young. Partially Observable Markov Decision Processes with Continuous Observations for Dialogue Management. In Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue, 2005.
• 11: B. Zhang, Q. Cai, J. Mao, E. Chang, and B. Guo. Spoken dialogue management as planning and acting under uncertainty. In European Conference on Speech and Language Processing (EUROSPEECH), pages 2169--2172, 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User interface management systems (UIMS)

General Terms:
Algorithms, Design, Management

Keywords:
dialogue management, human-computer interaction, stochastic modeling