Implementing emotion-based user-aware e-learning

ABSTRACT

We propose an intelligent e-learning system featuring with affective agent tutor. The agent tutor "Alice" is not only fully aware of the affective state of the students through facial expression, speech and text, but also fully capable of adapting to these states wisely guided by a case-based method with facial expression generation and emotional speech synthesis ability.

REFERENCES

• 1: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 2: C. J. Butz , S. Hua , R. B. Maguire, A web-based bayesian intelligent tutoring system for computer programming, Web Intelligence and Agent Systems, v.4 n.1, p.77-97, January 2006
• 3: Chih-Ming Chen, Intelligent web-based learning system with personalized learning path guidance, Computers & Education, v.51 n.2, p.787-814, September, 2008 [doi>10.1016/j.compedu.2007.08.004]
• 4: E. Reategui , E. Boff , J. A. Campbell, Personalization in an interactive learning environment through a virtual character, Computers & Education, v.51 n.2, p.530-544, September, 2008 [doi>10.1016/j.compedu.2007.05.018]
• 5: Roger, N., A framework for affective intelligent tutoring systems, In Proc. ITHET2006 (2006).
• 6: Viola, P., Rapid object detection using a boosted cascade of simple features, In Proc. CVPR2001 (2001).
• 7: Mao, X., Xue, Y.L., Beihang University Facial Expression Database and Multiple Facial Expression Recognition, In Proc. ICMLC2006 (2006).
• 8: Xia Mao , Bing Zhang , Yi Luo, Speech emotion recognition based on a hybrid of HMM/ANN, Proceedings of the 7th Conference on 7th WSEAS International Conference on Applied Informatics and Communications, p.367-370, August 24-26, 2007, Vouliagmeni, Athens, Greece
• 9: Wallace, R., The elements of AIML style, ALICE A.I. Foundation (2003)
• 10: Singh, P., The public acquisition of commonsense knowledge, In Proc. AAAI Spring Symposium (2003)
• 11: Hugo Liu , Henry Lieberman , Ted Selker, A model of textual affect sensing using real-world knowledge, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA [doi>10.1145/604045.604067]
• 12: Mehrabian, A., Communication without words, Psychology Today, 2, 4 (1968) , 53--56
• 13: Xue, Y. L., Mao, X., Modeling of Layered Fuzzy Facial Expression Generation. Digital Human Modeling, In Proc. HCI2007 (2007), 243--252

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Interaction styles (e.g., commands, menus, forms, direct manipulation)

  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Distance learning

General Terms:
Human Factors

Keywords:
affective computing, intelligent e-learning system, multimodal interaction, perceptive interfaces, virtual agent