Communicating emotions in online chat using physiological sensors and animated text

ABSTRACT

We present a chat system that uses animateddynamic text associated with emotional information to show the affective state of the user. The system obtains the affective state of a chat user from a physiological sensor attached to the user's body. This paper describes preliminary experiments and provides examples of possible applications of our chat system. Observations from informal experiments comparing our animated chat system with a conventional system suggest that an online interface that conveys emotional information helps online users to interact with each other more efficiently.

REFERENCES

• 1: Birdwhistell, R. Kinetics and Context:Essays on Body Motion Communication, University of Pennsylvania Press, 1970.
• 2: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 3: Conati, C., Chabbal, R., Maclaren, H. A Study on using biometric sensors for monitoring user emotions in educational games. Workshop on Assessing and Adapting to User Attitudes and Affect: Why, When and How?,, in conjunction with User Modeling (UM-03), Johnstown, USA, 2003.
• 4: Shannon Ford , Jodi Forlizzi , Suguru Ishizaki, Kinetic typography: issues in time-based presentation of text, CHI '97 extended abstracts on Human factors in computing systems: looking to the future, March 22-27, 1997, Atlanta, Georgia [doi>10.1145/1120212.1120387]
• 5: Ishizaki, S. On Kkinetic Ttypography Sstatements, American Center for Design Journal Vol. 12 No.1, 1998.
• 6: Johnny C. Lee , Jodi Forlizzi , Scott E. Hudson, The kinetic typography engine: an extensible system for animating expressive text, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571997]
• 7: Jodi Forlizzi , Johnny Lee , Scott Hudson, The kinedit system: affective messages using dynamic texts, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642677]
• 8: Kerry Bodine , Mathilde Pignol, Kinetic typography-based instant messaging, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766067]
• 9: Klein, J., Moon, Y., and Picard, R. This computer responds to user frustration: Theory, design, and results. Interacting with Computers, 2002, pp 119--140.
• 10: Prendinger, H., Mayer, S., Mori, J., and Ishizuka, M. Persona effect revisited. Using bio-signals to measure and reflect the impact of character-based interfaces. 4th Working Conference on Intelligent Virtual Agents, Germany,2003, pp 283--291.
• 11: Vyzas, E., Minka, T., and Healey, J., Emotion Recognition in an Actor, MIT Media Lab ProjectVyzas, E., Recognition of Emotional and Cognitive States Using Physiological Data, Mechanical Engineer's Degree Thesis, MIT, June 1999
• 12: Lang, P. J., The emotion probe: Studies of motivation and attention. American Psychologist, 50(5), 1995, pp 372.
• 13: ProComp UNIT, Thought Technology Ltd., http://www.thoughttechnology.com/
• 14: Ryohei Natatsu , Makoto Tadenuma , Tadao Maekawa, Computer technologies that support Kansei expression using the body, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500195]

INDEX TERMS

Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Animations
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods

General Terms:
Human Factors

Keywords:
affective computing, animated text, kinetic typography, online chat, physiological sensors