Designing empathic computers: the effect of multimodal empathic feedback using animated agent

ABSTRACT

Experiencing emotional distress is the number one reason why people who are undergoing behaviour modification (e.g. quitting smoking, dieting) suffer from relapses. Providing emotional support is an effective way to help them overcome the unpleasant effects of negative affect and adhere to their regimen. Building computers with such ability has grabbed the attention of the HCI community in recent years. Early research has shown some promising results when adopting strategies of how we comfort others, but many questions on how to build such systems remain unanswered. This paper presents the results of a 2 (modality: animated vs. no visual) by 3 (intervention: non-empathy vs. empathy vs. empathy and expressivity) between-subjects study that investigates the impact of two important factors and their interaction in the design of such systems: (1) different ways of expressing empathy, and (2) the modality of delivering such content. Findings and implications for the design of empathic computer systems are discussed and directions for future research are suggested.

REFERENCES

• 1: Timothy Bickmore , Daniel Schulman, Practical approaches to comforting users with relational agents, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1240996]
• 2: Scott Brave , Clifford Nass , Kevin Hutchinson, Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent, International Journal of Human-Computer Studies, v.62 n.2, p.161-178, February 2005 [doi>10.1016/j.ijhcs.2004.11.002]
• 3: Klein, J., Moon, Y., Picard, R. 2002. This computer responds to user frustration: Theory, design, results, and implications. Interacting with Computers, 14, 119--140.
• 4: Vincent, S. 2005. Being Empathic: A Companion for Counsellors and Therapists. Radcliffe Publishing.
• 5: Stein, N. L., Hernandez. M. W. 2007. Assessing understanding and appraisals during emotional experience: The development and use of the narcoder. Handbook of Emotion Elicitation and Assessment. Oxford University Press.
• 6: Greene, J., Burleson, B. R. 2003. Handbook of Communication and Social Interaction Skills. Lawrence Erlbaum Associates, Inc., Publishers.
• 7: Wilson, E., MacLeod, C., Campbell, L. 2007. The information-processing approach to emotion research. Handbook of Emotion Elicitation and Assessment. Oxford University Press.
• 8: Miller, W. R., Rollnick, S. 1991. Motivational Interviewing. The Guildford Press, New York.
• 9: Timothy W. Bickmore , Rosalind W. Picard, Establishing and maintaining long-term human-computer relationships, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.2, p.293-327, June 2005 [doi>10.1145/1067860.1067867]
• 10: Cahn, J. E. 1990. The generation of affect in synthesized speech. Journal of the American Voice I/O Society, 8, 1--19.
• 11: Nass, C., Foehr, U., Brave, S., Somoza, M. 2001. The effects of emotion of voice in synthesized and recorded speech. In Proceedings of the AAAI Symposium: Emotional and Intelligent II: The Tangled Knot of Social Cognition, North Falmouth, MA.
• 12: Diane J. Schiano , Sheryl M. Ehrlich , Krisnawan Rahardja , Kyle Sheridan, Face to interface: facial affect in (hu)man and machine, Proceedings of the SIGCHI conference on Human factors in computing systems, p.193-200, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332430]
• 13: Dominic W. Massaro , Michael M. Cohen , Jonas Beskow , Ronald A. Cole, Developing and evaluating conversational agents, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 14: Thompson. E. R. 2007. Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38, 2, 227--242.
• 15: Forgas, J. P. 1995. Mood and judgment: the affect infusion model (AIM). Psychol Bull.
• 16: Forgas, J. P. 1985. Interpersonal behavior: The Psychology of Social Interaction. Oxford: Pergamon Press.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Software psychology

General Terms:
Design, Experimentation, Human Factors

Keywords:
affective computing, design, experimentation, human factors