A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces

ABSTRACT

The use of embodied agents, defined as visual human-like representations accompanying a computer interface, is becoming prevalent in applications ranging from educational software to advertisements. In the current work, we assimilate previous empirical studies which compare interfaces with visually embodied agents to interfaces without agents, both using an informal, descriptive technique based on experimental results (46 studies) as well as a formal statistical meta-analysis (25 studies). Results revealed significantly larger effect sizes when analyzing subjective responses (i.e., questionnaire ratings, interviews) than when analyzing behavioral responses such as task performance and memory. Furthermore, the effects of adding an agent to an interface are larger than the effects of animating an agent to behave more realistically. However, the overall effect sizes were quite small (e.g., across studies, adding a face to an interface only explains approximately 2.5% of the variance in results). We discuss the implications for both designers building interfaces as well as social scientists designing experiments to evaluate those interfaces.

REFERENCES

• 1: Jeremy N. Bailenson , Jim Blascovich , Andrew C. Beall , Jack M. Loomis, Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments, Presence: Teleoperators and Virtual Environments, v.10 n.6, p.583-598, December 2001 [doi>10.1162/105474601753272844]
• 2: Bailenson, J., Beall, A., and Blasovich, J., Gaze and Task Performance in Shared Virtual Environments. The Journal of Visualization and Computer Animation, 2002. 13: p. 313--320.
• 3: Bailenson, J., Blasovich, J., Beall, A., and Loomis, J., Interpersonal Distance in Immersive Virtual Environments. Personality and Social Psychology Bulletin, 2003. 29: p. 1--15.
• 4: Jeremy N. Bailenson , Kim Swinth , Crystal Hoyt , Susan Persky , Alex Dimov , Jim Blascovich, The independent and interactive effects of embodied-agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments, Presence: Teleoperators and Virtual Environments, v.14 n.4, p.379-393, August 2005 [doi>10.1162/105474605774785235]
• 5: Jeremy N. Bailenson , Nick Yee, A longitudinal study of task performance, head movements, subjective report, simulator sickness, and transformed social interaction in collaborative virtual environments, Presence: Teleoperators and Virtual Environments, v.15 n.6, p.699-716, December 2006 [doi>10.1162/pres.15.6.699]
• 6: Christoph Bartneck, How Convincing is Mr. Data's Smile: Affective Expressions of Machines, User Modeling and User-Adapted Interaction, v.11 n.4, p.279-295, November 2001 [doi>10.1023/A:1011811315582]
• 7: Bente, G., Kramer, N., Petersen, A., and Ruiter, J., Computer Animated Movement and Person Perception: Methodological Advances in Nonverbal Behavior Research. Journal of Nonverbal Behavior, 2001. 25(3): p. 151--166.
• 8: Beun, R-J., de Vos, E., and Witterman, C., Embodied conversational agents: Effects on memory performance and anthropomorphisation, in IVA 2003, Lecture Notes in Computer Science 2792, T. Rist, Editor. 2003. p. 315--319.
• 9: Blascovich, J., Loomis, J., Beall, A., Swinth, K., Hoyt, C., and Bailenson, J., Immersive virtual environment technology as a methodological tool for social psychology. Psychological Inquiry, 2002. 13: p. 103--124.
• 10: Joseph A. Bonito , Judee K. Burgoon , Bjorn Bengtsson, The role of expectations in human-computer interaction, Proceedings of the international ACM SIGGROUP conference on Supporting group work, p.229-238, November 14-17, 1999, Phoenix, Arizona, United States [doi>10.1145/320297.320324]
• 11: Artemio R. Dunbar, Designing Interfaces to Maximize the Quality of Collaborative Work, Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences-Volume 1, p.1050, January 05-08, 1999
• 12: Burgoon, J., Bonito, J., Bengtsson, B., Cederberg, C., Lundeberg, M., and Allspach, L., Interactivity in Human--Computer Interaction: A Study of Credibility, Understanding, and Influence. Computers in Human Behavior, 2000. 16: p. 553--574.
• 13: Justine Cassell, Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 14: Cassell, J., Towards a Model of Technology and Literacy Development: Story Listening Systems. Journal of Applied Developmental Psychology, 2004. 25: p. 75--105.
• 15: Chan, F.Y. and Khalid, H.M., Is Talking to an Automated Teller Machine Natural and Fun? Egronomics, 2003. 46: p. 1386--1407.
• 16: Cowell, A.J., Increasing the Credibility of Anthropomorphic Computer Characters: The Effects of Manipulating Nonverbal Interaction Style and Demographic Emodiment. 2001, University of Central Florida: Orlando, Florida.
• 17: Doris M. Dehn , Susanne van Mulken, The impact of animated interface agents: a review of empirical research, International Journal of Human-Computer Studies, v.52 n.1, p.1-22, Jan. 2000 [doi>10.1006/ijhc.1999.0325]
• 18: Fabri, M., Moore, D., and Hobbs, D. Expressive Agents: Non-Verbal Communication in Collaborative Virtual Environments. in The Autonomous Agents and Multi--Agent Systems. 2002. Bologna, Italy.
• 19: Gerhard, M., Moore, D., and Hobbs, D., Close Encounters of the Virtual Kind: Agents Simulating Copresence. Applied Artifical Intelligence, 2005. 19: p. 393--412.
• 20: Guadagno, R., Blascovich, J., Bailenson, J., and McCall, C., Virtual Humans and Persuasion: The Effects of Agency and Behavioral Realism. Media Psychology, in press.
• 21: Gulz, A., Social Enrichment by Virtual Characters -- Differential Benefits. Journal of Computer Assisted Learning, 2005. 21: p. 405--418.
• 22: Hess, T.J., Fuller, M.A., and Mathew, J., Involvement and Decision--Making Performance with a Decision Aid: The Influence of Social Multimedia, Gender, and Playfulness. Journal of Management Information Systems, 2006. 22(3): p. 15--54.
• 23: Hongpaisanwiwat, C. and Lewis, M. Attentional Effect of Animated Character. in Human--Computer Interaction -- INTERACT. 2003. Zurich, Switzerland: IOS Press.
• 24: Kristina Höök , Per Persson , Marie Sjölinder, Evaluating users' experience of a character-enhanced information space, AI Communications, v.13 n.3, p.195-212, August 2000
• 25: Kiesler, S., Waters, K., and Sproull, L., A Prisoner's Dilemma Experiment on Cooperation with People and Human--Like Computers. Journal of Personality and Social Psychology, 1996. 70: p. 47--65.
• 26: Koda, T. and Maes, P. Agents with Faces: The Effect of Personification of Agents. in Human--Computer Interaction. 1996. London, UK.
• 27: Koda, T., User Reactions to Anthropmorphized Interfaces. IEICE Transactions on Information and Systems, 2003. E86--D: p. 1369--1377.
• 28: Kramer, N. Social Communicative Effects of a Virtual Program Guide. in Intelligent Virtual Agents. 2005. Kos, Greece: Springer-Verlag Berlin Heidelberg.
• 29: Lee, E. and Nass, C., Experimental Tests of Normative Group Influence and Representation Effects in Computer-Mediated Communication: When Interacting Via Computers Differs from Interacting with Computers. Human Computer Research, 2002. 28(3): p. 349--381.
• 30: Stefan Marti , Chris Schmandt, Physical embodiments for mobile communication agents, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095073]
• 31: McBreen, H. and Jack, M., Evaluating humanoid synthetic agents in E-retail applications. IEEE SMC Transactions, 2001. 31: p. 394--405.
• 32: McBreen, H. and Jack, M., Evaluating Humanoid Synthetic Agents in E-Retail Applications. IEEE Transactions on Systems, Man, and Cybernetics -- Part A: Stystems and Humans, 2001. 31(5): p. 394--405.
• 33: Moreno, R., Mayer, R., Spires, H., and Lester, J., The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents?. Cognition and Instruction, 2001. 19: p. 177--213.
• 34: Moreno, R., Mayer, R., Spires, H., and Lester, J., The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When They Interact With Animated Pedogogical Agents? Cognition and Instruction, 2001. 19(2): p. 177--213.
• 35: Mori, M., The Uncanny Valley. Energy, 1970. 7: p. 33--35.
• 36: Mosteller, F. and Bush, R., Selected quantitative techniques, in Handbook of social psychology: Vol. 1. Theory and method, G. Lindzey, Editor. 1954, Addison-Wesley: Cambridge, MA. p. 289--334.
• 37: Moundridou, M. and Virvou, M., Evaluating the Persona Effect of an Interface Agent in an Intelligent Tutoring System. Journal of Computer Assisted Learning, 2002. 18(3): p. 253--261.
• 38: Murano, P. Effectiveness of Mapping Human-Oriented Information to Feedback From a Software Interface. in 24th International Conference Information Technology Interfaces ITI 2002. Cavtat, Croatia.
• 39: Nass, C., Moon, Y., and Carney, P., Are respondents polite to computers? Social desirability and direct responses to computers. Journal of Applied Social Psychology, 1999. 29: p. 1093--1110.
• 40: Nowak, K. and Rauh, C., The influence of the avatar on online perceptions of anthropomorphism, androgyny, credibility, homophily, and attraction. Journal of Computer-Mediated Communication, 2005. 11.
• 41: Okonkwo, C. and Vassileva, J. Affective Pedagogical Agents and User Presuasion. in Universal Access in Human-Computer Interaction. 2001. New Orleans, USA.
• 42: Antti Oulasvirta , Antti Salovaara, A cognitive meta-analysis of design approaches to interruptions in intelligent environments, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986012]
• 43: Helmut Prendinger , Chunling Ma , Jin Yingzi , Arturo Nakasone , Mitsuru Ishizuka, Understanding the effect of life-like interface agents through users' eye movements, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy [doi>10.1145/1088463.1088484]
• 44: Helmut Prendinger , Junichiro Mori , Mitsuru Ishizuka, Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game, International Journal of Human-Computer Studies, v.62 n.2, p.231-245, February 2005 [doi>10.1016/j.ijhcs.2004.11.009]
• 45: Pernilla Qvarfordt , Arne Jönsson , Nils Dahlbäck, The role of spoken feedback in experiencing multimodal interfaces as human-like, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958478]
• 46: Raoul Rickenberg , Byron Reeves, The effects of animated characters on anxiety, task performance, and evaluations of user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.49-56, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332406]
• 47: Rosenthal, R., Meta-analytic procedures for social research. 1984, Beverly Hills, CA: Sage Publications.
• 48: Rosenthal, R. and DiMatteo, M., Meta-Analysis: Recent Developments in Quantitative Methods in Literature Reviews. Annual Review of Psychology, 2001. 52: p. 59--82.
• 49: Schaumburg, H., Computers as Tools or as Social Actors? -- The Users' Perspective on Anthropomorphic Agents. International Journal of Cooperative Information Systems, 2001. 10: p. 217--234.
• 50: Mel Slater, How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments, Presence: Teleoperators and Virtual Environments, v.13 n.4, p.484-493, August 2004 [doi>10.1162/1054746041944849]
• 51: Sproull, L., Subramani, R., Kiesler, S., Walker, J., and Waters, K., When the Interface Is a Face. Human-Computer Interaction, 1996. 11: p. 97--124.
• 52: William Swartout , Jonathan Gratch , Randall W. Hill , Eduard Hovy , Stacy Marsella , Jeff Rickel , David Traum, Toward virtual humans, AI Magazine, v.27 n.2, p.96-108, July 2006
• 53: Akikazu Takeuchi , Taketo Naito, Situated facial displays: towards social interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.450-455, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223965]
• 54: Bill Tomlinson , Man Lok Yau , Eric Baumer, Embodied mobile agents, Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems, May 08-12, 2006, Hakodate, Japan [doi>10.1145/1160633.1160807]
• 55: Susanne Van Mulken , Elisabeth André , Jochen Müller, The Persona Effect: How Substantial Is It?, Proceedings of HCI on People and Computers XIII, p.53-66, January 1998
• 56: Susanne van Mulken , Elisabeth André , Jochen Müller, An empirical study on the trustworthiness of life-like interface agents, Proceedings of the HCI International '99 (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Communication, Cooperation, and Application Design-Volume 2, p.152-156, August 22-26, 1999
• 57: H. C. van Vugt , E. A. Konijn , J. F. Hoorn , I. Keur , A. Eliëns, Realism is not all! User engagement with task-related interface characters, Interacting with Computers, v.19 n.2, p.267-280, March, 2007 [doi>10.1016/j.intcom.2006.08.005]
• 58: Roel Vertegaal , Yaping Ding, Explaining effects of eye gaze on mediated group conversations:: amount or synchronization?, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587085]
• 59: Janet H. Walker , Lee Sproull , R. Subramani, Using a human face in an interface, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.85-91, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191708]
• 60: Janet H. Walker , Lee Sproull , R. Subramani, Using a human face in an interface, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.85-91, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191708]
• 61: Walther, J., Anderson, J., and Park, D., Inpersonal effects in computer-mediated interactions: A meta-analysis of social and antisocial communication. Communication Research, 1994. 21: p. 460--487.
• 62: Walther, J., Slovacek, C., and Tidwell, L., Is a Picture Worth a Thousand Words?allPhotographic Images in Long-Term and Short-Term Computer-Mediated Communication. Communication Research, 2001. 28: p. 105--134.
• 63: Suzanne Weisband , Sara Kiesler, Self disclosure on computer forms: meta-analysis and implications, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.3-10, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238387]
• 64: Wexelblat, A., Don't Make that Face: A Report on Anthropomorphizing an Interface. Intelligent Environments, 1998.
• 65: Xiao, J., Stasko, J., and Catrambone, R. Embodied Conversational Agents as UI Paradigm: A Framework for Evaluation. in AAMAS02 Workshop on 'Embodied Conversational Agents -- Let's Specifiy and Evaluate Them! 2002. Bologna, Italy.
• 66: Catherine Zanbaka , Paula Goolkasian , Larry Hodges, Can a virtual cat persuade you?: the role of gender and realism in speaker persuasiveness, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124945]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Human Factors

Keywords:
computer-mediated communication, embodied agents, meta-analysis, quantitative methods, realism