Designing social presence of social actors in human computer interaction

ABSTRACT

This study examines the interaction effect between user factors and media factors on feelings of social presence which are critical in the design of virtual reality systems and human computer interfaces. Both Experiment 1 and Experiment 2 show that matching synthesized voice personality to user personality positively affects users' (especially extrovert users') feelings of social presence. Experiment 2 also reveals that users feel a stronger sense of social presence when the personality of synthesized voice matches the personality of textual content than when those two are mismatched. In both experiments, extrovert voice induces a stronger sense of presence than introvert voice. These results provide strong evidence for human's automatic social responses to artificial representations possessing humanistic properties such as language and personality. Finally, we discuss various applications of these findings in the design of human computer interfaces, as well as in the study of presence.

REFERENCES

• 1: Apter, M.J. The dangerous edge: The psychology of excitement. Free Press, New York, 1992.
• 2: Gene Ball , Jack Breese, Emotion and personality in a conversational agent, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 3: Barfield, E. and Weghorst, S. The sense of presence within virtual environments: A conceptual framework. in Salvendy, G. and Smith, M.J. eds. Human-computer interaction: Software and hardware interfaces, Elsevier, Amsterdam, 1993, 699--704.
• 4: Berscheid, E. and Walster, E.H. Interpersonal attraction. Addison-Wesley, Reading, MA, 1969.
• 5: Biocca, F. The cyborg's dilemma: Progressive embodiment in virtual environments. Journal of Computer-Mediated-Communication, 3 (2). Available: http://www.ascusc.org/jcmc/vol3/issue2/.
• 6: Frank Biocca , Mark R. Levy, The vision of virtual reality, Communication in the age of virtual reality, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1995
• 7: Bocker, M. and Muhlbach, L. Communicative presence in videocommunications. in Proceedings of the Human Factors and Ergonomics Society 37th annual meeting, The Human Factors and Ergonomics society, Santa Monica, CA, 1993, 249--253.
• 8: Clark, H.H. How do real people communicate with virtual partners? in Proceedings of 1999 AAAI Fall Symposium, Psychological Models of Communication in Collaborative Systems, AAAI, North Falmouth, MA, 1999, 43--47.
• 9: Ditton, T.B. The unintentional blending of direct experience and mediated experience: The role of enhanced versus limited television presentations., Temple University, Philadelphia, PA., 1997.
• 10: Ekman, P. and Friesen, W.V. Detecting deception from the body or face. Journal of Personality & Social Psychology, Vol. 29 (3). 288--298.
• 11: Field, S. Screenplay: The Foundations of screenwriting. Bantam Doubleday Dell, New York, NY, 1994.
• 12: Fiske, S.T. and Taylor, S.E. Social Cognition. McGraw-Hill, Inc, New York, NY, 1991.
• 13: B. J. Fogg , Hsiang Tseng, The elements of computer credibility, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.80-87, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303001]
• 14: Gary Fontaine, The experience of a sense of presence in intercultural and international encounters, Presence: Teleoperators and Virtual Environments, v.1 n.4, p.482-490, Fall 1992
• 15: Gerrig, R.J. Experiencing narrative worlds. Yale University Press, New Haven, CT, 1993.
• 16: Hartz, A.Z. Psycho-socionomics: Attractiveness research from a societal perspective. Journal of Social Behavior and Personality, 11. 683--694.
• 17: Carrie Heeter, Being there: the subjective experience of presence, Presence: Teleoperators and Virtual Environments, v.1 n.2, p.262-271, Spring 1992
• 18: Richard M. Held , Nathaniel I. Durlach, Telepresence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.109-112, Winter 1992
• 19: Hoffman, H.G., Prothero, J., Wells, M. and Groen, J. Virtual Chess: The role of meaning in the sensation of presence. International Journal of Human-Computer Interaction, 10. 251--263.
• 20: Katherine Isbister , Clifford Nass, Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics, International Journal of Human-Computer Studies, v.53 n.2, p.251-267, Aug. 2000 [doi>10.1006/ijhc.2000.0368]
• 21: Kim, T. Effects of presence on memory and persuasion, University of North Carolina, Chapel Hill, NC., 1996.
• 22: Kim, T. and Biocca, F. Telepresence via television: Two dimensions of telepresence may have different connections to memory and persuasion. Journal of Computer-Mediated-Communication, 3 (2). Available: http://www.ascusc.org/jcmc/vol3/issue2/.
• 23: Lombard, M. Direct responses to people on the screen: Television and personal space. Communication Research, 22 (3). 288--324.
• 24: Lombard, M. and Ditton, T.B. At the heart of it all: The concept of presence. Journal of Computer-Mediated-Communication, 3 (2). Retrieved June, 2002, from http://www.ascusc.org/jcmc/vol3/issue2/.
• 25: Lombard, M., Reich, R.D., Grabe, M.E., Bracken, C. and Ditton, T.B. Presence and Television: The role of screen size. Human Communication Research, 26 (1).
• 26: Jack M. Loomis, Distal attribution and presence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.113-119, Winter 1992
• 27: Pattie Maes, Agents that reduce work and information overload, Communications of the ACM, v.37 n.7, p.30-40, July 1994 [doi>10.1145/176789.176792]
• 28: McCroskey, J.C., Hamilton, P.R. and Weiner, A.N. The effect of interaction behavior on source credibility, homophily and interpersonal attraction. Human Communication Research, 1. 42--52.
• 29: Moon, Y. When the computer is the "salesperson": Computer responses to computer "personalities" in interactive marketing situations. Harvard Business School, Boston, MA, 1998.
• 30: Moon, Y. and Nass, C. How "real" are computer personalities? Psychological responses to personality types in human-computer interaction. Communication Research, 23 (6). 651--674.
• 31: Murray, J.B. Review of research on the Myers-Briggs type indicator. Perceptual and Motor Skills, 70. 1187--1202.
• 32: Nass, C. Ecce homo. Culture, 11 (3/4). 3--6.
• 33: Clifford Nass , Li Gong, Speech interfaces from an evolutionary perspective, Communications of the ACM, v.43 n.9, p.36-43, Sept. 2000 [doi>10.1145/348941.348976]
• 34: Nass, C. and Lee, K.M. Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. Journal of Experimental Psychology: Applied, 7 (3), 171--181.
• 35: Nass, C. and Moon, Y. Machines and mindlessness: Social responses to computers. Journal of Social Issues, 56 (1). 81--103.
• 36: Clifford Nass , Youngme Moon , B. J. Fogg , Byron Reeves , D. Christopher Dryer, Can computer personalities be human personalities?, International Journal of Human-Computer Studies, v.43 n.2, p.223-239, Aug. 1995 [doi>10.1006/ijhc.1995.1042]
• 37: Nass, C. and Steuer, J. Voices, boxes, and sources of messages: Computers and social actors. Human Communication Research, 19 (4). 504--527.
• 38: Rampoldi-Hnilo, L.A., Kind, K., Devries, J., Tait, K. and Besecker, K. The presence of presence: The influence of narrative on the perception of presence in virtual environments. Unpublished Manuscript. East Lansing, MI, 1997.
• 39: Reeves, B., Detenber, B. and Steuer, J., New televisions: The effects of big pictures and big sound on viewer responses to the screen. Paper presented at the Annual conference of the International Communication Association, (Washington, D. C., 1993, May).
• 40: Byron Reeves , Clifford Nass, The media equation: how people treat computers, television, and new media like real people and places, Cambridge University Press, New York, NY, 1996
• 41: Sheridan, T. B. Teleoperation, telerobotics and telepresence: A progress report. Control Engineering Practice, 3 (2). 205--214.
• 42: Sheridan, T. B. Teleoperation, telerobotics, and telepresence: A progress report. in 5th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design and Evalution of Man-Machine Systems 1992, Pergamon Press, Tarrytown, NY, 1993, 1--8.
• 43: Slater, M. and Usoh, M. Representations systems, perceptual position, and presence in immersive virtual environments. Presence: Teleoperators and Virtual Environment, 2 (3). 221--233.
• 44: Michael Potter Snow, Charting presence in virtual environments and its effects on performance, Virginia Polytechnic Institute & State University, Blacksburg, VA, 1998
• 45: Steuer, J. Defining virtual reality: Dimensions determining telepresence. Journal of Communication, 42 (4). 73--93.
• 46: Suler, J. The psychology of cyberspace. Available: http://www.rider.edu/users/suler/psycyber/psycyber.html, 1999.
• 47: Thomas, F. and Johnston, O. The illusion of life: Disney animation. Hyperion, New York, NY, 1981.
• 48: Sherry Turkle, Life on the Screen: Identity in the Age of the Internet, Simon & Schuster Trade, 1995
• 49: Whitmer, B.G. and Singer, M.J. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environment, 7 (3). 225--240.
• 50: Wiggins, J.S. A psychological taxonomy of trait-descriptive terms: The interpersonal domain. Journal of Personality and Social Psychology, 37 (3). 395--412.
• 51: Zettl, H. Sight, sound, motion: Applied media aesthetics. Wadsworth Publication Co, Belmont, CA, 1990.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors; Human information processing
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology; User-centered design

Keywords:
computers are social actors, consistency-attraction, media equation, presence, similarity-attraction, social presence, telepresence