Does computer-generated speech manifest personality? an experimental test of similarity-attraction

ABSTRACT

This study examines whether people would interpret and respond to paralinguistic personality cues in computer-generated speech in the same way as they do human speech. Participants used a book-buying website and heard five book reviews in a 2 (synthesized voice personality: extrovert vs. introvert) by 2 (participant personality: extrovert vs. introvert) balanced, between-subjects experiment. Participants accurately recognized personality cues in TTS and showed strong similarity-attraction effects. Although the content was the same for all participants, when the personality of the computer voice matched their own personality: 1) participants regarded the computer voice as more attractive, credible, and informative; 2) the book review was evaluated more positively; 3) the reviewer was more attractive and credible; and 4) participants were more likely to buy the book. Match of user voice characteristics with TTS had no effect, confirming the social nature of the interaction. We discuss implications for HCI theory and design.

REFERENCES

• 1: Beutnagel, M., Conkie, A., Schroeter, J., Stylianou, Y. & Syrdal, A. The A T&T Next-Gen 7TS system. Paper presented at joint meeting of ASA, EAA, and DAGA, Berlin, Germany, March, 1999. {Online} Available at http ://www. research, att. com/proj ects/tts/papers/1999_ ASA_Berlin/nextgen.pdf
• 2: Giles, H. & Powesland, P. F. Speech style and social evaluation. Academic Press, London. 1975.
• 3: Hall, J. A. Nonverbal sex differences. Johns Hopkins University Press, Baltimore, MD, 1980.
• 4: Katherine Isbister , Clifford Nass, Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics, International Journal of Human-Computer Studies, v.53 n.2, p.251-267, Aug. 2000 [doi>10.1006/ijhc.2000.0368]
• 5: Frances H. James , Terry Winograd, Representing structured information in audio interfaces: a framework for selecting audio marking techniques to represent document structures, 1998
• 6: Kamm, C., Walker, M. and Rabiner, L. The role of speech processing in human-computer intelligent communication. Paper presented at NSF Workshop on human-centered systems: Information, interactivity, and intelligence, February, 1997. {Online} Available at http ://www. ifp. uiuc. edu/nsfhcs/talks/rabiner, html
• 7: Massaro, D. M. Perceiving talking faces." From speech perception to a behavioral principle. MIT Press, Cambridge, MA, 1997
• 8: Moon, Y. When the computer is the "salesperson" Computer responses to computer "personalities" in interactive marketing situations. Working paper No. 99-041, Harvard Business School. Boston, MA, 1998.
• 9: Murray, J. B. Review of research on the Myers-Briggs type indicator. Perceptual and Motor Skills, 70. 1187- 1202, 1990.
• 10: Nass, C. & Gong, L. Maximized modality or constrained consistence? Paper presented at audiovisual speech processing conference, August, 1999.
• 11: Nass, C. & Moon, Y. Machines and mindlessness" Social responses to computers, journal of Social Issues, in press.
• 12: Clifford Nass , Youngme Moon , B. J. Fogg , Byron Reeves , D. Christopher Dryer, Can computer personalities be human personalities?, International Journal of Human-Computer Studies, v.43 n.2, p.223-239, Aug. 1995 [doi>10.1006/ijhc.1995.1042]
• 13: Olive, J. P. The talking computer: Text to speech synthesis, in D. Stork (ed.) Hal's legacy: 2001's computer as dream and reality. 101-130. The MIT Press, Cambridge, MA, 1997.
• 14: Oren, T., Salomon, G., Kreitman, K., & Don, A. Guides: Characterizing the interface. In B. Laurel (Ed.) The art of human-computer interface design. Addison-Wesley, Reading, MA, 1990.
• 15: Pittam, J. Voice in social interaction: An interdisciplinary approach. Sage, Thousand Oaks, CA, 1994.
• 16: Ramsay, R. W. Personality and speech. Journal of Personality and Social Psychology, 4, 116-118. 1966.
• 17: Byron Reeves , Clifford Nass, The media equation: how people treat computers, television, and new media like real people and places, Cambridge University Press, New York, NY, 1996
• 18: Sawlmey, N. and Schmandt, C. Design of spatialized audio in nomadic environments. Paper presented at the international conference on auditory display (ICAD'97), November, 1997. {Online} Available at http://www.media.mit.eelu/-~nitin/NomadicRadio/ICA D97/ICAD97_paper/iCAD97.html
• 19: Ben Shneiderman, Designing the user interface (2nd ed.): strategies for effective human-computer interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 20: Smith, B. L., Brown, B.L., Strong, W.J., & Rencher, A.C. Effects of speech rate on personality perceptions. Language and Speech, 18, 145-152, 1975.
• 21: Sherry Turkle, The second self: computers and the human spirit, Simon & Schuster, Inc., New York, NY, 1984
• 22: Wheeless, L. R. & Grotz, J. The measurement of trust and its relationship to serf-disclosure. Human Communication Research, 3(3), 250-257, 1977.
• 23: Wiggins, J. S. A psychological taxonomy of traitdescriptive terms: The interpersonal domain. Journal of Personality and Social Psychology, 37(3), 395-412, 1979.
• 24: Woodall, W. G., & Burgoon, J.K. Talking fast and changing attitudes: A critique and clarification. Journal of Nonverbal Behavior, 8, 126-142, 1983

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Speech recognition and synthesis

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design, Experimentation, Human Factors, Languages, Management, Measurement, Performance, Theory

Keywords:
CASA (computers are social actors), TTS (text-to-speech), personality, similarity-attraction effect, user interfaces