An evaluation of virtual human technology in informational kiosks

ABSTRACT

In this paper, we look at the results of using spoken language interactive virtual characters in information kiosks. Users interact with synthetic spokespeople using spoken natural language dialogue. The virtual characters respond with spoken language, body and facial gesture, and graphical images on the screen. We present findings from studies of three different information kiosk applications. As we developed successive kiosks, we applied lessons learned from previous kiosks to improve system performance. For each setting, we briefly describe the application, the participants, and the results, with specific focus on how we increased user participation and improved informational throughput. We tie the results together in a lessons learned section.

REFERENCES

• 1: André, E., Klesen, M., Gebhard, P., Allen, S., & Rist, T. (2000). Exploiting Models of Personality and Emotions to Control the Behavior of Animated Interface Agents. Proceedings of the International Conference on Autonomous Agents (pp. 3--7). Barcelona, Spain.
• 2: André, E., Rist, T., & Müüller, J. (1999). Employing AI Methods to Control the Behavior of Animated Interface Agents. International Journal of Applied Artificial Intelligence, 13 (4-5), 415--448.
• 3: Camburn, D.P., Gunther-Mohr, C., & Lessler, J.T. (1999). Developing New Models of Interviewer Training. Proceedings of the International Conference on Survey Nonresponse. Portland, OR.
• 4: Dahlbäck, N., Jönsson, A., & Ahrenberg, L. (1993). Wizard of Oz Studies - Why and How. Knowledge-based Systems, 6(4), 258--266.
• 5: Graesser, A., Wiemer-Hastings, K., Wiemer-Hastings, P., Kreuz, R., & the Tutoring Research Group (2000). AutoTutor: A simulation of a human tutor. Journal of Cognitive Systems Research, 1, 35--51.
• 6: Guinn, C.I., & Montoya, R.J. (1998). Natural Language Processing in Virtual Reality. Modern Simulation & Training, 6, 44--45.
• 7: Hubal, R.C., Deterding, R.R., Frank, G.A., Schwetzke, H.F., & Kizakevich, P.N. (2003). Lessons Learned in Modeling Pediatric Patients. In J.D. Westwood, H.M. Hoffman, G.T. Mogel, R. Phillips, R.A. Robb, & D. Stredney (Eds.) NextMed: Health Horizon (pp. 127--130). Amsterdam, Holland: IOS Press.
• 8: Robert C. Hubal , Geoffrey A. Frank , Curry I. Guinn, Lessons learned in modeling schizophrenic and depressed responsive virtual humans for training, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA [doi>10.1145/604045.604062]
• 9: Hubal, R.C., & Helms, R.F. (1998). Advanced Learning Environments. Modern Simulation & Training, 5, 40--45.
• 10: Kizakevich, P.N., McCartney, M.L., Nissman, D.B., Starko, K., & Smith, N.T. (1998). Virtual Medical Trainer: Patient Assessment and Trauma Care Simulator. In J.D. Westwood, H.M. Hoffman, D. Stredney, & S.J. Weghorst (Eds.), Art, Science, Technology: Healthcare (R)evolution (pp. 309--315). Amsterdam, Holland: IOS Press.
• 11: Kolb, D.A. (1984). Experiential Learning. Englewood Cliffs, NJ: Prentice Hall.
• 12: James C. Lester , Sharolyn A. Converse , Susan E. Kahler , S. Todd Barlow , Brian A. Stone , Ravinder S. Bhogal, The persona effect: affective impact of animated pedagogical agents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.359-366, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258797]
• 13: Richard Lindheim , William Swartout, Forging a New Simulation Technology at the ICT, Computer, v.34 n.1, p.72-79, January 2001
• 14: Lundeberg, M., & Beskow, J. (1999). Developing a 3D-Agent for the August Dialogue System. Proceedings of the Auditory-Visual Speech Processing Conference. Santa Cruz, CA.
• 15: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 16: Donald A. Norman, Things that make us smart: defending human attributes in the age of the machine, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1993
• 17: Olsen, D.E. (2001). The Simulation of a Human for Interpersonal Skill Training. Proceedings of the Office of National Drug Control Policy International Technology Symposium. San Diego, CA.
• 18: Ortony, A., Clore, G.L., & Collins, A. (1988). The Cognitive Structure of Emotions. Cambridge, England: Cambridge University Press.
• 19: Rickel, J., & Johnson, W.L. (1999). Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control. Applied Artificial Intelligence, 13, 343--382.
• 20: Rousseau, D., & Hayes-Roth, B. (1997). Improvisational Synthetic Actors with Flexible Personalities. KSL Report #97-10, Stanford University..
• 21: Elaine Weiss, Making Computers People-Literate, Jossey-Bass Inc., Publishers, 1994
• 22: Zimmer, J., Kizakevich, P., Heneghan, J., Schwetzke, H., & Duncan, S. (2003). The Technology Behind Full Body 3D Patients. Poster presented at the Medicine Meets Virtual Reality Conference. Newport Beach, CA. Available at http://www.rvht.info/publications.cfm.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Software psychology
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities; Evaluation/methodology
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI); Evaluation/methodology; Natural language; Voice I/O

General Terms:
Experimentation, Human Factors

Keywords:
evaluation, gesture, natural language, spoken dialogue system, virtual humans, virtual reality