The validity of a virtual human experience for interpersonal skills education

ABSTRACT

Any new tool introduced for education needs to be validated. We developed a virtual human experience called the Virtual Objective Structured Clinical Examination (VOSCE). In the VOSCE, a medical student examines a life-size virtual human who is presenting symptoms of an illness. The student is then graded on interview skills. As part of a medical school class requirement, thirty three second year medical students participated in a user study designed to determine the validity of the VOSCE for testing interview skills. In the study, participant performance in the VOSCE is compared to participant performance in the OSCE, an interview with a trained actor. There was a significant correlation (r(33)=.49, p<.005) between overall score in the VOSCE and overall score in the OSCE. This means that the interaction skills used with a virtual human translate to the interaction skills used with a real human. Comparing the experience of virtual human interaction to real human interaction is the critical validation step towards using virtual humans for interpersonal skills education.

REFERENCES

• 1: Alessi, N.E. and Huang, M.P., Evolution of the Virtual Human: From Term to Potential Application in Psychiatry. CyberPsychology & Behavior 3 (2000), 321--326.
• 2: Norman I. Badler , Charles A. Erignac , Ying Liu, Virtual humans for validating maintenance procedures, Communications of the ACM, v.45 n.7, July 2002 [doi>10.1145/514236.514264]
• 3: Norman I. Badler , Cary B. Phillips , Bonnie Lynn Webber, Simulating humans: computer graphics animation and control, Oxford University Press, Inc., New York, NY, 1993
• 4: Bordnick, P.S., Graap, K.M., Copp, H.L., Brooks, J. and Ferrer, M., Virtual Reality Cue Reactivity Assessment in Cigarette Smokers. Cyberpsychology & Behavior 8,5 (2005), 487--492.
• 5: Carolina Cruz-Neira , Daniel J. Sandin , Thomas A. DeFanti, Surround-screen projection-based virtual reality: the design and implementation of the CAVE, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.135-142, September 1993 [doi>10.1145/166117.166134]
• 6: Dickerson, R., Johnsen, K., Raij, A., Lok, B., Bernard, T., Stevens, A. and Lind, D.S. Virtual Patients: Assessment of Synthesized Versus Recorded Speech. In Proceedings of Medicine Meets Virtual Reality, (2005),114--119.
• 7: Dickerson, R., Johnsen, K., Raij, A., Lok, B., Hernandez, J., Stevens, A. and Lind, D.S. Evaluating a Script-Based Approach to Simulating Patient-Doctor Interaction. In Proceedings of SCS 2005 International Conference on Human-Computer Interface Advances for Modeling and Simulating, (2005),79--84.
• 8: Full Body Characters. www.haptek.com.
• 9: Hill, R., Gratch, J., Marsella, S., Rickel, J., Swartout, W. and Traum, D., Virtual Humans in the Mission Rehearsal Exercise System. Künstliche Intelligenz 4,03 (2003), 5--10.
• 10: Larry F. Hodges , Page Anderson , Grigore C. Burdea , Hunter G. Hoffman , Barbara O. Rothbaum, Treating Psychological and Physical Disorders with VR, IEEE Computer Graphics and Applications, v.21 n.6, p.25-33, November 2001 [doi>10.1109/38.963458]
• 11: Robert C. Hubal , Ruth S. Day, Informed consent procedures: an experimental test using a virtual character in a dialog systems training application, Journal of Biomedical Informatics, v.39 n.5, p.532-540, October 2006 [doi>10.1016/j.jbi.2005.12.006]
• 12: Hubal, R.C., Fishbein, D.H. and Paschall, M.J. Lessons Learned using Responsive Virtual Humans for Assessing Interaction Skills. In Proceedings of the Interservice/Industry Training, Simulation and Education Conference(I/ITSEC) 2004, (2004).
• 13: Hubal, R.C., Kizakevich, P.N., Guinn, C.I., Merino, K.D. and West, S.L., The Virtual Standardized Patient: Simulated Patient--Practitioner Dialog for Patient Interview Training. Studies in Health Technology and Informatics 70 (2000), 133--138.
• 14: Kyle Johnsen , Robert Dickerson , Andrew Raij , Cyrus Harrison , Benjamin Lok , Amy Stevens , D. Scott Lind, Evolving an immersive medical communication skills trainer, Presence: Teleoperators and Virtual Environments, v.15 n.1, p.33-46, February 2006 [doi>10.1162/pres.2006.15.1.33]
• 15: Kyle Johnsen , Robert Dickerson , Andrew Raij , Benjamin Lok , Jonathan Jackson , Min Shin , Jonathan Hernandez , Amy Stevens , D. Scott Lind, Experiences in Using Immersive Virtual Characters to Educate Medical Communication Skills, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.179-186, 324, March 12-16, 2005 [doi>10.1109/VR.2005.33]
• 16: McLaughlin, K., Gregor, L., Jones, A. and Coderre, S., Can standardized patients replace physicians as OSCE examiners? BMC Medical Education 6,1 (2006), 12.
• 17: Mitchell, M. and Jolley, J. Research Design Explained. Harcourt, New York, NY, USA, 2001.
• 18: Nass, C. and Moon, Y., Machines and Mindlessness: Social Responses to Computers. Journal of Social Issues 56 (2000), 81--103.
• 19: Dragon Naturally Speaking 8 Professional. www.nuance.com.
• 20: Jarrell Pair , Brian Allen , Matthieu Dautricourt , Anton Treskunov , Matt Liewer , Ken Graap , Greg Reger, A Virtual Reality Exposure Therapy Application for Iraq War Post Traumatic Stress Disorder, Proceedings of the IEEE Virtual Reality Conference (VR 2006), p.9, March 25-29, 2006 [doi>10.1109/VR.2006.23]
• 21: Park, R.S., Chibnall, J.T., Blaskiewicz, R.J., Furman, G.E., Powell, J.K. and Mohr, C.J., Contruct Validity of an Objective Structured Clinical Examination (OSCE) in Psychiatry: Associations with the Clinical Skills Examination and Other Indicators. Academic Psychiatry 28,2 (2004), 122--128.
• 22: David-Paul Pertaub , Mel Slater , Chris Barker, An experiment on public speaking anxiety in response to three different types of virtual audience, Presence: Teleoperators and Virtual Environments, v.11 n.1, p.68-78, February 2002 [doi>10.1162/105474602317343668]
• 23: Ponder, M., Herbelin, B., Molet, T., Scherteneib, S., Ulicny, B., Papagiannakis, G., Magnenat-Thalmann, N. and Thalmann, D. Interactive Scenario Immersion: Health Emergency Decision Training in the JUST Project,. In VRMHR 2002, (2002).
• 24: Andrew Raij , Kyle Johnsen , Robert Dickerson , Benjamin Lok , Marc Cohen , Thomas Bernard , Christopher Oxendine , Peggy Wagner , D. Scott Lind, Interpersonal Scenarios: Virtual \approx Real?, Proceedings of the IEEE Virtual Reality Conference (VR 2006), p.8, March 25-29, 2006 [doi>10.1109/VR.2006.91]
• 25: Thórisson, K.R. and Cassell, J. Why Put an Agent in a Body: The Importance of Communicative Feedback in Human-Humanoid Dialogue. In Proceedings of Lifelike Computer Characters '96, (1996),44--45.
• 26: Vinayagamoorthy, V., Steed, A. and Slater, M. Building Characters: Lessons Drawn from Virtual Environments. In Proceedings of Toward Social Mechanisms of Android Science: A CogSci 2005 Workshop, (2005),119--126.
• 27: Wind, L.A., Dalen, J.v., Muijtjens, A.M.M. and Rethans, J.-J., Assessing Simulated Patients in an Educational Setting: the MaSP (Maastricht Assessment of Simulated Patients). Medical Education 38,1 (2004), 39--44.
• 28: Catherine Zanbaka , Paula Goolkasian , Larry Hodges, Can a virtual cat persuade you?: the role of gender and realism in speaker persuasiveness, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124945]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

General Terms:
Experimentation, Human Factors, Verification

Keywords:
medicine, multimodal interfaces, validation, virtual characters, virtual humans, virtual reality