Automating the detection of breaks in continuous user experience with computer games

ABSTRACT

This paper describes an approach towards automating the identification of design problems with three-dimensional mediated or gaming environments through the capture and query of user-player behavior represented as a data schema that we have termed "immersidata". Analysis of data from a study of an educational computer game that we are developing shows that this approach is an effective way to pinpoint potential usability or design problems occurring in unfolding situational and episodic events that can interrupt or break user experience. As well as informing redesign, a key advantage of this cost-effective approach is that it considerably reduces the time evaluators spend analyzing hours of videoed study material.

REFERENCES

• 1: IJsselsteijn W. A., Freeman J., Avons S. E., Davidoff J., de Ridder H. and Hamberg R. Continuous assessment of presence, Perception, 26 (suppl), 42--43, 1997.
• 2: Marsh T. Staying there: an activity-based approach to narrative design and evaluation as an antidote to virtual corpsing, In: G. Riva, F. Davide and W. A. IJsselsteijn, Being There: Concepts, effects and measurements of user presence in synthetic environments. Amsterdam, The Netherlands: IOS Press, Chapter Five, 85--96, 2003.
• 3: Marsh T, Yang K and Shahabi C. Vicariously there: connected with and through our own and other characters, In Proceedings of the AISB 2005 Virtual Social Characters Symposium: Empathic Interaction Theme, University of Hertfordshire, Hatfield, UK, 2005.
• 4: Michael Meehan , Brent Insko , Mary Whitton , Frederick P Brooks, Jr., Physiological Measures of Presence in Virtual Environments, University of North Carolina at Chapel Hill, Chapel Hill, NC, 2001
• 5: Shahabi C. AIMS: An Immersidata Management System, VLDB First Biennial Conference on Innovative Data Systems Research (CIDR2003), Asilomar, CA, 2003. Available at: http://infolab.usc.edu/DocsDemos/p138-shahabi.pdf
• 6: Slater M. and Steed A. A Virtual Presence Counter, Presence: Teleoperators and Virtual Environments, MIT Press, 9, 5, 413--434, 2000.
• 7: Slater, M., Brogni A., and Steed A. Physiological Responses to Breaks in Presence: A Pilot Study. In Proceedings of the 6th International Workshop on Presence. Aalborg, Denmark, 2003.
• 8: Smith S., Duke D. and Massink M. The hybrid world of virtual environments. Computer Graphics Forum, 18, 3, Blackwell Publishers, C297-C307, 1999.
• 9: Jonathan Sykes , Simon Brown, Affective gaming: measuring emotion through the gamepad, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765957]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Human Factors

Keywords:
3D mediated environments, computer games, database storage and query, digital games, evaluation, presence, usability, user experience