Gameplay issues in the design of spatial 3D gestures for video games.

ABSTRACT

We describe preliminary tests that form the first phase of research into issues involved with the design of spatial 3D gestures for video games. Early research on 3D gesture and spatial interaction was largely the domain of Virtual Reality (VR) [1]. More recent work looks at 3D gestures for mobile devices [2] and pervasive computing [3]. We are investigating issues affecting usability and fun [4] in the context of 3D gestures and spatial movement in video games where emotion, immediacy and immersion are more important than breadth of functionality and user task efficiency. These tests use our 3motion™ system, a wireless inertial motion tracking device and gesture SDK. This enables a range of gesture types from tight, precise movements to whole arm gestures, and from direct mapping of movement to recognition of 3D symbolic gestures. Four game scenarios using different spatial gesture characteristics were used to identify gameplay issues that have an impact on the design of 3D interaction.

REFERENCES

• 1: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, A survey of design issues in spatial input, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.213-222, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192501]
• 2: Marentakis, G. Brewster, S.A. A Study on Gestural Interaction with a 3D Audio Display. In Proc. Mobile HCI (2004) Vol. 3160, 180--191
• 3: A Map-Based System Using Speech and 3D Gestures for Pervasive Computing, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.191, October 14-16, 2002 [doi>10.1109/ICMI.2002.1166991]
• 4: Thomas W. Malone, What makes things fun to learn? heuristics for designing instructional computer games, Proceedings of the 3rd ACM SIGSMALL symposium and the first SIGPC symposium on Small systems, p.162-169, September 18-19, 1980, Palo Alto, California, United States [doi>10.1145/800088.802839]
• 5: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, Proceedings of the 7th annual conference on Computer graphics and interactive techniques, p.262-270, July 14-18, 1980, Seattle, Washington, United States
• 6: Keir, P. Elgoyhen, J. Naef, M. Payne, J. Horner, M. Anderson, P. Gesture-recognition with non-referenced tracking. 1st IEEE Symposium on 3D User interfaces (2006).
• 7: Kent, S. L. The first quarter: a 25-year history of video games. Bothwell, WA, BWD Press (2000)

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Keywords:
3D gestures, fun, physical gaming, spatial interaction, videogames