MIND-WARPING: towards creating a compelling collaborative augmented reality game

ABSTRACT

Computer gaming offers a unique test-bed and market for advanced concepts in computer science, such as Human Computer Interaction (HCI), computer-supported collaborative work (CSCW), intelligent agents, graphics, and sensing technology. In addition, computer gaming is especially well-suited for explorations in the relatively young fields of wearable computing and augmented reality (AR). This paper presents a developing multi-player augmented reality game, patterned as a cross between a martial arts fighting game and an agent controller, as implemented using the Wearable Augmented Reality for Personal, Intelligent, and Networked Gaming (WARPING) system. Through interactions based on gesture, voice, and head movement input and audio and graphical output, the WARPING system demonstrates how computer vision techniques can be exploited for advanced, intelligent interfaces.

REFERENCES

• 1: Kessler, D., Kooper, R., and Hodges, L. The Simple Virtual Environment Library User's Guide V2.0. GVU Center, Georgia Tech, 1997.
• 2: Wolfgang Krüger , Christian-A. Bohn , Bernd Fröhlich , Heinrich Schüth , Wolfgang Strauss , Gerold Wesche, The Responsive Workbench: A Virtual Work Environment, Computer, v.28 n.7, p.42-48, July 1995 [doi>10.1109/2.391040]
• 3: Leibe, B., Starrier, T., Ribarsky, W., Wartell, Z., Krum, D., Singletary, B., Hodges, L. The Perceptive Workbench. Submitted to VR2000.
• 4: M. Mantyla, Introduction to Solid Modeling, W. H. Freeman & Co., New York, NY, 1988
• 5: Toshikazu Ohshima , Kiyohide Satoh , Hiroyuke Yamamoto , Hideyuki Tamura, AR² Hockey, ACM SIGGRAPH 98 Conference abstracts and applications, p.110, July 19-24, 1998, Orlando, Florida, United States [doi>10.1145/280953.281302]
• 6: Paul L. Rosin , Geoff A. W. West, Nonparametric Segmentation of Curves into Various Representations, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.12, p.1140-1153, December 1995 [doi>10.1109/34.476507]
• 7: Thad Starner , Alex Pentland , Joshua Weaver, Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.12, p.1371-1375, December 1998 [doi>10.1109/34.735811]
• 8: Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., and Pentland, A. Augmented Reality Through Wearable Computing. Presence 6,4.
• 9: Steve Sullivan , Jean Ponce, Automatic Model Construction and Pose Estimation From Photographs Using Triangular Splines, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.10, p.1091-1097, October 1998 [doi>10.1109/34.722621]
• 10: Zsolt Szalavári , Erik Eckstein , Michael Gervautz, Collaborative gaming in augmented reality, Proceedings of the ACM symposium on Virtual reality software and technology, p.195-204, November 02-05, 1998, Taipei, Taiwan [doi>10.1145/293701.293740]
• 11: Ullmer B., and Ishii, H. The metaDESK: Proc. of UIST, 1997.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE

General Terms:
Experimentation, Human Factors

Keywords:
augmented reality, computer vision, wearable computing