TimeWarp: interactive time travel with a mobile mixed reality game

ABSTRACT

Mobile location-aware applications have become quite popular across a range of new areas such as pervasive games and mobile edutainment applications. However it is only recently, that approaches have been presented which combine gaming and education with mobile Augmented Reality systems. However they typically lack a close crossmedia integration of the surroundings, and often annotate or extend the environment rather than modifying and altering it.

In this paper we present a mobile outdoor mixed reality game for exploring the history of a city in the spatial and the temporal dimension. We introduce the design and concept of the game and present a universal mechanism to define and setup multi-modal user interfaces for the game challenges. Finally we discuss the results of the user tests.

REFERENCES

• 1: Alexander, C. A Pattern Language, New York. 1977.
• 2: Jeremy N. Bailenson , Jim Blascovich , Andrew C. Beall , Jack M. Loomis, Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments, Presence: Teleoperators and Virtual Environments, v.10 n.6, p.583-598, December 2001 [doi>10.1162/105474601753272844]
• 3: David Benyon , Michael Smyth , Shaleph O'Neill , Rod McCall , Fiona Carroll, The place probe: exploring a sense of place in real and virtual environments, Presence: Teleoperators and Virtual Environments, v.15 n.6, p.668-687, December 2006 [doi>10.1162/pres.15.6.668]
• 4: Wolfgang Broll , Irma Lindt , Jan Ohlenburg , Iris Herbst , Michael Wittkamper , Thomas Novotny, An Infrastructure for Realizing Custom-Tailored Augmented Reality User Interfaces, IEEE Transactions on Visualization and Computer Graphics, v.11 n.6, p.722-733, November 2005 [doi>10.1109/TVCG.2005.90]
• 5: Wolfgang Broll , Jan Ohlenburg , Irma Lindt , Iris Herbst , Anne-Kathrin Braun, Meeting technology challenges of pervasive augmented reality games, Proceedings of 5th ACM SIGCOMM workshop on Network and system support for games, October 30-31, 2006, Singapore [doi>10.1145/1230040.1230097]
• 6: Chalmers, M. Seamful Design and Ubicomp Infrastructure. Proceedings of Ubicomp 2003 Workshop at the Crossroads: The Interaction of HCI and Systems Issues in Ubicomp
• 7: Adrian David Cheok , Kok Hwee Goh , Wei Liu , Farzam Farbiz , Siew Wan Fong , Sze Lee Teo , Yu Li , Xubo Yang, Human Pacman: a mobile, wide-area entertainment system based on physical, social, and ubiquitous computing, Personal and Ubiquitous Computing, v.8 n.2, p.71-81, May 2004 [doi>10.1007/s00779-004-0267-x]
• 8: A. D. Cheok , F. S. Wan, Game-City: A Ubiquitous Large Area Multi-Interface Mixed Reality Game Space for Wearable Computers, Proceedings of the 6th IEEE International Symposium on Wearable Computers, p.156, October 07-10, 2002
• 9: Davidsson, O., Peitz, J., Björk, S., Game Design Patterns for Mobile Games. Project report to Nokia Research Center, Finland, 2004.
• 10: Steven Feiner , Blair MacIntyre , Tobias Hollerer , Anthony Webster, A Touring Machine: Prototyping 3D Mobile Augmented Reality Systems for Exploring the Urban Environment, Proceedings of the 1st IEEE International Symposium on Wearable Computers, p.74, October 13-14, 1997
• 11: Ferdinand, P., Müller, S., Ritschel, T., Wechselberger, U., The Eduventure --- A New Approach of Digital Game Based Learning Combining Virtual and Mobile Augmented Reality Game Episodes. Pre-Conference Workshop Game based Learning of DeLFI 2005 and GMW 2005 Conference, Rostock, 13. September 2005, Germany
• 12: Sinem Guven , Steven Feiner, Interaction Techniques for Exploring Historic Sites through Situated Media, Proceedings of the 3D User Interfaces, p.111-118, March 25-29, 2006
• 13: Ijsselsteijn, W. A. & Riva, G. Being There: The experience of presence in mediated environments. In: Riva, G., Davide, F., & Ijsselsteijn, W. A., (eds.), Being There - Concepts, Effects and Measurements of User Presence in Synthetic Environments, Amsterdam: IOS Press, 2003. pp. 3--16
• 14: Hirokazu Kato , Mark Billinghurst, Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System, Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, p.85, October 20-21, 1999
• 15: Lindt, I., Broll, W.: NetAttack - First Steps Towards Pervasive Gaming, ERCIM NEWS Special Issue on Games Technology, No. 57 (April 2004,). 49--50
• 16: Irma Lindt , Jan Ohlenburg , Uta Pankoke-Babatz , Wolfgang Prinz , Sabiha Ghellal, Combining multiple gaming interfaces in epidemic menace, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125496]
• 17: Lindt, I., Ohlenburg, J., Pankoke-Babatz, U., S. Ghellal, L. Oppermann, and M. Adams. Designing Cross Media Games. In Proc. PerGames Workshop at Pervasive 2005.
• 18: Lombard, M. & Ditton, T. (1997). At the Heart of It All: The Concept of Presence, Journal of Computer-Mediated Communication, 3(2). http://www.ascusc.org/jcmc/vol3/issue2/lombard.html
• 19: Carsten Magerkurth , Adrian David Cheok , Regan L. Mandryk , Trond Nilsen, Pervasive games: bringing computer entertainment back to the real world, Computers in Entertainment (CIE), v.3 n.3, July 2005 [doi>10.1145/1077246.1077257]
• 20: Malaka, R., Schneider, K., Kretschmer, U., Stage-Based Augmented Edutainment. Smart Graphics, volume 3031, 54--65 (2004)
• 21: Malone, T. W. Toward a theory of intrinsically motivating instruction. Cognitive Science 4, 13 (1981), 333--369.
• 22: Jan Ohlenburg , Iris Herbst , Irma Lindt , Thorsten Fröhlich , Wolfgang Broll, The MORGAN framework: enabling dynamic multi-user AR and VR projects, Proceedings of the ACM symposium on Virtual reality software and technology, November 10-12, 2004, Hong Kong [doi>10.1145/1077534.1077568]
• 23: Doyun Park , Tek-Jin Nam , Chung-Kon Shi, Designing an immersive tour experience system for cultural tour sites, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125675]
• 24: Wayne Piekarski , Bruce Thomas, ARQuake: the outdoor augmented reality gaming system, Communications of the ACM, v.45 n.1, January 2002 [doi>10.1145/502269.502291]
• 25: Relph, E. Place and Placelessness, London: Pion Books. 1976
• 26: Luis Salgado , Enrique Rendón , Roberto Artola, System architecture for tourist orientation: the TOSCA high-end system, Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage, November 28-30, 2001, Glyfada, Greece [doi>10.1145/584993.585044]
• 27: Vorderer, P., Wirth, W., Gouveia, F. R., Biocca, F., Saari, T., Jäncke, F., Böcking, S., Schramm, H., Gysbers, A., Hartmann, T., Klimmt, C., Laarni, J., Ravaja, N., Sacau, A., Baumgartner, T., & Jääncke, P. (2004). MEC Spatial Presence Questionnaire (MEC-SPQ): Short Documentation and Instructions for Application. Report to the European Community, Project Presence: MEC (IST-2001-37661). Online. Available from http://www.ijk.hmt-hannover.de/presence
• 28: Vlahakis, V., Karigiannis, J., Tsotros, M., Gounaris, M., Ionnidis, N., Stricker, D., Gleue, T., Daehne, P., Almeida, H., Interactive Augmented Touring of Archaeological Sitel. Laval Virtual, International Conference on Virtual Reality, 2002, Laval, France
• 29: Wagner, D., Pintaric T., Ledermann, F., Schmalstieg, D.,. Towards Massively Multi-User Augmented Reality on Handheld Devices. Proceedings of Third International Conference on Pervasive Computing, Pervasive 2005
• 30: Walz, S., Ballagas, R., Borchers, J., Mendoza, J., Kratz, S., Wartmann, C., Fuhr, C., Tann, M., Shin, D., Hameed, B., Bardos, L., Hovestadt, L.,. Cell Spell-Casting: Designing a Locative and Gesture Recognition Multiplayer Smartphone Game for Tourists. PERGAMES, Third International Workshop on Pervasive Gaming Applications at PERVASIVE 2006, Dublin, Ireland, May 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
      I.3.6 Methodology and Techniques

  K. Computing Milieux
  K.8 PERSONAL COMPUTING
      K.8.0 General

General Terms:
Design, Experimentation, Human Factors, Languages, Measurement

Keywords:
augmented reality (AR), mixed reality (MR), multimodal interfaces, pervasive gaming, presence