Foot-based mobile interaction with games

ABSTRACT

Interaction with mobile applications is often awkward due to the limited and miniaturized input modalities available. This is especially problematic for games where the only incentive to use an application is the pleasure derived from the interaction. It is therefore interesting to examine novel forms of interaction in order to increase the "playability" of mobile games.In this paper we present a simple mobile gaming application on a standard Pocket PC PDA that employs computer vision (CV) as it's main interaction modality. Practical experience with the application demonstrates the feasibility of CV as a primary interaction modality and indicates the high potential of CV as an input modality for mobile devices in the future. Our approach exploits the video capabilities that are becoming ubiquitous on camera equipped smart-phones and PDAs to provide a fun solution for interaction tasks in games like "Pong", "Break-out" or soccer.

REFERENCES

• 1: AR-PDA: The AR-PDA, a personal digital mobile assistant for virtual and augmented reality, Project-homepage http://www.ar-pda.com
• 2: Dunlop, M. D. and Brewster, S. A. (Eds.): Proceedings of Mobile HCI 2001: Third International Workshop on Human Computer Interaction with Mobile Devices, IHM-HCI 2001 Lille, France, September 2001
• 3: Johnson, C. (Ed.): Proceedings of the First Workshop on Human Computer Interaction with Mobile Devices, GIST Technical Report G98-1, University of Glasgow, Scotland
• 4: Claudia Nölker , Helge Ritter, GREFIT: Visual Recognition of Hand Postures, Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction, p.61-72, March 17-19, 1999
• 5: Stichling, D. and Kleinjohann, B.: Edge Vectorization for Embedded Real-Time Systems using the CV-SDF Model, Proc. Vision Interface 2003, Halifax, Canada
• 6: Dirk Stichling , Bernd Kleinjohann, CV-SDF - A model for Real-Time Computer Vision Applications, Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision, p.325, December 03-04, 2002
• 7: WMCSA (2002): Workshop on Mobile Computing Systems and Applications, IEEE, http://wmcsa2002.hpl.hp.com/

INDEX TERMS

General Terms:
Experimentation, Human Factors

Keywords:
computer vision, entertainment computing, interaction techniques, mobile computing