Detecting gesture force peaks for intuitive interaction

ABSTRACT

With the release of the Nintendo Wii in 2006, the use of haptic force gestures has become a very popular form of input for interactive entertainment. However, current gesture recognition techniques utilised in Nintendo Wii games fall prey to a lack of control when it comes to recognising simple gestures. This paper presents a simple gesture recognition technique called Peak Testing which gives greater control over gesture interaction. This recognition technique locates force peaks in continuous force data (provided by a gesture device such as the Wiimote) and then cancels any peaks which are not meant for input. Peak Testing is therefore technically able to identify movements in any direction. This paper applies this recognition technique to control virtual instruments and investigates how users respond to this interaction. The technique is then explored as the basis for a robust way to navigate menus with a simple flick of the wrist. We propose that this flick-form of interaction could be a very intuitive way to navigate Nintendo Wii menus instead of the current pointer techniques implemented.

REFERENCES

• 1: Amento, B., Brooks, P., Harley, H., & McGee, M. (1996) Fitts' Law. Available from: http://ei.cs.vt.edu/~cs5724/g1/#summary. Accessed 1 July, 2008.
• 2: CBS News (2005) Gesture Glove Not Science Fiction. Available from http://www.cbsnews.com/stories/2005/08/23/eveningnews/main792311.shtml. Accessed 1 July, 2008
• 3: Cohen, C. (1999) A Brief Overview of Gesture Recognition. Available from: http://homepages.inf.ed.ac.uk/rbf/CVonline/LOCAL_COPIES/COHEN/gesture_overview.html. Accessed 1 July, 2008.
• 4: Hidden Markov Model Based Continuous Online Gesture Recognition, Proceedings of the 14th International Conference on Pattern Recognition-Volume 2, p.1206, August 16-20, 1998 [doi>10.1109/ICPR.1998.711914]
• 5: Goldberg, K. (2008) A Web-based Test of Fitts' Law. Available from http://www.tele-actor.net/fitts/index.html. Accessed 1 July, 2008.
• 6: Jukka Linjama , Topi Kaaresoja, Novel, minimalist haptic gesture interaction for mobile devices, Proceedings of the third Nordic conference on Human-computer interaction, p.457-458, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028095]
• 7: Jani Mäntyjärvi , Juha Kela , Panu Korpipää , Sanna Kallio, Enabling fast and effortless customisation in accelerometer based gesture interaction, Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, p.25-31, October 27-29, 2004, College Park, Maryland [doi>10.1145/1052380.1052385]
• 8: Mitra, S., & Acharya, T. (2007) Gesture recognition: a survey. Systems, man, and cybernetics, Part C: Applications and Reviews, IEE, 37(3), 311--324.
• 9: Brad A. Myers, A brief history of human-computer interaction technology, interactions, v.5 n.2, p.44-54, March/April 1998 [doi>10.1145/274430.274436]
• 10: Nespoulous, J., Perron, P., and Lecours, A. The Biological Foundations of Gestures: Motor and Semiotic Aspects. Lawrence Erlbaum Associates, Hillsdale, MJ, 1986.
• 11: Nintendo. (2006) The Nintendo Wii. Available from http://www.wii.com. Accessed 1 July, 2008.
• 12: Nintendo. (2006) Wii Experience. Available from http://wiiportal.nintendo-europe.com/14.html. Accessed 1 July, 2008.
• 13: Nuance Communications. (2007) T9 Text Input. Available from http://www.t9.com/. Accessed 1 July, 2008.
• 14: Thomas Schlömer , Benjamin Poppinga , Niels Henze , Susanne Boll, Gesture recognition with a Wii controller, Proceedings of the 2nd international conference on Tangible and embedded interaction, February 18-20, 2008, Bonn, Germany [doi>10.1145/1347390.1347395]
• 15: Troillard, C. (2008) Osculator FAQ. Available from http://www.osculator.net/wiki/Main/FAQ. Accessed 1 July, 2008.

INDEX TERMS

General Terms:
Algorithms, Design, Human Factors, Measurement, Performance

Keywords:
Nintendo, Wii, Wiimote, accelerometer, games, gesture recognition, gestures, interaction, navigation