Accelerometer-based user interfaces for the control of a physically simulated character

ABSTRACT

In late 2006, Nintendo released a new game controller, the Wiimote, which included a three-axis accelerometer. Since then, a large variety of novel applications for these controllers have been developed by both independent and commercial developers. We add to this growing library with three performance interfaces that allow the user to control the motion of a dynamically simulated, animated character through the motion of his or her arms, wrists, or legs. For comparison, we also implement a traditional joystick/button interface. We assess these interfaces by having users test them on a set of tracks containing turns and pits. Two of the interfaces (legs and wrists) were judged to be more immersive and were better liked than the joystick/button interface by our subjects. All three of the Wiimote interfaces provided better control than the joystick interface based on an analysis of the failures seen during the user study.

REFERENCES

• 1: Android Technologies, Inc., 2008. Robosapien gesture controller. http://www.robodance.com/.
• 2: Okan Arikan , D. A. Forsyth, Interactive motion generation from examples, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 3: Laroussi Bouguila , Florian Evequoz , Michele Courant , Beat Hirsbrunner, Walking-pad: a step-in-place locomotion interface for virtual environments, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027948]
• 4: Jinxiang Chai , Jessica K. Hodgins, Performance animation from low-dimensional control signals, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 5: Mira Dontcheva , Gary Yngve , Zoran Popović, Layered acting for character animation, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 6: William T. Freeman , David B. Anderson , Paul A. Beardsley , Chris N. Dodge , Michal Roth , Craig D. Weissman , William S. Yerazunis , Hiroshi Kage , Kazuo Kyuma , Yasunari Miyake , Ken-ichi Tanaka, Computer Vision for Interactive Computer Graphics, IEEE Computer Graphics and Applications, v.18 n.3, p.42-53, May 1998 [doi>10.1109/38.674971]
• 7: Jessica K. Hodgins , Wayne L. Wooten , David C. Brogan , James F. O'Brien, Animating human athletics, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.71-78, September 1995 [doi>10.1145/218380.218414]
• 8: Hodgins, J. K. 1991. Biped gait transitions. In Proc. IEEE Int'l Conf. on Robotics and Automation, 2092--2097.
• 9: Hoppe, F. M., and Dunnett, C. W. 1993. Multiple Comparisons, Selection, and Applications in Biometry. CRC Press.
• 10: T. Igarashi , T. Moscovich , J. F. Hughes, Spatial keyframing for performance-driven animation, Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 29-31, 2005, Los Angeles, California [doi>10.1145/1073368.1073383]
• 11: Michael Patrick Johnson , Andrew Wilson , Bruce Blumberg , Christopher Kline , Aaron Bobick, Sympathetic interfaces: using a plush toy to direct synthetic characters, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.152-158, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303028]
• 12: Lucas Kovar , Michael Gleicher , Frédéric Pighin, Motion graphs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 13: Joseph Laszlo , Michiel van de Panne , Eugene Fiume, Interactive control for physically-based animation, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.201-208, July 2000 [doi>10.1145/344779.344876]
• 14: Jehee Lee , Jinxiang Chai , Paul S. A. Reitsma , Jessica K. Hodgins , Nancy S. Pollard, Interactive control of avatars animated with human motion data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 15: Lee, J., 2008. Head tracking for desktop VR displays. http://www.cs.cmu.edu/~johnny/projects/wii/.
• 16: McMahon, T. A. 1984. Muscles, Reflexes, and Locomotion. Princeton University Press, Princeton.
• 17: Neff, M., Albrecht, I., and Seidel, H.-P. 2007. Layered performance animation with correlation maps. Computer Graphics Forum 26, 3, 675--684,.
• 18: Nintendo, 2006. Wii. http://www.wii.com/.
• 19: Nintendo, 2006. Wii Sports. http://wii.nintendo.com/softwarewiisports.jsp.
• 20: Nintendo, 2007. Donkey Kong Barrel Blast. http://www.nintendo.com/sites/dkbb/.
• 21: Nintendo, 2007. Mario Party 8. http://wii.nintendo.com/site/mp8/.
• 22: Nintendo, 2008. Mario Kart Wii. http://www.mariokart.com/wii/launch/.
• 23: Nintendo, 2008. Wii Fit. http://www.nintendo.com/wiifit/launch/.
• 24: Oore, S., Terzopoulos, D., and Hinton, G. 2002. Local physical models for interactive character animation. Computer Graphics Forum 21, 3, 337--346.
• 25: Oshita, M. 2005. Pen-to-mime: A pen-based interactive control of a human figure. Computer & Graphics 29, 6, 931--945.
• 26: Marc H. Raibert , Jessica K. Hodgins, Animation of dynamic legged locomotion, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.349-358, July 1991
• 27: Raibert, M. H., Chepponis, M., and Brown, H. B. 1986. Running on four legs as though they were one. IEEE Journal of Robotics and Automation RA-2, 2, 70--82.
• 28: Marc H. Raibert, Legged robots that balance, Massachusetts Institute of Technology, Cambridge, MA, 1986
• 29: Rasco, B., 2008. Where's the Wiimote? Using Kalman filtering to extract accelerometer data. http://www.gamasutra.com/.
• 30: Sharif Razzaque , David Swapp , Mel Slater , Mary C. Whitton , Anthony Steed, Redirected walking in place, Proceedings of the workshop on Virtual environments 2002, May 30-31, 2002, Barcelona, Spain
• 31: Slyper, R. Y., and Hodgins, J. K. 2008. Action capture with accelerometers. In Proc. SIGGRAPH/Eurographics Symp. on Computer Animation.
• 32: Sony, 2003. Eyetoy. http://www.eyetoy.com/.
• 33: James N. Templeman , Patricia S. Denbrook , Linda E. Sibert, Virtual Locomotion: Walking in Place through Virtual Environments, Presence: Teleoperators and Virtual Environments, v.8 n.6, p.598-617, December 1999 [doi>10.1162/105474699566512]
• 34: Matthew Thorne , David Burke , Michiel van de Panne, Motion doodles: an interface for sketching character motion, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 35: Ubisoft, 2007. Rayman Raving Rabbids 2. http://ravingrabbids2.us.ubi.com/.
• 36: US Mechantronics, 2008. WiiBot: How to build a sword-wielding, tennis-playing, Wiimote-controlled, friendly robot. http://www.usmgarage.com/usmgarage/WiiBot.html.
• 37: Martin Usoh , Kevin Arthur , Mary C. Whitton , Rui Bastos , Anthony Steed , Mel Slater , Frederick P. Brooks, Jr., Walking > walking-in-place > flying, in virtual environments, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.359-364, July 1999 [doi>10.1145/311535.311589]
• 38: van de Panne, M., and Lee, C. 2003. Ski stunt simulator: Experiments with interactive dynamics. In Proc. 14th Western Computer Graphics Symp.
• 39: Xsens Technologies. Moven--inertial motion capturing. http://www.xsens.com/moven.
• 40: KangKang Yin , Dinesh K. Pai, FootSee: an interactive animation system, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 41: KangKang Yin , Kevin Loken , Michiel van de Panne, SIMBICON: simple biped locomotion control, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 42: KangKang Yin , Stelian Coros , Philippe Beaudoin , Michiel van de Panne, Continuation methods for adapting simulated skills, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008
• 43: Youtube, 2008. Kyma X demonstrated with Nintendo Wiimote. http://www.youtube.com/watch?v=ESDzYY10__s.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation
  I.6 SIMULATION AND MODELING
      I.6.8 Types of Simulation
          Subjects: Gaming

Keywords:
Wiimotes, character animation, physical simulation, user interface