Optimization-based interactive motion synthesis

ABSTRACT

We present a physics-based approach to synthesizing motion of a virtual character in a dynamically varying environment. Our approach views the motion of a responsive virtual character as a sequence of solutions to the constrained optimization problem formulated at every time step. This framework allows the programmer to specify active control strategies using intuitive kinematic goals, significantly reducing the engineering effort entailed in active body control. Our optimization framework can incorporate changes in the character's surroundings through a synthetic visual sensory system and create significantly different motions in response to varying environmental stimuli. Our results show that our approach is general enough to encompass a wide variety of highly interactive motions.

REFERENCES

• 1: Yeuhi Abe , Marco da Silva , Jovan Popović, Multiobjective control with frictional contacts, Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 02-04, 2007, San Diego, California
• 2: Yeuhi Abe , Jovan Popović, Interactive animation of dynamic manipulation, Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, September 02-04, 2006, Vienna, Austria
• 3: Michael F. Cohen, Interactive spacetime control for animation, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.293-302, July 1992
• 4: da Silva, M., Abe, Y., and Popovic, J. 2008. Simulation of human motion data using short-horizon model-predictive control. Comput. Graphics Forum (EUROGRAPHICS) 27, 2, 371--380.
• 5: Petros Faloutsos , Michiel van de Panne , Demetri Terzopoulos, Composable controllers for physics-based character animation, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.251-260, August 2001 [doi>10.1145/383259.383287]
• 6: Anthony C. Fang , Nancy S. Pollard, Efficient synthesis of physically valid human motion, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 7: Gill, P., Saunders, M., and Murray, W. 1996. Snopt: An SQP algorithm for large-scale constrained optimization. Tech. rep. NA 96-2, University of California, San Diego.
• 8: Jessica K. Hodgins , Wayne L. Wooten , David C. Brogan , James F. O'Brien, Animating human athletics, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.71-78, September 1995 [doi>10.1145/218380.218414]
• 9: Paul M. Isaacs , Michael F. Cohen, Controlling dynamic simulation with kinematic constraints, ACM SIGGRAPH Computer Graphics, v.21 n.4, p.215-224, July 1987
• 10: Kawato, M. 1999. Internal models for motor control and trajectory planning. In Current Opinions in Neurobiology, Vol. 9.
• 11: Kudoh, S., Komura, T., and Ikeuchi, K. 2006. Stepping motion for a human-like character to maintain balance against large perturbations. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2661--2666.
• 12: Joseph Laszlo , Michiel van de Panne , Eugene Fiume, Limit cycle control and its application to the animation of balancing and walking, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.155-162, August 1996 [doi>10.1145/237170.237231]
• 13: Liegeois, A. 1977. Automatic supervisory control of the configuration and behavior of multibody mechanisms. IEEE Trans. Syst. Man Cybernetics 7, 12, 868--871.
• 14: Liu, C. K. 2008. Synthesis of interactive hand manipulation. In Proceedings of the Eurographics/SIGGRAPH Symposium on Computer Animation.
• 15: C. Karen Liu , Aaron Hertzmann , Zoran Popović, Learning physics-based motion style with nonlinear inverse optimization, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 16: C. Karen Liu , Zoran Popović, Synthesis of complex dynamic character motion from simple animations, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 17: Zicheng Liu , Steven J. Gortler , Michael F. Cohen, Hierarchical spacetime control, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.35-42, July 1994 [doi>10.1145/192161.192169]
• 18: Lockhart, D. B. and Ting, L. H. 2007. Optimal sensorimotor transformations for balance. Nat Neurosci 10, 1329--1336.
• 19: Maciejewski, A. A. and Klein, C. A. 1985. Obstacle avoidance for kinematically redundant manipulators in dynamically varying environments. Int. J. Robotics Res. 4, 3, 109--117.
• 20: Ronald Metoyer , Victor Zordan , Benjamin Hermens , Chun-Chi Wu , Marc Soriano, Psychologically Inspired Anticipation and Dynamic Response for Impacts to the Head and Upper Body, IEEE Transactions on Visualization and Computer Graphics, v.14 n.1, p.173-185, January 2008 [doi>10.1109/TVCG.2007.70427]
• 21: NaturalMotion. 2006. Endorphin. www.naturalmotion.com.
• 22: Zoran Popović , Andrew Witkin, Physically based motion transformation, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.11-20, July 1999 [doi>10.1145/311535.311536]
• 23: Marc H. Raibert, Legged robots that balance, Massachusetts Institute of Technology, Cambridge, MA, 1986
• 24: Alla Safonova , Jessica K. Hodgins , Nancy S. Pollard, Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 25: Sentis, L. and Khatib, O. 2005. Synthesis of whole-body behaviors through hierarchical control of behavioral primitives. Int. J. Humanoid Robotics 2, 4, 505--518.
• 26: Sentis, L. and Khatib, O. 2006. A whole-body control framework for humanoids operating in human environments. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). 2641--2648.
• 27: Sharon, D. and van de Panne, M. 2005. Synthesis of controllers for stylized planar bipedal walking. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA).
• 28: Stewart, A. J. and Cremer, J. F. 1992a. Animation of 3d human locomotion: Climbing stairs and descending stairs. In Proceedings of the Eurographics Workshop on Animation and Simulation, 152--168.
• 29: A. James Stewart , James F. Cremer, Beyond keyframing: an algorithmic approach to animation, Proceedings of the conference on Graphics interface '92, p.273-281, September 1992, Vancouver, British Columbia, Canada
• 30: Adnan Sulejmanpašić , Jovan Popović, Adaptation of performed ballistic motion, ACM Transactions on Graphics (TOG), v.24 n.1, p.165-179, January 2005 [doi>10.1145/1037957.1037966]
• 31: Uno, Y., Kawato, M., and Suzuki, R. 1989. Minimum muscle-tension-change model which reproduces human arm movement. In Proceedings of the Symposium on Biological and Physiological Engineering, 299--302.
• 32: van de Panne, M. and Lamouret, A. 1995. Guided optimization for balanced locomotion. In Computer Animation and Simulation, 165--177.
• 33: Andrew Witkin , Michael Kass, Spacetime constraints, ACM SIGGRAPH Computer Graphics, v.22 n.4, p.159-168, Aug. 1988
• 34: Wayne Lewis Wooten , Jessica K. Hodgins, Simulation of leaping, tumbling, landing, and balancing humans, Georgia Institute of Technology, Atlanta, GA, 1998
• 35: Yamane, K. and Nakamura, Y. 2000. Dynamics filter?Concept and implementation of on-line motion generator for human figures. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 688--695.
• 36: KangKang Yin , Kevin Loken , Michiel van de Panne, SIMBICON: simple biped locomotion control, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 37: Victor Zordan , Adriano Macchietto , Jose Medin , Marc Soriano , Chun-Chih Wu , Ronald Metoyer , Robert Rose, Anticipation from example, Proceedings of the 2007 ACM symposium on Virtual reality software and technology, November 05-07, 2007, Newport Beach, California [doi>10.1145/1315184.1315197]
• 38: Zordan, V. B. and Hodgins, J. K. 1999. Tracking and modifying upper-body human motion data with dynamic simulation. In Conference on Computer Animation and Simulation.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

General Terms:
Algorithms, Design, Experimentation

Keywords:
Character animation, nonlinear optimization, physics-based animation