Simulating biped behaviors from human motion data

ABSTRACT

Physically based simulation of human motions is an important issue in the context of computer animation, robotics and biomechanics. We present a new technique for allowing our physically-simulated planar biped characters to imitate human behaviors. Our contribution is twofold. We developed an optimization method that transforms any (either motion-captured or kinematically synthesized) biped motion into a physically-feasible, balance-maintaining simulated motion. Our optimization method allows us to collect a rich set of training data that contains stylistic, personality-rich human behaviors. Our controller learning algorithm facilitates the creation and composition of robust dynamic controllers that are learned from training data. We demonstrate a planar articulated character that is dynamically simulated in real time, equipped with an integrated repertoire of motor skills, and controlled interactively to perform desired motions.

REFERENCES

• 1: AIST Human Body Properties Database, 2006. http://www.dh.aist.go.jp/bodydb.
• 2: Anderson, F., and Pandy', M. 2001. Dynamic optimization of human walking. Journal of Biomechanical Engineering 123, 381--390.
• 3: Okan Arikan , David A. Forsyth , James F. O'Brien, Motion synthesis from annotations, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 4: Okan Arikan , David A. Forsyth , James F. O'Brien, Pushing people around, Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 29-31, 2005, Los Angeles, California [doi>10.1145/1073368.1073376]
• 5: A. Bruderlin , T. W. Calvert, Goal-directed, dynamic animation of human walking, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.233-242, July 1989
• 6: Michael F. Cohen, Interactive spacetime control for animation, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.293-302, July 1992
• 7: Dasgupta, A., and Nakamura, Y. 1999. making feasible walking motion of humanoid robots from human motion capture data. In Proceedings of IEEE Intl. Conference on Robotics and Automation (ICRA), 1044--1049.
• 8: Petros Faloutsos , Michiel van de Panne , Demetri Terzopoulos, Composable controllers for physics-based character animation, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.251-260, August 2001 [doi>10.1145/383259.383287]
• 9: Anthony C. Fang , Nancy S. Pollard, Efficient synthesis of physically valid human motion, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 10: Aaron Hertzmann, Introduction to Bayesian learning, ACM SIGGRAPH 2004 Course Notes, p.22-es, August 08-12, 2004, Los Angeles, CA [doi>10.1145/1103900.1103922]
• 11: Jessica K. Hodgins , Nancy S. Pollard, Adapting simulated behaviors for new characters, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.153-162, August 1997 [doi>10.1145/258734.258822]
• 12: Jessica K. Hodgins , Wayne L. Wooten , David C. Brogan , James F. O'Brien, Animating human athletics, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.71-78, September 1995 [doi>10.1145/218380.218414]
• 13: Kajita, S., Kanehiro, F., Kaneko, K., Fujiwara, K., Harada, K., Yokoi, K., and Hirukawa, H. 2003. Biped walking pattern generation by using preview control of zero-moment point. In Proceedings of the IEEE International Conference on Robotics and Automation, 1620--1626.
• 14: Taku Komura , Howard Leung , James Kuffner, Animating reactive motions for biped locomotion, Proceedings of the ACM symposium on Virtual reality software and technology, November 10-12, 2004, Hong Kong [doi>10.1145/1077534.1077542]
• 15: Lucas Kovar , Michael Gleicher , Frédéric Pighin, Motion graphs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 16: Joseph Laszlo , Michiel van de Panne , Eugene Fiume, Limit cycle control and its application to the animation of balancing and walking, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.155-162, August 1996 [doi>10.1145/237170.237231]
• 17: Joseph Laszlo , Michiel van de Panne , Eugene Fiume, Interactive control for physically-based animation, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.201-208, July 2000 [doi>10.1145/344779.344876]
• 18: Jehee Lee , Sung Yong Shin, A hierarchical approach to interactive motion editing for human-like figures, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.39-48, July 1999 [doi>10.1145/311535.311539]
• 19: Jehee Lee , Jinxiang Chai , Paul S. A. Reitsma , Jessica K. Hodgins , Nancy S. Pollard, Interactive control of avatars animated with human motion data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 20: C. Karen Liu , Zoran Popović, Synthesis of complex dynamic character motion from simple animations, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 21: C. Karen Liu , Aaron Hertzmann , Zoran Popović, Learning physics-based motion style with nonlinear inverse optimization, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 22: Loken, K. 2006. Imitation-based Learning of Bipedal Walking Using Locally Weighted Learning. Master's thesis, Computer Science Department, The University of British Columbia.
• 23: Mount, D., and Arya, S., 2006. Ann: Library for approximate nearest neighbor searching, http://www.cs.sunysb.edu/algorith/implement/ann/distrib/index1.html.
• 24: Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Schaal, S., and Kawato, M. 2004. Learning from demonstration and adaptation of biped locomotion. Robotics and Autonomous Systems 47, 79--91.
• 25: Nakaoka, S., Nakazawa, A., and Yokoi, K. 2003. Generating whole body motions for a biped humanoid robot from captured human dances. In Proceedings of the IEEE International Conference on Robotics and Automation, 3905--3910.
• 26: Oshita, M., and Makinouchi, A. 2001. A dynamic motion control technique for human-like articulated figures. Computer Graphics Forum (EUROGRAPHICS 2001) 20, 3, 192--202.
• 27: Zoran Popović , Andrew Witkin, Physically based motion transformation, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.11-20, July 1999 [doi>10.1145/311535.311536]
• 28: William H. Press , William T. Vetterling , Saul A. Teukolsky , Brian P. Flannery, Numerical Recipes in C++: the art of scientific computing, Cambridge University Press, New York, NY, 2001
• 29: Safonova, A., Pollard, N. S., and Hodgins, J. K. 2003. Optimizing human motion for the control of a humanoid robot. In Proceedings of 2nd International Symposium on Adaptive Motion of Animals and Machines (AMAM2003).
• 30: Alla Safonova , Jessica K. Hodgins , Nancy S. Pollard, Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 31: Schaal, S., Ijspeert, A., and Billard, A. 2003. Computational approaches to motor learning by imitation. Philosophical Transaction of the Royal Society of London: Series B, Biological Sciences 358, 537--547.
• 32: Sharon, D., and van de Panne, M. 2005. Synthesis of controllers for stylized planar bipedal walking. In International Conference on Robotics and Automation (ICRA 2005), 18--22.
• 33: Smith, R., 2006. Open dynamics engine, http://www.ode.org.
• 34: Adnan Sulejmanpašić , Jovan Popović, Adaptation of performed ballistic motion, ACM Transactions on Graphics (TOG), v.24 n.1, p.165-179, January 2005 [doi>10.1145/1037957.1037966]
• 35: Harold C. Sun , Dimitris N. Metaxas, Automating gait generation, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.261-270, August 2001 [doi>10.1145/383259.383288]
• 36: Tak, S., Song, O.-Y., and Ko, H.-S. 2000. Motion balance filtering. Computer Graphics Forum (Eurographics 2000) 19, 3, 437--446.
• 37: Yamane, K., and Nakamura, Y. 2000. Dynamics filter - concept and implementation of on-line motion generator for human figures. In Proceedings of the IEEE International Conference on Robotics and Automation, 688--695.
• 38: Yin, K., Pai, D. K., and van de Panne, M. 2005. Data-driven interactive balancing behaviors. In Pacific Graphics.
• 39: KangKang Yin , Kevin Loken , Michiel van de Panne, SIMBICON: simple biped locomotion control, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 40: Victor Brian Zordan , Jessica K. Hodgins, Motion capture-driven simulations that hit and react, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545276]
• 41: Victor Brian Zordan , Anna Majkowska , Bill Chiu , Matthew Fast, Dynamic response for motion capture animation, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Keywords:
biped walk and balance, controller learning, human motion, motion capture, physically based simulation