Synthesizing animations of human manipulation tasks

ABSTRACT

Even such simple tasks as placing a box on a shelf are difficult to animate, because the animator must carefully position the character to satisfy geometric and balance constraints while creating motion to perform the task with a natural-looking style. In this paper, we explore an approach for animating characters manipulating objects that combines the power of path planning with the domain knowledge inherent in data-driven, constraint-based inverse kinematics. A path planner is used to find a motion for the object such that the corresponding poses of the character satisfy geometric, kinematic, and posture constraints. The inverse kinematics computation of the character's pose resolves redundancy by biasing the solution toward natural-looking poses extracted from a database of captured motions. Having this database greatly helps to increase the quality of the output motion. The computed path is converted to a motion trajectory using a model of the velocity profile. We demonstrate the effectiveness of the algorithm by generating animations across a wide range of scenarios that cover variations in the geometric, kinematic, and dynamic models of the character, the manipulated object, and obstacles in the scene.

REFERENCES

• 1: Okan Arikan , D. A. Forsyth, Interactive motion generation from examples, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 2: Okan Arikan , David A. Forsyth , James F. O'Brien, Motion synthesis from annotations, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 3: Sunil Arya , David M. Mount , Nathan S. Netanyahu , Ruth Silverman , Angela Y. Wu, An optimal algorithm for approximate nearest neighbor searching fixed dimensions, Journal of the ACM (JACM), v.45 n.6, p.891-923, Nov. 1998 [doi>10.1145/293347.293348]
• 4: ATKESON, C., AND HOLLERBACH, J. 1985. Kinematic features of unrestrained vertical arm movements. Journal of Neuroscience, 9, 318--2330.
• 5: BANDI, S. 1998. Discrete Object Space Methods for Computer Animation. PhD thesis, Swiss Federal Institute of Technology.
• 6: Jérîme Barraquand , Jean-Claude Latombe, Robot motion planning: a distributed representation approach, International Journal of Robotics Research, v.10 n.6, p.628-649, Dec. 1991 [doi>10.1177/027836499101000604]
• 7: BINDIGANAVALE, R., GRANIERI, J., WEI, S., ZHAO, X., AND BADLER, N. 1994. Posture interpolation with collision avoidance. In Proc. of Computer Animation '94, 13--20.
• 8: Ronan Boulic , Ramon Mas-Sanso , Daniel Thalmann, Complex Character Positioning Based on a Compatible Flow Model of Multiple Supports, IEEE Transactions on Visualization and Computer Graphics, v.3 n.3, p.245-261, July 1997 [doi>10.1109/2945.620491]
• 9: A. Bruderlin , T. W. Calvert, Goal-directed, dynamic animation of human walking, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.233-242, July 1989
• 10: CHING, W., AND BADLER, N. 1992. Fast motion planning for anthropometric figures with many degrees of freedom. In Proc. IEEE Int'l Conf. on Robotics and Automation, 2340--2345.
• 11: Michael Gleicher, Motion editing with spacetime constraints, Proceedings of the 1997 symposium on Interactive 3D graphics, p.139-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253321]
• 12: Michael Gleicher, Retargetting motion to new characters, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.33-42, July 1998 [doi>10.1145/280814.280820]
• 13: JUNG, M. R., BADLER, N., AND NOMA, T. 1994. Animated human agents with motion planning capability for 3D-space postural goals. J. Visualization and Comp. Animation 5, 4, 225--246.
• 14: KALISIAK, M., AND VANDE PANNE, M. 2000. A grasp-based motion planning algorithm for character animation. In Proc. Comp. Animation and Simulation 2000, Springer-Verlag, 43--58.
• 15: KAVRAKI, L., ŠVESTKA, P., LATOMBE, J. C., AND OVERMARS, M. H. 1996. Probabilistic roadmaps for path planning in high-dimensional configuration space. IEEE Trans. on Robotics and Automation 12, 4, 566--580.
• 16: KAWATO, M. 1999. Internal models for motor control and trajectory planning. Current Opinion in Neurobiology 9, 718--727.
• 17: Yoshihito Koga , Koichi Kondo , James Kuffner , Jean-Claude Latombe, Planning motions with intentions, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.395-408, July 1994 [doi>10.1145/192161.192266]
• 18: Lucas Kovar , Michael Gleicher , Frédéric Pighin, Motion graphs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 19: James J. Kuffner, Jr. , Satoshi Kagami , Koichi Nishiwaki , Masayuki Inaba , Hirochika Inoue, Dynamically-Stable Motion Planning for Humanoid Robots, Autonomous Robots, v.12 n.1, p.105-118, January 2002 [doi>10.1023/A:1013219111657]
• 20: James Joseph Kuffner, Jr. , Jean-Claude Latombe, Autonomous agents for real-time animation, 2000
• 21: Jean-Claude Latombe, Robot Motion Planning, Kluwer Academic Publishers, Norwell, MA, 1991
• 22: LAVALLE, S., AND KUFFNER, J. 2001. Randomized kinodynamic planning. Int'l Journal of Robotics Research 20, 5, 378--400.
• 23: Jehee Lee , Jinxiang Chai , Paul S. A. Reitsma , Jessica K. Hodgins , Nancy S. Pollard, Interactive control of avatars animated with human motion data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 24: Sooha Park Lee , Jeremy B. Badler , Norman I. Badler, Eyes alive, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 25: Ying Liu , Norman I. Badler, Real-Time Reach Planning for Animated Characters Using Hardware Acceleration, Proceedings of the 16th International Conference on Computer Animation and Social Agents (CASA 2003), p.86, May 08-09, 2003
• 26: P. Morasso , V. Tagliasco, Human Movement Understanding: From Computational Geometry to Artificial Intelligence, Elsevier Science Inc., New York, NY, 1986
• 27: NAKAMURA, Y., AND HANAFUSA, H. 1986. Inverse Kinematics Solutions with Singularity Robustness for Robot Manipulator Control. J. Dynamic Sys., Meas., and Control 108, 163--171.
• 28: PARK, W., CHAFFIN, D., AND MARTIN, B. 2002. Modifying motions for avoiding obstacles. SAE Transactions 110, 6, 2250--2256.
• 29: Julien Pettré , Jean-Paul Laumond , Thierry Siméon, A 2-stages locomotion planner for digital actors, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 30: Charles Rose , Brian Guenter , Bobby Bodenheimer , Michael F. Cohen, Efficient generation of motion transitions using spacetime constraints, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.147-154, August 1996 [doi>10.1145/237170.237229]
• 31: Charles Rose , Michael F. Cohen , Bobby Bodenheimer, Verbs and Adverbs: Multidimensional Motion Interpolation, IEEE Computer Graphics and Applications, v.18 n.5, p.32-40, September 1998 [doi>10.1109/38.708559]
• 32: ROSE, C. F., SLOAN, P.-P. J., AND COHEN, M. F. 2001. Artist-directed inverse-kinematics using radial basis function interpolation. Computer Graphics Forum 20, 3, 239--250.
• 33: Ken Shoemake, Animating rotation with quaternion curves, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.245-254, July 1985
• 34: SIMEON, T., CORTES, J., SAHBANI, A., AND LAUMOND, J. P. 2002. A manipulation planner for pick and place operations under continous grasps and placements. In Proc. Int'l Conf. on Robotics and Automation, 2022--2027.
• 35: Douglas J. Wiley , James K. Hahn, Interpolation Synthesis of Articulated Figure Motion, IEEE Computer Graphics and Applications, v.17 n.6, p.39-45, November 1997 [doi>10.1109/38.626968]
• 36: YAMANE, K., AND NAKAMURA, Y. 2003. Natural Motion Animation through Constraining and Deconstraining at Will. IEEE Trans. on Visualization and Computer Graphics 9, 3, 352--360.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Keywords:
human figure animation, motion capture, path planning, two-hand manipulation