Motion modeling for on-line locomotion synthesis

ABSTRACT

In this paper, we propose an example-based approach to on-line locomotion synthesis. Our approach consists of two parts: motion analysis and motion synthesis. In the motion analysis part, an unlabeled motion sequence is first decomposed into motion segments, exploiting the behavior of the COM (center of mass) trajectory of the performer. Those motion segments are subsequently classified into groups of motion segments such that the same group of motion segments share an identical footstep pattern. Finally, we construct a hierarchical motion transition graph by representing these groups and their connectivity to other groups as nodes and edges, respectively. The coarse level of this graph models locomotive motions and their transitions, and the fine level mainly captures the cyclic nature of locomotive motions. In the motion synthesis part, given a stream of motion specifications in an on-line manner, the motion transition graph is traversed while blending the motion segments to synthesize a motion at a node, one by one, guided by the motion specifications. Our main contributions are the motion labeling scheme and a new motion model, embodied by the hierarchical motion transition graph, which together enable not only artifact-free motion blending but also seamless motion transition.

REFERENCES

• 1: Brett Allen , Brian Curless , Zoran Popović, Articulated body deformation from range scan data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 2: Okan Arikan , D. A. Forsyth, Interactive motion generation from examples, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 3: Okan Arikan , David A. Forsyth , James F. O'Brien, Motion synthesis from annotations, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 4: Sunil Arya , David M. Mount , Nathan S. Netanyahu , Ruth Silverman , Angela Wu, An optimal algorithm for approximate nearest neighbor searching, Proceedings of the fifth annual ACM-SIAM symposium on Discrete algorithms, p.573-582, January 23-25, 1994, Arlington, Virginia, United States
• 5: Rama Bindiganavale , Norman I. Badler, Motion Abstraction and Mapping with Spatial Constraints, Proceedings of the International Workshop on Modelling and Motion Capture Techniques for Virtual Environments, p.70-82, January 1998
• 6: Jernej Barbič , Alla Safonova , Jia-Yu Pan , Christos Faloutsos , Jessica K. Hodgins , Nancy S. Pollard, Segmenting motion capture data into distinct behaviors, Proceedings of the 2004 conference on Graphics interface, p.185-194, May 17-19, 2004, London, Ontario, Canada
• 7: Ajo Fod , Maja J. Matarić , Odest Chadwicke Jenkins, Automated Derivation of Primitives for Movement Classification, Autonomous Robots, v.12 n.1, p.39-54, January 2002 [doi>10.1023/A:1013254724861]
• 8: Aphrodite Galata , Neil Johnson , David Hogg, Learning variable-length Markov models of behavior, Computer Vision and Image Understanding, v.81 n.3, p.398-413, March 2001 [doi>10.1006/cviu.2000.0894]
• 9: Shang Guo , James Robergé, A high-level control mechanism for human locomotion based on parametric frame space interpolation, Proceedings of the Eurographics workshop on Computer animation and simulation '96, p.95-107, December 1996, Poitiers, France
• 10: Michael Gleicher , Hyun Joon Shin , Lucas Kovar , Andrew Jepsen, Snap-together motion: assembling run-time animations, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 11: Odest Chadwicke Jenkins , Maja J. Mataric, Automated derivation of behavior vocabularies for autonomous humanoid motion, Proceedings of the second international joint conference on Autonomous agents and multiagent systems, July 14-18, 2003, Melbourne, Australia [doi>10.1145/860575.860612]
• 12: Lucas Kovar , Michael Gleicher, Flexible automatic motion blending with registration curves, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 13: {KG04} Kovar L., Gleicher M.: Automated extraction and parameterization motions in large data sets. vol. 23, pp. 559--568.
• 14: Lucas Kovar , Michael Gleicher , Frédéric Pighin, Motion graphs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 15: Lucas Kovar , John Schreiner , Michael Gleicher, Footskate cleanup for motion capture editing, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545277]
• 16: Tae-hoon Kim , Sang Il Park , Sung Yong Shin, Rhythmic-motion synthesis based on motion-beat analysis, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 17: Jehee Lee , Jinxiang Chai , Paul S. A. Reitsma , Jessica K. Hodgins , Nancy S. Pollard, Interactive control of avatars animated with human motion data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 18: C. Karen Liu , Zoran Popović, Synthesis of complex dynamic character motion from simple animations, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 19: Yan Li , Tianshu Wang , Heung-Yeung Shum, Motion texture: a two-level statistical model for character motion synthesis, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 20: Katherine Pullen , Christoph Bregler, Motion capture assisted animation: texturing and synthesis, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 21: {Per92} Perry J.: Gait analysis: Normal and Pathological Function. Delmar Learning, 1992.
• 22: Sang Il Park , Hyun Joon Shin , Sung Yong Shin, On-line locomotion generation based on motion blending, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545279]
• 23: Sang Il Park , Hyun Joon Shin , Tae Hoon Kim , Sung Yong Shin, On-line motion blending for real-time locomotion generation: Research Articles, Computer Animation and Virtual Worlds, v.15 n.3-4, p.125-138, July 2004 [doi>10.1002/cav.v15:3/4]
• 24: Charles Rose , Michael F. Cohen , Bobby Bodenheimer, Verbs and Adverbs: Multidimensional Motion Interpolation, IEEE Computer Graphics and Applications, v.18 n.5, p.32-40, September 1998 [doi>10.1109/38.708559]
• 25: Hyun Joon Shin , Jehee Lee , Sung Yong Shin , Michael Gleicher, Computer puppetry: An importance-based approach, ACM Transactions on Graphics (TOG), v.20 n.2, p.67-94, April 2001 [doi>10.1145/502122.502123]
• 26: Adnan Sulejmanpašić , Jovan Popović, Adaptation of performed ballistic motion, ACM Transactions on Graphics (TOG), v.24 n.1, p.165-179, January 2005 [doi>10.1145/1037957.1037966]
• 27: Peter-Pike J. Sloan , Charles F. Rose, III , Michael F. Cohen, Shape by example, Proceedings of the 2001 symposium on Interactive 3D graphics, p.135-143, March 2001 [doi>10.1145/364338.364382]
• 28: L. M. Tanco , A. Hilton, Realistic synthesis of novel human movements from a database of motion capture examples, Proceedings of the Workshop on Human Motion (HUMO'00), p.137, December 07-08, 2000
• 29: Douglas J. Wiley , James K. Hahn, Interpolation Synthesis of Articulated Figure Motion, IEEE Computer Graphics and Applications, v.17 n.6, p.39-45, November 1997 [doi>10.1109/38.626968]
• 30: {Win90} Winter D. A.: Biomechanics and Motor Control of Human Movement. John Wiley and Sons Inc, 1990.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism