MotionMaster: authoring and choreographing Kung-fu motions by sketch drawings

ABSTRACT

Sketch-drawings is an intuitive and comprehensive means of conveying movement ideas in character animation. We proposed a novel sketch-based approach to assisting the authoring and choreographing of Kungfu motions at the early stage of animation creation. Given two human figure sketches corresponding to the initial and closing posture of a Kungfu form, and the trajectory drawings on specific moving joints, MotionMaster can directly rapid-prototype the realistic 3D motion sequence by sketch-based motion retrieval and refinement based on a motion database. The animators can then preview and evaluate the recovered motion sequence from any viewing angles. After the 3D motion sequence has been associated with the 2D sketch drawing, the animator can also interactively and iteratively make changes on the 2D sketch drawing, and the system will automatically transfer the 2D changes to the 3D motion data of current interests. It greatly helps the animator focus on the movement idea development during the evolutionary process of building motion data for articulated characters.

REFERENCES

• 1: Maxine D. Brown , Stephen W. Smoliar, A graphics editor for labanotation, Proceedings of the 3rd annual conference on Computer graphics and interactive techniques, p.60-65, July 14-16, 1976, Philadelphia, Pennsylvania
• 2: Tom W. Calvert , Armin Bruderlin , Sang Mah , Thecla Schiphorst , Chris Welman, The evolution of an interface for choreographers, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.115-122, May 1993, Amsterdam, The Netherlands
• 3: Shih-Pin Chao , Chih-Yi Chiu , Shi-Nine Yang , Tsang-Gang Lin, Tai Chi synthesizer: a motion synthesis framework based on key-postures and motion instructions: Research Articles, Computer Animation and Virtual Worlds, v.15 n.3-4, p.259-268, July 2004 [doi>10.1002/cav.v15:3/4]
• 4: {CKB04} Chaudhuri P., Kalra P., Banerjee S.: A system for view-dependent animation. Computer Graphics Forum 23, 3 (2004), C411--C419.
• 5: Lei Chen , M. Tamer Özsu , Vincent Oria, Robust and fast similarity search for moving object trajectories, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland [doi>10.1145/1066157.1066213]
• 6: {CWW*04} Chiu C. Y., Wu M. Y., Wu Y. C., Wu C. C., Yang S. N.: Retrieval and constraint-based human posture reconstruction from a single image. In Workshop on Modelling and Motion Capture Techniques for Virtual Environments (2004).
• 7: James Davis , Maneesh Agrawala , Erika Chuang , Zoran Popović , David Salesin, A sketching interface for articulated figure animation, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 8: {DCR01} Difranco D., Cham T.-J., Rehg J.: Reconstruction of 3d figure motion from 2d correspondences. In IEEE Proceedings of Computer Vision and Pattern Recognition (2001), pp. 1-307--1-314.
• 9: D. M. Gavrila, The visual analysis of human movement: a survey, Computer Vision and Image Understanding, v.73 n.1, p.82-98, Jan. 1999 [doi>10.1006/cviu.1998.0716]
• 10: {GY03} Geng W., Yu G.: Reuse of motion capture data in animation: a review. In Lecture notes in computer science 2669 (2003), pp. 620--629.
• 11: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 12: {JM04} Jin Y., Mokhtarian F.: Efficient video retrieval by motion trajectory. In Proceedings of British Machine Vision Conference (2004), pp. 667--676.
• 13: {LC85} Lee H.-J., Chen Z.: Determination of 3d human body postures from a single view. Computer Vision, Graphics, and Image Processing 30 (1985), 148--169.
• 14: Thomas B. Moeslund , Erik Granum, A survey of computer vision-based human motion capture, Computer Vision and Image Understanding, v.81 n.3, p.231-268, March 2001 [doi>10.1006/cviu.2000.0897]
• 15: {Osh04} Oshita M.: Pen-to-mime: A pen-based interface for interactive control of a human figure. In EUROGRAPHICS workshop on sketch-based interfaces and modeling (2004), pp. 43--52.
• 16: Paul Rademacher, View-dependent geometry, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.439-446, July 1999 [doi>10.1145/311535.311612]
• 17: {RSR01} Rosales R., Siddiqui M., Rehg J.: Estimating 3d body pose using uncalibrated cameras. In IEEE Proceedings of Computer Vision and Pattern Recognition (2001), pp. 821--827.
• 18: {SAB91} Sabiston W. R.: Extracting 3d motion from hand-drawn animated figures. In Master Thesis OF Massachusetts Institute of Technology (1991).
• 19: T. Schiphorst , T. Calvert , C. Lee , C. Welman , S. Gaudet, Tools for interaction with the creative process of composition, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.167-174, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97270]
• 20: Camillo J. Taylor, Reconstruction of articulated objects from point correspondences in a single uncalibrated image, Computer Vision and Image Understanding, v.80 n.3, p.349-363, Dec. 2000 [doi>10.1006/cviu.2000.0878]
• 21: Matthew Thorne , David Burke , Michiel van de Panne, Motion doodles: an interface for sketching character motion, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 22: Dimitrios Gunopoulos, Discovering Similar Multidimensional Trajectories, Proceedings of the 18th International Conference on Data Engineering, p.673, February 26-March 01, 2002
• 23: Katsu Yamane , James J. Kuffner , Jessica K. Hodgins, Synthesizing animations of human manipulation tasks, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism