Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation

ABSTRACT

Pose space deformation generalizes and improves upon both shape interpolation and common skeleton-driven deformation techniques. This deformation approach proceeds from the observation that several types of deformation can be uniformly represented as mappings from a pose space, defined by either an underlying skeleton or a more abstract system of parameters, to displacements in the object local coordinate frames. Once this uniform representation is identified, previously disparate deformation types can be accomplished within a single unified approach. The advantages of this algorithm include improved expressive power and direct manipulation of the desired shapes yet the performance associated with traditional shape interpolation is achievable. Appropriate applications include animation of facial and body deformation for entertainment, telepresence, computer gaming, and other applications where direct sculpting of deformations is desired or where real-time synthesis of a deforming model is required.

REFERENCES

• 1: R. Barnhill, R. Dube, and F. Little, Properties of Shepard's Surfaces. Rocky Mountain J. Math., vol.13, 1983, pp. 365-382.
• 2: Thaddeus Beier , Shawn Neely, Feature-based image metamorphosis, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.35-42, July 1992
• 3: R Bergeron and R Lachapelle, Controlling Facial Expression and Body Movements in the Computer Generated Short 'Tony de Peltrie'. SIGGRAPtt 85 Tutorial Notes, ACM, 1985.
• 4: Christopher M. Bishop, Neural networks for pattern recognition, Oxford University Press, Oxford, 1996
• 5: Andrew Blake , Andrew Zisserman, Visual reconstruction, MIT Press, Cambridge, MA, 1987
• 6: N. Burtnyk , M. Wein, Interactive skeleton techniques for enhancing motion dynamics in key frame animation, Communications of the ACM, v.19 n.10, p.564-569, Oct. 1976 [doi>10.1145/360349.360357]
• 7: J. E. Chadwick , D. R. Haumann , R. E. Parent, Layered construction for deformable animated characters, ACM SIGGRAPH Computer Graphics, v.23 n.3, p.243-252, July 1989
• 8: David T. Chen , David Zeltzer, Pump it up: computer animation of a biomechanically based model of muscle using the finite element method, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.89-98, July 1992
• 9: Cinefex, Riverside, CA, various issues, e.g. vol. 66 (June 1996), p. 52 (Dragonheart); vol. 64 (Dec 1995), p. 62 (Jumanji).
• 10: Tony DeRose , Michael Kass , Tien Truong, Subdivision surfaces in character animation, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.85-94, July 1998 [doi>10.1145/280814.280826]
• 11: D. Forsey, A Surface Model for Skeleton-Based Character Animation. In Second Eurographics Workshop on Animation and Simulation, Vienna, Austria, 1991, pp. 55-73.
• 12: William M. Hsu , John F. Hughes , Henry Kaufman, Direct manipulation of free-form deformations, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.177-184, July 1992
• 13: K. Komatsu, "Human Skin Model Capable of Natural Shape Variation," The Visual Computer, vol. 4, no. 3, 1988, pp. 265-271.
• 14: J. R Lewis, Creation by Refinement: A Creativity Paradigm for Gradient Descent Learning Networks. International Conf. on Neural Networks'. San Diego, 1988, Ih 229-233.
• 15: J.P. Lewis, Probing the Critic: Approaches to Connectionist Pattern Synthesis. IEEE International Joint Conference on Neural Networks' Seattle, July 1991.
• 16: Peter Litwinowicz , Lance Williams, Animating images with drawings, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.409-412, July 1994 [doi>10.1145/192161.192270]
• 17: Ron MacCracken , Kenneth I. Joy, Free-form deformations with lattices of arbitrary topology, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.181-188, August 1996 [doi>10.1145/237170.237247]
• 18: George Maestri, Digital Character Animation 2: Essential Techniques, Pearson Education, 1999
• 19: L. Nedel and D. Thalmann, Modeling and Deformation of the Human Body Using an Anatomically-Based Approach, www preprint.
• 20: C.W.A.M. van Overveld, A Technique for Motion Specification in Computer Animation, Visual Computer, vol. 6 (1990), p. 106-116.
• 21: Tomaso Poggio , Roberto Brunelli, A Novel Approach to Graphics, Massachusetts Institute of Technology, Cambridge, MA, 1992
• 22: Karan Singh , Eugene Fiume, Wires: a geometric deformation technique, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.405-414, July 1998 [doi>10.1145/280814.280946]
• 23: N. Magnenat-Thalmann , R. Laperrière , D. Thalmann, Joint-dependent local deformations for hand animation and object grasping, Proceedings on Graphics interface '88, p.26-33, December 1989, Edmonton, Alberta, Canada
• 24: Nadia Magnenat-Thalmann , Daniel Thalmann, Human body deformations using joint-dependent local operators and finite-element theory, Making them move: mechanics, control, and animation of articulated figures, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1991
• 25: Maya Alias/Wavefront, Santa Barbara, CA, 1998.
• 26: F. h Parke, Parameterized Models for Facial Animation. IEEE Computer Graphics and Applications, vol. 2, no. 9, November 1982, pp. 61-68.
• 27: S. Pieper, Physically-Based Animation of Facial Tissue for Surgical Simulation, SIGGRAPH 89 Tutorial Notes: State of the Art in FaciaI Animation, ACM, 1989.
• 28: J.D. Powell, The Theory of Radial Basis Function Approximation. Cambridge University Numerical Analysis Report, 1990.
• 29: M. J. D. Powell, Radial basis functions for multivariable interpolation: a review, Algorithms for approximation, Clarendon Press, New York, NY, 1987
• 30: J.A. Russel, A Circomplex Model of Affect. J. Personality and Social Psychology, vol. 39, p. 1161-1178, 1980.
• 31: Ferdi Scheepers , Richard E. Parent , Wayne E. Carlson , Stephen F. May, Anatomy-based modeling of the human musculature, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.163-172, August 1997 [doi>10.1145/258734.258827]
• 32: Thomas W. Sederberg , Scott R. Parry, Free-form deformation of solid geometric models, ACM SIGGRAPH Computer Graphics, v.20 n.4, p.151-160, Aug. 1986
• 33: B. Shneiderman, The Future of Interactive Systems and the Emergence of Direct Manipulation. Behaviour and Information Technology, 1, pp. 237-356.
• 34: Pat Taylor, Disney/Dream Quest Mighty Joe Young facial animation, personal communication.
• 35: R. Turner and D. Thalmann, The Elastic Surface Layer Model for Animated Character Construction. in N. M. Thalmann and D. Thalmann, eds., P~vc. Computer Graphis International, New York: Springer Verlag, 1993, pp. 399-412.
• 36: Jane Wilhelms , Allen Van Gelder, Anatomically based modeling, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.173-180, August 1997 [doi>10.1145/258734.258833]
• 37: G. Wyvill, C. McPheeters, and B. Wyvill, Animating Soft Objects. Visual Compute~, 2, 235-242, 1986.
• 38: Xinmin Zhao, Disney Dinosaur project, personal communication.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Curve, surface, solid, and object representations

Additional Classification:
  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
      G.1.1 Interpolation
          Subjects: Interpolation formulas

  H. Information Systems
  H.1 MODELS AND PRINCIPLES

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

General Terms:
Algorithms, Design, Measurement, Performance, Theory

Keywords:
animation, applications, deformation, facial animation, morphing