EigenSkin: real time large deformation character skinning in hardware

ABSTRACT

We present a technique which allows subtle nonlinear quasi-static deformations of articulated characters to be compactly approximated by data-dependent eigenbases which are optimized for real time rendering on commodity graphics hardware. The method extends the common Skeletal-Subspace Deformation (SSD) technique to provide efficient approximations of the complex deformation behaviours exhibited in simulated, measured, and artist-drawn characters. Instead of storing displacements for key poses (which may be numerous), we precompute principal components of the deformation influences for individual kinematic joints, and so construct error-optimal eigenbases describing each joint's deformation subspace. Pose-dependent deformations are then expressed in terms of these reduced eigenbases, allowing precomputed coefficients of the eigenbasis to be interpolated at run time. Vertex program hardware can then efficiently render nonlinear skin deformations using a small number of eigendisplacements stored in graphics hardware. We refer to the final resulting character skinning construct as the model's EigenSkin. Animation results are presented for a very large nonlinear finite element model of a human hand rendered in real time at minimal cost to the main CPU.

REFERENCES

• 1: Brett Allen , Brian Curless , Zoran Popović, Articulated body deformation from range scan data, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 2: Volker Blanz , Thomas Vetter, A morphable model for the synthesis of 3D faces, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.187-194, July 1999 [doi>10.1145/311535.311556]
• 3: F. L. Bookstein, Principal Warps: Thin-Plate Splines and the Decomposition of Deformations, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.11 n.6, p.567-585, June 1989 [doi>10.1109/34.24792]
• 4: CANI-GASCUEL, M.-P. 1998. Layered Deformable Models with Implicit Surfaces. In Graphics Interface, 201-208.
• 5: David T. Chen , David Zeltzer, Pump it up: computer animation of a biomechanically based model of muscle using the finite element method, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.89-98, July 1992
• 6: Stéphane Cotin , Hervé Delingette , Nicholas Ayache, Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation, IEEE Transactions on Visualization and Computer Graphics, v.5 n.1, p.62-73, January 1999 [doi>10.1109/2945.764872]
• 7: CURIOUS LABS INC. Poser 4, Santa Cruz, CA., http://www.curiouslabs.com/products/poser4.
• 8: Gilles Debunne , Mathieu Desbrun , Marie-Paule Cani , Alan H. Barr, Dynamic real-time deformations using space & time adaptive sampling, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.31-36, August 2001 [doi>10.1145/383259.383262]
• 9: DHONDT, G., AND WITTIG, K. CalculiX: A Free Software Three-Dimensional Structural Finite Element Program, http://www.calculix.de.
• 10: Gene H. Golub , Charles F. Van Loan, Matrix computations (3rd ed.), Johns Hopkins University Press, Baltimore, MD, 1996
• 11: J.-P. Gourret , N. M. Thalmann , D. Thalmann, Simulation of object and human skin formations in a grasping task, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.21-30, July 1989
• 12: HERMAN, D. L. 2001. Using Precomputed Cloth Simulations for Interactive Applications. In SIGGRAPH 2001 Conference Abstracts and Applications, Addison Wesley, Annual Conference Series, ACM SIGGRAPH.
• 13: HYVARINEN, A., OJA, E., AND KARHUNEN, J. 2001. Independent Component Analysis. Wiley, Johns and Sons, Inc.
• 14: IMMERSION CORPORATION. CyberGlove, http://www.immersion.com.
• 15: Doug L. James , Dinesh K. Pai, ArtDefo: accurate real time deformable objects, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.65-72, July 1999 [doi>10.1145/311535.311542]
• 16: Doug L. James , Dinesh K. Pai, DyRT: dynamic response textures for real time deformation simulation with graphics hardware, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 17: JAMES, D. L., AND PAI, D. K. 2002. Real time simulation of elastokinematic models. In ICRA2002: IEEE International Conference on Robotics and Automation.
• 18: JOLLIFFE, I. 1986. Principal Component Analysis. Springer Verlag.
• 19: Yuencheng Lee , Demetri Terzopoulos , Keith Walters, Realistic modeling for facial animation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.55-62, September 1995 [doi>10.1145/218380.218407]
• 20: J. P. Lewis , Matt Cordner , Nickson Fong, Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.165-172, July 2000 [doi>10.1145/344779.344862]
• 21: Erik Lindholm , Mark J. Kligard , Henry Moreton, A user-programmable vertex engine, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.149-158, August 2001 [doi>10.1145/383259.383274]
• 22: LOOP, C. 1987. Smooth Subdivision Surfaces Based on Triangles. Master's thesis, University of Utah, Department of Mathematics.
• 23: George Maestri, Digital Character Animation 2: Essential Techniques, Pearson Education, 1999
• 24: Nadia Magnenat-Thalmann , Daniel Thalmann, Human body deformations using joint-dependent local operators and finite-element theory, Making them move: mechanics, control, and animation of articulated figures, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1991
• 25: N. Magnenat-Thalmann , R. Laperrière , D. Thalmann, Joint-dependent local deformations for hand animation and object grasping, Proceedings on Graphics interface '88, p.26-33, December 1989, Edmonton, Alberta, Canada
• 26: Dimitri Metaxas , Demetri Terzopoulos, Dynamic deformation of solid primitives with constraints, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.309-312, July 1992
• 27: James F. O'Brien , Jessica K. Hodgins, Graphical modeling and animation of brittle fracture, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.137-146, July 1999 [doi>10.1145/311535.311550]
• 28: Dinesh K. Pai , Kees van den Doel , Doug L. James , Jochen Lang , John E. Lloyd , Joshua L. Richmond , Som H. Yau, Scanning physical interaction behavior of 3D objects, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.87-96, August 2001 [doi>10.1145/383259.383268]
• 29: Frederic I. Parke , Keith Waters, Computer facial animation, A. K. Peters, Ltd., Natick, MA, 1996
• 30: A. Pentland , J. Williams, Good vibrations: model dynamics for graphics and animation, ACM SIGGRAPH Computer Graphics, v.23 n.3, p.207-214, July 1989
• 31: PICINBONO, G., DELINGETTE, H., AND AYACHE, N. 2001. Non-linear and anisotropic elastic soft tissue models for medical simulation. In ICRA2001: IEEE International Conference on Robotics and Automation.
• 32: M. J. D. Powell, Radial basis functions for multivariable interpolation: a review, Algorithms for approximation, Clarendon Press, New York, NY, 1987
• 33: Ferdi Scheepers , Richard E. Parent , Wayne E. Carlson , Stephen F. May, Anatomy-based modeling of the human musculature, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.163-172, August 1997 [doi>10.1145/258734.258827]
• 34: SCHOBERL, J. 1997. NETGEN - An advancing front 2D/3D-mesh generator based on abstract rules. Comput.Visual.Sci 1, 41-52.
• 35: SINGH, K., AND KOKKEVIS, E. 2000. Skinning Characters using Surface-Oriented Free-Form Deformations. In Graphics Interface 2000, 35-42.
• 36: Peter-Pike J. Sloan , Charles F. Rose, III , Michael F. Cohen, Shape by example, Proceedings of the 2001 symposium on Interactive 3D graphics, p.135-143, March 2001 [doi>10.1145/364338.364382]
• 37: TERZOPOULOS, D., AND FLEISCHER, K. 1988. Deformable Models. The Visual Computer 4, 306-331.
• 38: Demetri Terzopoulos , Andrew Witkin, Physically Based Models with Rigid and Deformable Components, IEEE Computer Graphics and Applications, v.8 n.6, p.41-51, November 1988 [doi>10.1109/38.20317]
• 39: TURK, M., AND PENTLAND, A. 1991. Eigen faces for recognition. Jrnl. Cognitive Neuroscience 3, 71-86.
• 40: Jane Wilhelms , Allen Van Gelder, Anatomically based modeling, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.173-180, August 1997 [doi>10.1145/258734.258833]
• 41: ZHUANG, Y., AND CANNY, J. 1999. Real-time Simulation of Physically Realistic Global Deformation. In IEEE Vis'99 Late Breaking Hot Topics.
• 42: ZIENKIEWICZ, O. C. 1977. The Finite Element Method. McGraw-Hill Book Company (UK) Limited, Maidenhead, Berkshire, England.

INDEX TERMS

Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Keywords:
hardware rendering, pose-space deformation, principal component analysis, skeletal-subspace deformation