Example-based dynamic skinning in real time

ABSTRACT

In this paper we present an approach to enrich skeleton-driven animations with physically-based secondary deformation in real time. To achieve this goal, we propose a novel, surface-based deformable model that can interactively emulate the dynamics of both low-and high-frequency volumetric effects. Given a surface mesh and a few sample sequences of its physical behavior, a set of motion parameters of the material are learned during an off-line preprocessing step. The deformable model is then applicable to any given skeleton-driven animation of the surface mesh. Additionally, our dynamic skinning technique can be entirely implemented on GPUs and executed with great efficiency. Thus, with minimal changes to the conventional graphics pipeline, our approach can drastically enhance the visual experience of skeleton-driven animations by adding secondary deformation in real time.

REFERENCES

• 1: Pierre Alliez , David Cohen-Steiner , Mariette Yvinec , Mathieu Desbrun, Variational tetrahedral meshing, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 2: Avriel, M. 2003. Nonlinear programming: Analysis and Methods. Dover Publications.
• 3: Miklós Bergou , Saurabh Mathur , Max Wardetzky , Eitan Grinspun, TRACKS: toward directable thin shells, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 4: Kiran S. Bhat , Christopher D. Twigg , Jessica K. Hodgins , Pradeep K. Khosla , Zoran Popović , Steven M. Seitz, Estimating cloth simulation parameters from video, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 5: Bianchi, G., Solenthaler, B., Székely, G., and Harders, M. 2004. Simultaneous topology and stiffness identification for mass-spring models based on fem reference deformations. In MICCAI (2), 293--301.
• 6: Bourguignon, D., and Cani, M.-P. 2000. Controlling anisotropy in mass-spring systems. In Proceedings of Computer Animation and Simulation'00, 113--123.
• 7: Steve Capell , Seth Green , Brian Curless , Tom Duchamp , Zoran Popović, Interactive skeleton-driven dynamic deformations, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 8: Dempster, A. P., Laird, N. M., and Rubin, D. B. 1977. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological) 39, 1, 1--38.
• 9: Sunil Hadap , Vangelis Kokkevis, Introduction to articulated rigid body dynamics: Copyright restrictions prevent ACM from providing the full text for this work., ACM SIGGRAPH 2005 Courses, July 31-August 04, 2005, Los Angeles, California [doi>10.1145/1198555.1198559]
• 10: Haralick, R., Joo, H., Lee, C., Zhuang, X., Vaidya, V., and Kim, M. 1989. Pose estimation from corresponding point data. IEEE Transactions on Systems, Man and Cybernetics 19, 6, 1426--1446.
• 11: Hauser, K. K., Shen, C., and O'Brien, J. F. 2003. Interactive deformation using modal analysis with constraints. In Graphics Interface, 247--256.
• 12: Doug L. James , Dinesh K. Pai, ArtDefo: accurate real time deformable objects, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.65-72, July 1999 [doi>10.1145/311535.311542]
• 13: Doug L. James , Dinesh K. Pai, DyRT: dynamic response textures for real time deformation simulation with graphics hardware, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 14: James, D. L., and Pai, D. K. 2002. Real time simulation of multizone elastokinematic models. Proceedings of ICRA'02 1, 927--932.
• 15: Caroline Larboulette , Marie-Paule Cani , Bruno Arnaldi, Dynamic skinning: adding real-time dynamic effects to an existing character animation, Proceedings of the 21st spring conference on Computer graphics, May 12-14, 2005, Budmerice, Slovakia [doi>10.1145/1090122.1090138]
• 16: Lee, M. 2006. Seven ways to skin a mesh: Character skinning revisited for modern gpus. In Proceedings of GameFest, Microsoft Game Technology Conference.
• 17: J. P. Lewis , Matt Cordner , Nickson Fong, Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.165-172, July 2000 [doi>10.1145/344779.344862]
• 18: Erik Lindholm , Mark J. Kligard , Henry Moreton, A user-programmable vertex engine, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.149-158, August 2001 [doi>10.1145/383259.383274]
• 19: N. Magnenat-Thalmann , R. Laperrière , D. Thalmann, Joint-dependent local deformations for hand animation and object grasping, Proceedings on Graphics interface '88, p.26-33, December 1989, Edmonton, Alberta, Canada
• 20: Antoine McNamara , Adrien Treuille , Zoran Popović , Jos Stam, Fluid control using the adjoint method, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 21: Alex Mohr , Michael Gleicher, Building efficient, accurate character skins from examples, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 22: Molino, N., Bridson, R., Teran, J., and Fedkiw, R. 2003. A crystalline, red green strategy for meshing highly deformable objects with tetrahedra. In IMR, 103--114.
• 23: Matthias Müller , Markus Gross, Interactive virtual materials, Proceedings of Graphics Interface 2004, p.239-246, May 17-19, 2004, London, Ontario, Canada
• 24: Matthias Müller , Bruno Heidelberger , Matthias Teschner , Markus Gross, Meshless deformations based on shape matching, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 25: NVIDIA, 2007. CUDA homepage. http://developer.nvidia.com/object/cuda.html.
• 26: James F. O'Brien , Victor Brian Zordan , Jessica K. Hodgins, Combining Active and Passive Simulations for Secondary Motion, IEEE Computer Graphics and Applications, v.20 n.4, p.86-96, July 2000 [doi>10.1109/38.851756]
• 27: Sang Il Park , Jessica K. Hodgins, Capturing and animating skin deformation in human motion, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 28: A. Pentland , J. Williams, Good vibrations: modal dynamics for graphics and animation, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.215-222, July 1989
• 29: Alec R. Rivers , Doug L. James, FastLSM: fast lattice shape matching for robust real-time deformation, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 30: Peter Sand , Leonard McMillan , Jovan Popović, Continuous capture of skin deformation, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 31: Xiaohan Shi , Kun Zhou , Yiying Tong , Mathieu Desbrun , Hujun Bao , Baining Guo, Mesh puppetry: cascading optimization of mesh deformation with inverse kinematics, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 32: Robert W. Sumner , Matthias Zwicker , Craig Gotsman , Jovan Popović, Mesh-based inverse kinematics, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 33: Matthias Teschner , Bruno Heidelberger , Matthias Muller , Markus Gross, A Versatile and Robust Model for Geometrically Complex Deformable Solids, Proceedings of the Computer Graphics International, p.312-319, June 16-19, 2004 [doi>10.1109/CGI.2004.6]
• 34: Wolfram von Funck , Holger Theisel , Hans-Peter Seidel, Elastic secondary deformations by vector field integration, Proceedings of the fifth Eurographics symposium on Geometry processing, July 04-06, 2007, Barcelona, Spain
• 35: Robert Y. Wang , Kari Pulli , Jovan Popović, Real-time enveloping with rotational regression, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 36: Jane Wilhelms, MODELING ANIMALS WITH BONES, MUSCLES, AND SKIN, University of California at Santa Cruz, Santa Cruz, CA, 1995

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Additional Classification:
  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems
          Subjects: Geometrical problems and computations

  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
      G.1.8 Partial Differential Equations
          Subjects: Finite element methods

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Curve, surface, solid, and object representations; Physically based modeling

General Terms:
Algorithms, Design, Measurement

Keywords:
finite element method, physically-based animation, secondary motion, skeleton-driven mesh deformation