Real-time data driven deformation using kernel canonical correlation analysis

ABSTRACT

Achieving intuitive control of animated surface deformation while observing a specific style is an important but challenging task in computer graphics. Solutions to this task can find many applications in data-driven skin animation, computer puppetry, and computer games. In this paper, we present an intuitive and powerful animation interface to simultaneously control the deformation of a large number of local regions on a deformable surface with a minimal number of control points. Our method learns suitable deformation subspaces from training examples, and generate new deformations on the fly according to the movements of the control points. Our contributions include a novel deformation regression method based on kernel Canonical Correlation Analysis (CCA) and a Poisson-based translation solving technique for easy and fast deformation control based on examples. Our run-time algorithm can be implemented on GPUs and can achieve a few hundred frames per second even for large datasets with hundreds of training examples.

REFERENCES

• 1: Dragomir Anguelov , Praveen Srinivasan , Daphne Koller , Sebastian Thrun , Jim Rodgers , James Davis, SCAPE: shape completion and animation of people, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 2: Jinxiang Chai , Jessica K. Hodgins, Performance animation from low-dimensional control signals, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 3: Zhigang Deng , Pei-Ying Chiang , Pamela Fox , Ulrich Neumann, Animating blendshape faces by cross-mapping motion capture data, Proceedings of the 2006 symposium on Interactive 3D graphics and games, March 14-17, 2006, Redwood City, California [doi>10.1145/1111411.1111419]
• 4: Kevin G. Der , Robert W. Sumner , Jovan Popović, Inverse kinematics for reduced deformable models, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 5: Mira Dontcheva , Gary Yngve , Zoran Popović, Layered acting for character animation, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 6: Keith Grochow , Steven L. Martin , Aaron Hertzmann , Zoran Popović, Style-based inverse kinematics, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 7: Hotelling, H. 1936. Relations between two sets of variates. Biometrika 28, 321--377.
• 8: Doug L. James , Christopher D. Twigg, Skinning mesh animations, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 9: Pushkar Joshi , Wen C. Tien , Mathieu Desbrun , Frédéric Pighin, Learning controls for blend shape based realistic facial animation, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 10: Ladislav Kavan , Steven Collins , Jiří Žára , Carol O'Sullivan, Skinning with dual quaternions, Proceedings of the 2007 symposium on Interactive 3D graphics and games, April 30-May 02, 2007, Seattle, Washington [doi>10.1145/1230100.1230107]
• 11: Ladislav Kavan , Rachel McDonnell , Simon Dobbyn , Jiří Žára , Carol O'Sullivan, Skinning arbitrary deformations, Proceedings of the 2007 symposium on Interactive 3D graphics and games, April 30-May 02, 2007, Seattle, Washington [doi>10.1145/1230100.1230109]
• 12: Scott Kircher , Michael Garland, Editing arbitrarily deforming surface animations, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 13: Manfred Lau , Jinxiang Chai , Ying-Qing Xu , Heung-Yeung Shum, Face poser: interactive modeling of 3D facial expressions using model priors, Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 02-04, 2007, San Diego, California
• 14: N. Magnenat-Thalmann , R. Laperrière , D. Thalmann, Joint-dependent local deformations for hand animation and object grasping, Proceedings on Graphics interface '88, p.26-33, December 1989, Edmonton, Alberta, Canada
• 15: Melzer, T., Reitera, M., and Bischofb, H. 2003. Appearance models based on kernel canonical correlation analysis. Pattern Recognition 36, 9, 1961--1971.
• 16: Mark Meyer , John Anderson, Key Point Subspace Acceleration and soft caching, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 17: Alex Mohr , Michael Gleicher, Building efficient, accurate character skins from examples, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 18: nVidia Cuda. Compute unified device architecture (cuda). http://developer.nvidia.com/object/cuda.html.
• 19: Sang Il Park , Jessica K. Hodgins, Capturing and animating skin deformation in human motion, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 20: Lin Shi , Yizhou Yu , Nathan Bell , Wei-Wen Feng, A fast multigrid algorithm for mesh deformation, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 21: Robert W. Sumner , Jovan Popović, Deformation transfer for triangle meshes, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 22: Robert W. Sumner , Matthias Zwicker , Craig Gotsman , Jovan Popović, Mesh-based inverse kinematics, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 23: Robert Y. Wang , Kari Pulli , Jovan Popović, Real-time enveloping with rotational regression, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 24: Weber, O., Sorkine, O., Lipman, Y., and Gotsman, C. 2007. Context-aware skeletal shape deformation. Computer Graphics Forum (Eurographics 2007) 26, 3, 265--274.
• 25: Ryan White , Keenan Crane , D. A. Forsyth, Capturing and animating occluded cloth, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 26: Weiwei Xu , Kun Zhou , Yizhou Yu , Qifeng Tan , Qunsheng Peng , Baining Guo, Gradient domain editing of deforming mesh sequences, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 27: Yizhou Yu , Kun Zhou , Dong Xu , Xiaohan Shi , Hujun Bao , Baining Guo , Heung-Yeung Shum, Mesh editing with poisson-based gradient field manipulation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 28: Li Zhang , Noah Snavely , Brian Curless , Steven M. Seitz, Spacetime faces: high resolution capture for modeling and animation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Keywords:
Poisson equation, animation, regression, skinning