Reducing blendshape interference by selected motion attenuation

ABSTRACT

Blendshapes (linear shape interpolation models) are perhaps the most commonly employed technique in facial animation practice. A major problem in creating blendshape animation is that of blendshape interference: the adjustment of a single blendshape "slider" may degrade the effects obtained with previous slider movements, because the blendshapes have overlapping, non-orthogonal effects. Because models used in commercial practice may have 100 or more individual blendshapes, the interference problem is the subject of considerable manual effort. Modelers iteratively resculpt models to reduce interference where possible, and animators must compensate for those interference effects that remain. In this short paper we consider the blendshape interference problem from a linear algebra point of view. We find that while full orthogonality is not desirable, the goal of preserving previous adjustments to the model can be effectively approached by allowing the user to temporarily designate a set of points as representative of the previous (desired) adjustments. We then simply solve for blendshape slider values that mimic desired new movement while moving these "tagged" points as little as possible. The resulting algorithm is easy to implement and demonstrably reduces cases of blendshape interference found in existing models.

REFERENCES

• 1: Beier, T., 2005. personal communication. Hammerhead Productions.
• 2: Bergeron, P., and Lachapelle, P. 1985. Controlling facial expression and body movements in the computer generated short 'Tony de Peltrie'. In SIGGRAPH Tutorial Notes. ACM.
• 3: Bergeron, P. 1987. 3-d character animation on the symbolics system. SIGGRAPH Course Notes: 3-D Character Animation by Computer (July).
• 4: Volker Blanz , Thomas Vetter, A morphable model for the synthesis of 3D faces, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.187-194, July 1999 [doi>10.1145/311535.311556]
• 5: Choe, B., Lee, H., and Ko, H.-S. 2001. Performance-driven muscle-based facial animation. J. Visualization and Computer Animation 12, 2, 67--79.
• 6: Elson, M. 1990. "Displacement" facial animation techniques. SIGGRAPH Course Notes: State of the Art in Facial Animation.
• 7: Keith Grochow , Steven L. Martin , Aaron Hertzmann , Zoran Popović, Style-based inverse kinematics, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 8: Jenkins, S., 2004. personal communication. Disney Feature Animation.
• 9: Pushkar Joshi , Wen C. Tien , Mathieu Desbrun , Frédéric Pighin, Learning controls for blend shape based realistic facial animation, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 10: Kleiser, J. 1989. A fast, efficient, accurate way to represent the human face. In SIGGRAPH '89 Course Notes 22: State of the Art in Facial Animation.
• 11: Tsuneya Kurihara , Natsuki Miyata, Modeling deformable human hands from medical images, Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 27-29, 2004, Grenoble, France [doi>10.1145/1028523.1028571]
• 12: Landreth, C., 1998. Bingo. Computer generated short film directed by Chris Landreth.
• 13: N. Magnenat-Thalmann , R. Laperrière , D. Thalmann, Joint-dependent local deformations for hand animation and object grasping, Proceedings on Graphics interface '88, p.26-33, December 1989, Edmonton, Alberta, Canada
• 14: Alex Mohr , Luke Tokheim , Michael Gleicher, Direct manipulation of interactive character skins, Proceedings of the 2003 symposium on Interactive 3D graphics, April 27-30, 2003, Monterey, California [doi>10.1145/641480.641488]
• 15: Frederick I. Parke, Computer generated animation of faces, Proceedings of the ACM annual conference, August 01-01, 1972, Boston, Massachusetts, United States [doi>10.1145/800193.569955]
• 16: Frédéric Pighin , Jamie Hecker , Dani Lischinski , Richard Szeliski , David H. Salesin, Synthesizing realistic facial expressions from photographs, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.75-84, July 1998 [doi>10.1145/280814.280825]
• 17: Raitt, B., 2004. The making of Gollum. Presentation at U. Southern California Institute for Creative Technologies's Frontiers of Facial Animation Workshop, August.
• 18: Video, 2005. Accompanying video for "Reducing Blendshape Interference by Selected Motion Attenuation". http://graphics.usc.edu/~noisebrain/I3D2005.mov.
• 19: Yamane, K., and Nakamura, Y. 2003. Natural motion animation through constraining and deconstraining at will. IEEE Tran. Visualization and Computer Graphics 9, 3, 352--360.
• 20: Zhao, X., 2001. personal communication. Disney Feature Animation.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Curve, surface, solid, and object representations

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Keywords:
facial animation, user interaction