Performance driven face animation via non-rigid 3d tracking

ABSTRACT

In this demo, a performance driven 3D face animation system is proposed. The proposed system consists of two key components: a robust non-rigid 3D tracking module and a MPEG4 compliant facial animation module. Firstly, the facial motion is tracked from source videos which contain both the rigid 3D head motion (6 DOF) and the non-rigid expression variations. Afterward, the tracked facial motion is parameterized via estimating a set of MPEG4 facial animation parameters(FAP). As the final step, these FAP values are transferred to the MPEG4-compliant face model for the animation purpose. The proposed tracking and animation system has a strong generalization ability and can be used in the indoor environment with no additional assumptions.

REFERENCES

• 1: J. Chai, J. Xiao, and J. Hodgins. Vision-based control of 3d facial animation. In Symposium on Computer Animation, 2003.
• 2: E. Chuang and C. Bregler. Performance driven facial animation using blendshape interpolation. Computer Science Technical Report, Stanford University, 2002.
• 3: Q. P. Ekaterina, E. Kostina, and O. Kostyukova. A primal-dual active-set method for convex, 2003.
• 4: P. Joshi, W. Tien, M. Desbrun, and F. Pighin. Learning controls for blend shape based realistic facial animation. In SIGGRAPH Courses, 2005.
• 5: F. Parke. Computer generated animation of faces. In Proceedings of ACM annual conference, 1972.
• 6: W. Zhang, Q. Wang, and X. Tang. Real Time Feature Based 3-D Deformable Face Tracking. European Conference on Computer Vision, 2008.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking

General Terms:
Experimentation

Keywords:
3D tracking, performance driven animation