Performance-driven facial animation

ABSTRACT

As computer graphics technique rises to the challenge of rendering lifelike performers, more lifelike performance is required. The techniques used to animate robots, arthropods, and suits of armor, have been extended to flexible surfaces of fur and flesh. Physical models of muscle and skin have been devised. But more complex databases and sophisticated physical modeling do not directly address the performance problem. The gestures and expressions of a human actor are not the solution to a dynamic system. This paper describes a means of acquiring the expressions of real faces, and applying them to computer-generated faces. Such an "electronic mask" offers a means for the traditional talents of actors to be flexibly incorporated in digital animations. Efforts in a similar spirit have resulted in servo-controlled "animatrons," high-technology puppets, and CG puppetry [1]. The manner in which the skills of actors and puppetteers as well as animators are accommodated in such systems may point the way for a more general incorporation of human nuance into our emerging computer media.The ensuing description is divided into two major subjects: the construction of a highly-resoved human head model with photographic texture mapping, and the concept demonstration of a system to animate this model by tracking and applying the expressions of a human performer.

REFERENCES

• 1: Waiters, Graham, The Story of Waldo C. Graphic. ACM SIGGRAPH '89 Course Notes, 3D Character Animation by Computer, August 1989.
• 2: Frederic Ira Parke, A parametric model for human faces., 1974
• 3: Stephen M. Platt , Norman I. Badler, Animating facial expressions, Proceedings of the 8th annual conference on Computer graphics and interactive techniques, p.245-252, August 03-07, 1981, Dallas, Texas, United States
• 4: Stephen Michael Platt, A structural model of the human face (graphics, animation, object representation), 1985
• 5: Brennan, Susan Elise, Caricature Generator. M.S. Visual Studies, Dept. of Architecture, Massachusetts Institute of Technology, Cambridge, MA. Sept. 1982.
• 6: Burson, Nancy, and Schneider, Thomas, "Method and Apparatus for Producing an Image of a Person's Face at a Different Age," U.S. Patent #4276570, June 30, 1981.
• 7: Masaaki Oka , Kyoya Tsutsui , Akio Ohba , Yoshitaka Kurauchi , Takashi Tago, Real-time manipulation of texture-mapped surfaces, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.181-188, August 1987
• 8: Lachapelle, Pierre, Bergeron, Philippe, Robidoux, P., and Langlois, Daniel, Tony de Peltrie. {film} 1985.
• 9: Keith Waters, A muscle model for animation three-dimensional facial expression, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.17-24, August 1987
• 10: Lasseter, John, Ostby, Eben, Reeves, William, Good, Craig, Rydstrom, Gary. Tin Toy. {film} Pixar, 1988.
• 11: Cyberware Laboratory, Inc.: 4020/PS 3D Scanner, 4020/RGB 3D Scanner with color digitizer. 8 Harris Court 3D, Monterey, California 93940.
• 12: Butt, P.J., Ogden, J.M., Adelson, E.H., and Bergen, J.R., Pyramid-Based Computer Graphics. RCA Engineer, Vol. 30, 5, Sept.-Oct. 1985.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Curve, surface, solid, and object representations
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.3 Enhancement
          Subjects: Filtering

  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Arts, fine and performing**

General Terms:
Algorithms, Design