Xface: MPEG-4 based open source toolkit for 3D Facial Animation

ABSTRACT

In this paper, we present our open source, platform independent toolkit for developing 3D talking agents, namely Xface. It relies on MPEG-4 Face Animation (FA) standard. The toolkit currently incorporates three pieces of software. The core Xface library is for developers who want to embed 3D facial animation to their software as well as researchers who want to focus on related topics without the hassle of implementing a full framework from scratch. XfaceEd editor provides an easy to use interface to generate MPEG-4 ready meshes from static 3D models. Last, XfacePlayer is a sample application that demonstrates the toolkit in action. All the pieces are implemented in C++ programming language and rely on only operating system independent libraries. The main design principles for Xface are ease of use and extendibility.

REFERENCES

• 1: Justine Cassell , Hannes Högni Vilhjálmsson , Timothy Bickmore, BEAT: the Behavior Expression Animation Toolkit, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.477-486, August 2001 [doi>10.1145/383259.383315]
• 2: N. DeCarolis, V. Carofiglio, and C. Pelachaud. From Discourse Plans to Believable Behavior Generation. In International Natural Language Generation Conference, New York, July 2002.
• 3: Petros Faloutsos , Michiel van de Panne , Demetri Terzopoulos, Dynamic Free-Form Deformations for Animation Synthesis, IEEE Transactions on Visualization and Computer Graphics, v.3 n.3, p.201-214, July 1997 [doi>10.1109/2945.620488]
• 4: T. C. for Speech Technology Research University of Edinburgh. The Festival Speech Synthesis System, 2002. http://www.cstr.ed.ac.uk/projects/festival/.
• 5: Interface Curtin. The Virtual Human Markup Language, 2001. Working Draft {Online} Available: http://www.vhml.org.
• 6: P. Kalra, A. Mangili, N. M. Thalmann, and D. Thalmann. 3d Interactive Free Form Deformations for Facial Expressions. In Proc. Compugraphics, Lisboa, Portugal, 1991.
• 7: N. Kojekine, V. Savchenko, M. Senin, and I. Hagiwara. Real-time 3D Deformations by Means of Compactly Supported Radial Basis Functions. In Short papers proceedings of Eurographics, pages 35--43, Saarbrucken, Germany, 2--6 September 2002.
• 8: F. Lavagetto and R. Pockaj. The Facial Animation Engine: Towards a High-Level Interface for Design of MPEG-4 Compliant Animated Faces. IEEE Transaction on Circuits and Systems for Video Technology, 9(2):277--289, 1999.
• 9: M. Preda and F. Prêteux. Critic Review on MPEG-4 Face and Body Animation. In Proceedings IEEE International Conference on Image Processing (ICIP'2002), pages 505--508, Rochester, NY, 2002.
• 10: I. J. N1901. Text for CD 14496-1 Systems. Fribourg Meeting, November 1997.
• 11: I. J. N1902. Text for CD 14496-1 Visual. Fribourg Meeting, November 1997.
• 12: J. Noh and U. Neumann. A Survey of Facial Modeling and Animation Techniques. Technical Report 99-705, USC, 1998.
• 13: J. Ostermann, Animation of Synthetic Faces in MPEG-4, Proceedings of the Computer Animation, p.49, June 08-10, 1998
• 14: Igor S. Pandzic , Robert Forchheimer, MPEG-4 Facial Animation: The Standard, Implementation and Applications, John Wiley & Sons, Inc., New York, NY, 2003
• 15: F. Parke. Parameterized Models for Facial Animation. IEEE Computer Graphics App. Mag., 2(9):61--68, 1982.
• 16: C. Pelachaud, E. Magno-Caldognetto, C. Zmarich, and P. Cosi. An Approach to An Italian Head. In Eurospeech'01, Aalborg, Danemark, September 2001.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

General Terms:
Design, Performance, Standardization

Keywords:
3D facial animation, MPEG-4, open source, talking heads