Voice puppetry

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Voice puppetry

Full text

Pdf (1.82 MB)

Source

International Conference on Computer Graphics and Interactive Techniques archive
Proceedings of the 26th annual conference on Computer graphics and interactive techniques table of contents

Pages: 21 - 28

Year of Publication: 1999

ISBN:0-201-48560-5

Author

Matthew Brand

MERL -- a Mitsubishi Electric Research Laboratory, 201 Broadway, Cambridge, MA

Sponsor

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

ACM Press/Addison-Wesley Publishing Co. New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 10, Downloads (12 Months): 99, Citation Count: 46

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/311535.311537 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	J.E. Ball and D.T. Ling. Spoken language processing in the Persona conversational assistant. In Proc. ESCA Workshop on Spoken Dialogue Systems, 1995.
	2	L. Baum. An inequality and associated maximization technique in statistical estimation of probabilistic functions of Markov processes. Inequalities, 3:1-8, 1972.
	3	C. Benoit, C. Abry, M.-A. Cathiard, T. Guiard-Marigny, and T. Lallouache. Read my lips: Where? How? When? And so... What? In 8th Int. Congress on Event Perception and Action, Marseille, France, July 1995. Springer-Verlag.
	4	Matthew Brand, Structure learning in conditional probability models via an entropic prior and parameter extinction, Neural Computation, v.11 n.5, p.1155-1182, July 1, 1999 [doi>10.1162/089976699300016395]
	5	M. Brand. Pattern discovery via entropy minimization. In Proc. Artificial Intelligence and Statistics #7, Morgan Kaufmann Publishers. January 1999.
	6	Matthew Brand, Shadow Puppetry, Proceedings of the International Conference on Computer Vision-Volume 2, p.1237, September 20-25, 1999
	7	Christoph Bregler , Michele Covell , Malcolm Slaney, Video Rewrite: driving visual speech with audio, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.353-360, August 1997 [doi>10.1145/258734.258880]
	8	T. Chen , R. Rao, Audio-Visual Interaction in Multimedia Communication, Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 1, p.179, April 21-24, 1997
	9	M.M. Cohen and D.W. Massaro. Modeling coarticulation in synthetic visual speech. In N.M. Thalmann and D. Thalmann, editors, Models and Techniques in Computer Animation. Springer-Verlag, 1993.
	10	S. Curinga, F. Lavagetto, and F. Vignoli. Lip movement sythesis using time delay neural networks. In Proc. EUSIPCO ' 96, 1996.
	11	E Ekman and W.V. Friesen. Manual for the Facial Action Coding System. Consulting Psychologists Press, Inc., Palo Alto, CA, 1978.
	12	T. Ezzat , T. Poggio, MikeTalk: A Talking Facial Display Based on Morphing Visemes, Proceedings of the Computer Animation, p.96, June 08-10, 1998
	13	G.D. Forney. The Viterbi algorithm. Proc. IEEE, 6:268-278, 1973.
	14	G.H. Golub and C.F. van Loan. Matrix Computations. Johns Hopkins, 1996. 3rd edition.
	15	Gregory D. Hager , Kentaro Toyama, X Vision: a portable substrate for real-time vision applications, Computer Vision and Image Understanding, v.69 n.1, p.23-37, Jan. 1998 [doi>10.1006/cviu.1997.0586]
	16	H. Hermansky and N. Morgan. RASTA processing of speech. IEEE Transactions on Speech and Audio Processing, 2(4):578-589, October 1994.
	17	I. Katunobu and O. Hasegawa. An active multimodal interaction system. In Proc. ESCA Workshop on Spoken Dialogue Systems, 1995.
	18	J.E Lewis. Automated lip-sync: Background and techniques. J. Visualization and Computer Animation, 2:118-122, 1991.
	19	D.F. McAllister, R.D. Rodman, and D.L. Bitzer. Speaker independence in lip synchronization. In Proc. CompuGraphics ' 97, December 1997.
	20	H. McGurk and J. MacDonald. Hearing lips and seeing voices. Nature, 264:746-748, 1976.
	21	K. Stevens (MIT). Personal communication., 1998.
	22	S. Morishima and H. Harashima. A media conversion from speech to facial image for intelligent man-machine interface. IEEE J. Selected Areas in Communications, 4:594-599, 1991.
	23	F.I. Parke. A parametric model for human faces. Technical Report UTEC-CSc-75-047, University of Utah, 1974.
	24	F.I. Parke. A model for human faces that allows speech synchronized animation. J. Computers and Graphics, 1(1): 1- 4, 1975.
	25	M. Rydfalk. CANDIDE, a parameterised face. Technical Report LiTH-ISY-I-0866, Department of Electrical Engineering, Link/Sping University, Sweden, October 1987. Java demo available at http://www.bk.isy.liu.se/candide/candemo.html.
	26	L.K. Saul and M.I. Jordan. A variational principle for model-based interpolation. Technical report, MIT Center for Biological and Computational Learning, 1996.
	27	E.F. Walther. Lipreading. Nelson-Hall Inc., Chicago, 1982.
	28	K. Waters and T. Levergood. DECface: A system for synthetic face applications. Multimedia Tools and Applications, 1:349- 366, 1995.
	29	E. Yamamoto , S. Nakamura , K. Shikano, Lip Movement Synthesis from Speech Based on Hidden Markov Models, Proceedings of the 3rd. International Conference on Face & Gesture Recognition, p.154, April 14-16, 1998

CITED BY 46

	Matthew Stone , Doug DeCarlo , Insuk Oh , Christian Rodriguez , Adrian Stere , Alyssa Lees , Chris Bregler, Speaking with hands: creating animated conversational characters from recordings of human performance, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
	Xiaohuan Corina Wang , Cary Phillips, Multi-weight enveloping: least-squares approximation techniques for skin animation, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas
	Tony Ezzat , Gadi Geiger , Tomaso Poggio, Trainable videorealistic speech animation, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
	Alyn Rockwood , Janet McAndless, Through the Looking Glass: The Synthesis of Computer Graphics and Computer Vision, IEEE MultiMedia, v.6 n.3, p.8-11, July 1999
	Yan Li , Feng Yu , Ying-Qing Xu , Eric Chang , Heung-Yeung Shum, Speech-driven cartoon animation with emotions, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada
	Ian Buck , Adam Finkelstein , Charles Jacobs , Allison Klein , David H. Salesin , Joshua Seims , Richard Szeliski , Kentaro Toyama, Performance-driven hand-drawn animation, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.101-108, June 05-07, 2000, Annecy, France
	Katherine Pullen , Christoph Bregler, Motion capture assisted animation: texturing and synthesis, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
	Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001
	Matthew Brand , Aaron Hertzmann, Style machines, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.183-192, July 2000
	Justine Cassell , Hannes Högni Vilhjálmsson , Timothy Bickmore, BEAT: the Behavior Expression Animation Toolkit, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.477-486, August 2001
	Hong Chen , Nan-Ning Zheng , Lin Liang , Yan Li , Ying-Qing Xu , Heung-Yeung Shum, PicToon: a personalized image-based cartoon system, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France
	Yong Cao , Petros Faloutsos , Frédéric Pighin, Unsupervised learning for speech motion editing, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
	P. Kakumanu , R. Gutierrez-Osuna , A. Esposito , R. Bryll , A. Goshtasby , O. N. Garcia, Speech driven facial animation, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida
	Sooha Park Lee , Jeremy B. Badler , Norman I. Badler, Eyes alive, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
	Bill Tomlinson , Marc Downie , Matt Berlin , Jesse Gray , Derek Lyons , Jennie Cochran , Bruce Blumberg, Leashing the AlphaWolves: mixing user direction with autonomous emotion in a pack of semi-autonomous virtual characters, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas
	Qingshan Zhang , Zicheng Liu , Baining Guo , Harry Shum, Geometry-driven photorealistic facial expression synthesis, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
	Jin-xiang Chai , Jing Xiao , Jessica Hodgins, Vision-based control of 3D facial animation, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
	Tian-Shu Wang , Nan-Ning Zheng , Yan Li , Ying-Qing Xu , Heung-Yung Shum, Learning kernel-based HMMs for dynamic sequence synthesis, Graphical Models, v.65 n.4, p.206-221, July 2003
	Li Zhang , Noah Snavely , Brian Curless , Steven M. Seitz, Spacetime faces: high resolution capture for modeling and animation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
	Eugene Hsu , Sommer Gentry , Jovan Popović, Example-based control of human motion, Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 27-29, 2004, Grenoble, France
	Yong Cao , Petros Faloutsos , Eddie Kohler , Frédéric Pighin, Real-time speech motion synthesis from recorded motions, Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 27-29, 2004, Grenoble, France
	Zhigang Deng , Shri Narayanan , Carlos Busso , Ulrich Neumann, Audio-based head motion synthesis for Avatar-based telepresence systems, Proceedings of the 2004 ACM SIGMM workshop on Effective telepresence, October 15-15, 2004, New York, NY, USA
	Darren Cosker , Susan Paddock , David Marshall , Paul. L. Rosin , Simon Rushton, Towards perceptually realistic talking heads: models, methods and McGurk, Proceedings of the 1st Symposium on Applied perception in graphics and visualization, August 07-08, 2004, Los Angeles, California
	Bo Zhang , Zicheng Liu , Baining Guo, Photo-realistic conversation agent, Integrated image and graphics technologies, Kluwer Academic Publishers, Norwell, MA, 2004
	Erika Chuang , Christoph Bregler, Mood swings: expressive speech animation, ACM Transactions on Graphics (TOG), v.24 n.2, p.331-347, April 2005
	Eftychios Sifakis , Igor Neverov , Ronald Fedkiw, Automatic determination of facial muscle activations from sparse motion capture marker data, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
	Darren Cosker , Susan Paddock , David Marshall , Paul L. Rosin , Simon Rushton, Toward Perceptually Realistic Talking Heads: Models, Methods, and McGurk, ACM Transactions on Applied Perception (TAP), v.2 n.3, p.270-285, July 05
	Yong Cao , Wen C. Tien , Petros Faloutsos , Frédéric Pighin, Expressive speech-driven facial animation, ACM Transactions on Graphics (TOG), v.24 n.4, p.1283-1302, October 2005
	Scott A. King , Richard E. Parent, Creating Speech-Synchronized Animation, IEEE Transactions on Visualization and Computer Graphics, v.11 n.3, p.341-352, May 2005
	Zhigang Deng , Pei-Ying Chiang , Pamela Fox , Ulrich Neumann, Animating blendshape faces by cross-mapping motion capture data, Proceedings of the 2006 symposium on Interactive 3D graphics and games, March 14-17, 2006, Redwood City, California
	Zhigang Deng , Ulrich Neumann, eFASE: expressive facial animation synthesis and editing with phoneme-isomap controls, Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, September 02-04, 2006, Vienna, Austria
	Eftychios Sifakis , Andrew Selle , Avram Robinson-Mosher , Ronald Fedkiw, Simulating speech with a physics-based facial muscle model, Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, September 02-04, 2006, Vienna, Austria
	Ian Buck , Adam Finkelstein , Charles Jacobs , Allison Klein , David H. Salesiny , Joshua Seims , Richard Szeliski , Kentaro Toyama, Performance-driven hand-drawn animation, ACM SIGGRAPH 2006 Courses, July 30-August 03, 2006, Boston, Massachusetts
	Graham Grindlay , David Helmbold, Modeling, analyzing, and synthesizing expressive piano performance with graphical models, Machine Learning, v.65 n.2-3, p.361-387, December 2006
	Goranka Zorić , Igor S. Pandžić, Real-time language independent lip synchronization method using a genetic algorithm, Signal Processing, v.86 n.12, p.3644-3656, December 2006
	Shin-ichi Kawamoto , Tatsuo Yotsukura , Shigeo Morishima , Satoshi Nakamura, Automatic head-movement control for emotional speech, ACM SIGGRAPH 2005 Posters, July 31-August 04, 2005, Los Angeles, California
	Nadia Mana , Fabio Pianesi, HMM-based synthesis of emotional facial expressions during speech in synthetic talking heads, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada
	Lei Xie , Zhi-Qiang Liu, A coupled HMM approach to video-realistic speech animation, Pattern Recognition, v.40 n.8, p.2325-2340, August, 2007
	Kevin Wampler , Daichi Sasaki , Li Zhang , Zoran Popović, Dynamic, expressive speech animation from a single mesh, Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 02-04, 2007, San Diego, California
	Ig-Jae Kim , Hyeong-Seok Ko, Intuitive quasi-eigen faces, Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia, December 01-04, 2007, Perth, Australia
	Tanasai Sucontphunt , Zhenyao Mo , Ulrich Neumann , Zhigang Deng, Interactive 3D facial expression posing through 2D portrait manipulation, Proceedings of graphics interface 2008, May 28-30, 2008, Windsor, Ontario, Canada
	Gregor Hofer , Hiroshi Shimodaira , Junichi Yamagishi, Speech driven head motion synthesis based on a trajectory model, ACM SIGGRAPH 2007 posters, August 05-09, 2007, San Diego, California
	Barry-John Theobald , Iain A. Matthews , Jeffrey F. Cohn , Steven M. Boker, Real-time expression cloning using appearance models, Proceedings of the 9th international conference on Multimodal interfaces, November 12-15, 2007, Nagoya, Aichi, Japan
	Alice Wang , Michael Emmi , Petros Faloutsos, Assembling an expressive facial animation system, Proceedings of the 2007 ACM SIGGRAPH symposium on Video games, August 04-05, 2007, San Diego, California
	Zhigang Deng , Ulrich Neumann , J. P. Lewis , Tae-Yong Kim , Murtaza Bulut , Shrikanth Narayanan, Expressive Facial Animation Synthesis by Learning Speech Coarticulation and Expression Spaces, IEEE Transactions on Visualization and Computer Graphics, v.12 n.6, p.1523-1534, November 2006
	Jinxiang Chai , Jessica K. Hodgins, Constraint-based motion optimization using a statistical dynamic model, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007