Motion texture

ABSTRACT

In this paper, we describe a novel technique, called motion texture, for synthesizing complex human-figure motion (e.g., dancing) that is statistically similar to the original motion captured data. We define motion texture as a set of motion textons and their distribution, which characterize the stochastic and dynamic nature of the captured motion. Specifically, a motion texton is modeled by a linear dynamic system (LDS) while the texton distribution is represented by a transition matrix indicating how likely each texton is switched to another. We have designed a maximum likelihood algorithm to learn the motion textons and their relationship from the captured dance motion. The learnt motion texture can then be used to generate new animations automatically and/or edit animation sequences interactively. Most interestingly, motion texture can be manipulated at different levels, either by changing the fine details of a specific motion at the texton level or by designing a new choreography at the distribution level. Our approach is demonstrated by many synthesized sequences of visually compelling dance motion.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Okan Arikan , D. A. Forsyth, Interactive motion generation from examples, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
	2	Ziv Bar-Joseph , Ran El-Yaniv , Dani Lischinski , Michael Werman, Texture Mixing and Texture Movie Synthesis Using Statistical Learning, IEEE Transactions on Visualization and Computer Graphics, v.7 n.2, p.120-135, April 2001 [doi>10.1109/2945.928165]
	3	Christopher M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, Inc., New York, NY, 1995
	4	B. Bodenheimer, A. Shleyfman, and J. Hodgins. The effects of noise on the perception of animated human running. In Computer Animation and Simulation '99, Eurographics Animation Workshop, pages 53-63, 1999.
	5	R. Bowden. Learning statistical models of human motion. In IEEE Workshop on Human Modeling, Analysis and Synthesis, CVPR, 2000.
	6	Matthew Brand , Aaron Hertzmann, Style machines, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.183-192, July 2000 [doi>10.1145/344779.344865]
	7	Christoph Bregler, Learning and Recognizing Human Dynamics in Video Sequences, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.568, June 17-19, 1997
	8	Armin Bruderlin , Lance Williams, Motion signal processing, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.97-104, September 1995 [doi>10.1145/218380.218421]
	9	Thomas T. Cormen , Charles E. Leiserson , Ronald L. Rivest, Introduction to algorithms, MIT Press, Cambridge, MA, 1990
	10	Jeremy S. De Bonet, Multiresolution sampling procedure for analysis and synthesis of texture images, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.361-368, August 1997 [doi>10.1145/258734.258882]
	11	N. M. Dempster, A. P. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. J. R. Statist. Soc. B, 39:185-197, 1977.
	12	Alexei A. Efros , William T. Freeman, Image quilting for texture synthesis and transfer, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.341-346, August 2001 [doi>10.1145/383259.383296]
	13	A. W. Fitzgibbon. Stochastic rigidity: Image registration for nowhere-static scenes. In IEEE Int. Conf. on Computer Vision, pages 662-669, 2001.
	14	Aphrodite Galata , Neil Johnson , David Hogg, Learning variable-length Markov models of behavior, Computer Vision and Image Understanding, v.81 n.3, p.398-413, March 2001 [doi>10.1006/cviu.2000.0894]
	15	Michael Gleicher, Retargetting motion to new characters, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.33-42, July 1998 [doi>10.1145/280814.280820]
	16	F. Sebastin Grassia, Practical parameterization of rotations using the exponential map, Journal of Graphics Tools, v.3 n.3, p.29-48, 1 March 1998
	17	C. E. Guo, S. C. Zhu, and Y. N. Wu. Visual learning by integrating descriptive and generative methods. In Int. Conf. Computer Vision, 2001.
	18	Jessica K. Hodgins , Wayne L. Wooten , David C. Brogan , James F. O'Brien, Animating human athletics, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.71-78, September 1995 [doi>10.1145/218380.218414]
	19	Michael Isard , Andrew Blake, C $ONDENSATION$ —Conditional Density Propagation forVisual Tracking, International Journal of Computer Vision, v.29 n.1, p.5-28, Aug. 1998 [doi>10.1023/A:1008078328650]
	20	B. Julesz. Textons, the elements of texture perception and their interactions. Nature, 290:91-97, 1981.
	21	Lucas Kovar , Michael Gleicher , Frédéric Pighin, Motion graphs, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
	22	Jehee Lee , Jinxiang Chai , Paul S. A. Reitsma , Jessica K. Hodgins , Nancy S. Pollard, Interactive control of avatars animated with human motion data, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
	23	Jehee Lee , Sung Yong Shin, A hierarchical approach to interactive motion editing for human-like figures, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.39-48, July 1999 [doi>10.1145/311535.311539]
	24	Thomas Leung , Jitendra Malik, Recognizing Surfaces Using Three-Dimensional Textons, Proceedings of the International Conference on Computer Vision-Volume 2, p.1010, September 20-25, 1999
	25	L. Liang, C. Liu, Y. Xu, B. Guo, and H.-Y. Shum. Real-time texture synthesis by patch-based sampling. Technical Report MSR-TR-2001-40, Microsoft Research, 2001.
	26	Lennart Ljung, System identification (2nd ed.): theory for the user, Prentice Hall PTR, Upper Saddle River, NJ, 1999
	27	Jitendra Malik , Serge Belongie , Jianbo Shi , Thomas Leung, Textons, Contours and Regions: Cue Integration in Image Segmentation, Proceedings of the International Conference on Computer Vision-Volume 2, p.918, September 20-25, 1999
	28	Ben North , Andrew Blake , Michael Isard , Jens Rittscher, Learning and Classification of Complex Dynamics, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.9, p.1016-1034, September 2000 [doi>10.1109/34.877523]
	29	V. Pavlović, J. M. Rehg, T. J. Cham, and K. P. Murphy. A dynamic Bayesian network approach to figure tracking using learned dynamic models. In IEEE International Conference on Computer Vision, 1999.
	30	V. Pavlović, J. M. Rehg, and J. MacCormick. Impact of dynamic model learning on classification of human motion. In IEEE International Conference on Computer Vision and Pattern Recognition, 2000.
	31	Ken Perlin, An image synthesizer, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.287-296, July 1985
	32	Ken Perlin , Athomas Goldberg, Improv: a system for scripting interactive actors in virtual worlds, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.205-216, August 1996 [doi>10.1145/237170.237258]
	33	Zoran Popović , Andrew Witkin, Physically based motion transformation, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.11-20, July 1999 [doi>10.1145/311535.311536]
	34	K. Pullen and C. Bregler. http://graphics.stanford.edu/~pullen/motion_texture.
	35	Katherine Pullen , Christoph Bregler, Motion capture assisted animation: texturing and synthesis, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
	36	L. Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-285, February 1989.
	37	Arno Schödl , Richard Szeliski , David H. Salesin , Irfan Essa, Video textures, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.489-498, July 2000 [doi>10.1145/344779.345012]
	38	Hyun Joon Shin , Jehee Lee , Sung Yong Shin , Michael Gleicher, Computer puppetry: An importance-based approach, ACM Transactions on Graphics (TOG), v.20 n.2, p.67-94, April 2001 [doi>10.1145/502122.502123]
	39	Ken Shoemake, Animating rotation with quaternion curves, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.245-254, July 1985
	40	S. Soatto, G. Doretto, and Y. N. Wu. Dynamic textures. In IEEE International Conference on Computer Vision, pages 439-446, 2001.
	41	L. M. Tanco , A. Hilton, Realistic synthesis of novel human movements from a database of motion capture examples, Proceedings of the Workshop on Human Motion (HUMO'00), p.137, December 07-08, 2000
	42	Munetoshi Unuma , Ken Anjyo , Ryozo Takeuchi, Fourier principles for emotion-based human figure animation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.91-96, September 1995 [doi>10.1145/218380.218419]
	43	Andrew Witkin , Zoran Popovic, Motion warping, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.105-108, September 1995 [doi>10.1145/218380.218422]
	44	Song Chun Zhu , Cheng-en Guo , Ying Nian Wu , Yizhou Wang, What Are Textons?, Proceedings of the 7th European Conference on Computer Vision-Part IV, p.793-807, May 28-31, 2002