Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

We present techniques for transforming images and videos into painterly animations depicting different artistic styles. Our techniques rely on image and video analysis to compute appearance and motion properties. We also determine and apply motion information from different (user-specified) sources to static and moving images. These properties that encode spatio-temporal variations are then used to render (or paint) effects of selected styles to generate images and videos with a painted look. Painterly animations are generated using a mesh of brush stroke objects with dynamic spatio-temporal properties. Styles govern the behavior of these brush strokes as well as their rendering to a virtual canvas. We present methods for modifying the properties of these brush strokes according to the input images, videos, or motions. Brush stroke color, length, orientation, opacity, and motion are determined and the brush strokes are regenerated to fill the canvas as the video changes. All brush stroke properties are temporally constrained to guarantee temporally coherent non-photorealistic animations.

REFERENCES

• 1: BLACK, M., AND ANANDAN, P. 1991. Robust dynamic motion estimation over time. In Proceedings of Computer Vision and Pattern Recognition (CVPR 1991), 296--302.
• 2: BORS, A. G. 2001. Introduction of the radial basis function (rbf) networks. In Online Symposium for Electronics Engineers, vol. 1 of DSP Algorithms: Multimedia.
• 3: BRADKSI, G., AND PISAREVSKY, V. 2000. Intel's computer vision library: Applications in calibration, stereo, segmentation, tracking, gesture, face, and object recognition. In In Proceedings of IEEE Computer Vision and Pattern Recognition Conference 2000, vol. II, II:796--797. Demonstration Paper.
• 4: Doug DeCarlo , Anthony Santella, Stylization and abstraction of photographs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 5: David A. Forsyth , Jean Ponce, Computer Vision: A Modern Approach, Prentice Hall Professional Technical Reference, 2002
• 6: William T. Freeman , Edward H. Adelson , David J. Heeger, Motion without movement, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.27-30, July 1991
• 7: Antonio Haro , Irfan Essa, Learning Video Processing by Example, Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1, p.10487, August 11-15, 2002
• 8: Aaron Hertzmann , Ken Perlin, Painterly rendering for video and interaction, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.7-12, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340917]
• 9: Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 [doi>10.1145/383259.383295]
• 10: Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 [doi>10.1145/280814.280951]
• 11: Aaron Hertzmann, Fast paint texture, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France [doi>10.1145/508530.508546]
• 12: Allison W. Klein , Peter-Pike J. Sloan , Adam Finkelstein , Michael F. Cohen, Stylized video cubes, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545264]
• 13: John Lansdown , Simon Schofield, Expressive Rendering: A Review of Nonphotorealistic Techniques, IEEE Computer Graphics and Applications, v.15 n.3, p.29-37, May 1995 [doi>10.1109/38.376610]
• 14: Peter Litwinowicz, Processing images and video for an impressionist effect, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.407-414, August 1997 [doi>10.1145/258734.258893]
• 15: Barbara J. Meier, Painterly rendering for animation, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.477-484, August 1996 [doi>10.1145/237170.237288]
• 16: REYNOLDS, C., WWW. Stylized depiction in computer graphics non-photorealistic, painterly and 'toon rendering. http://www.red3d.com/cwr/npr/.
• 17: Jarke J. van Wijk, Image based flow visualization, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 18: WARD, V., 1998. What dreams may come. Feature Film.