Interactive vector fields for painterly rendering

ABSTRACT

We present techniques for generating and manipulating vector fields for use in the creation of painterly images and animations. Our aim is to enable casual users to create results evocative of expressionistic art. Rather than defining stroke alignment fields globally, we divide input images into regions using a colorspace clustering algorithm. Users interactively assign characteristic brush stroke alignment fields and stroke rendering parameters to each region. By combining vortex dynamics and semi-Lagrangian fluid simulation we are able to create stable, easily controlled vector fields. In addition to fluid simulations, users can align strokes in a given region using more conventional field models such as smoothed gradient fields and optical flow, or hybrid fields that combine the desirable features of fluid simulations and smoothed gradient information.

REFERENCES

• 1: Aseem Agarwala , Aaron Hertzmann , David H. Salesin , Steven M. Seitz, Keyframe-based tracking for rotoscoping and animation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 2: William Baxter , Jeremy Wendt , Ming C. Lin, IMPaSTo: a realistic, interactive model for paint, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France [doi>10.1145/987657.987665]
• 3: Brian Cabral , Leith Casey Leedom, Imaging vector fields using line integral convolution, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.263-270, September 1993 [doi>10.1145/166117.166151]
• 4: Alexandre J. Chorin. Vorticity and Turbulence. Springer, New York, 1994.
• 5: D. Comaniciu , P. Meer, Robust analysis of feature spaces: color image segmentation, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.750, June 17-19, 1997
• 6: Cassidy J. Curtis , Sean E. Anderson , Joshua E. Seims , Kurt W. Fleischer , David H. Salesin, Computer-generated watercolor, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.421-430, August 1997 [doi>10.1145/258734.258896]
• 7: Gianluca Donato , Serge Belongie, Approximate Thin Plate Spline Mappings, Proceedings of the 7th European Conference on Computer Vision-Part III, p.21-31, May 28-31, 2002
• 8: Ronald Fedkiw , Jos Stam , Henrik Wann Jensen, Visual simulation of smoke, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.15-22, August 2001 [doi>10.1145/383259.383260]
• 9: Ben Galvin, Brendan McCane, Kevin Novins, David Mason, and Steven Mills. Recovering motion fields: An evaluation of eight optical flow algorithms. In Proceedings of the British Machine Vision Converence (BMVC), 1998.
• 10: Manuel Noronha Gamito, Pedro Faria Lopes, and Mario Rui Gomes. Two-dimensional simulation of gaseous phenomena using vortex particles. In Proceedings of the 6th Eurographics Workshop on Comput. Anim. and Sim., pages 2--15. Springer-Verlag, 1995.
• 11: Paul Haeberli, Paint by numbers: abstract image representations, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.207-214, September 1990, Dallas, TX, USA
• 12: James Hays , Irfan Essa, Image and video based painterly animation, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France [doi>10.1145/987657.987676]
• 13: Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 [doi>10.1145/280814.280951]
• 14: Aaron Hertzmann , Ken Perlin, Painterly rendering for video and interaction, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.7-12, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340917]
• 15: Berthold K. P. Horn and Brian G. Schunck. Determining optical flow. Artificial Intelligence, 17(1--3):185--203, August 1981.
• 16: Yin Li , Jian Sun , Chi-Keung Tang , Heung-Yeung Shum, Lazy snapping, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 17: Peter Litwinowicz, Processing images and video for an impressionist effect, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.407-414, August 1997 [doi>10.1145/258734.258893]
• 18: Carsten Rother , Vladimir Kolmogorov , Andrew Blake, "GrabCut": interactive foreground extraction using iterated graph cuts, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 19: Jonathan Richard Shewchuk, Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator, Selected papers from the Workshop on Applied Computational Geormetry, Towards Geometric Engineering, p.203-222, May 27-28, 1996
• 20: Jos Stam, Stable fluids, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.121-128, July 1999 [doi>10.1145/311535.311548]
• 21: Demetri Terzopoulos, The Computation of Visible-Surface Representations, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.10 n.4, p.417-438, July 1988 [doi>10.1109/34.3908]
• 22: Patrick Witting, Computational fluid dynamics in a traditional animation environment, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.129-136, July 1999 [doi>10.1145/311535.311549]

INDEX TERMS

Keywords:
fluid simulation, non-photorealistic rendering