Real-time gradient-domain painting

ABSTRACT

We present an image editing program which allows artists to paint in the gradient domain with real-time feedback on megapixel-sized images. Along with a pedestrian, though powerful, gradient-painting brush and gradient-clone tool, we introduce an edge brush designed for edge selection and replay. These brushes, coupled with special blending modes, allow users to accomplish global lighting and contrast adjustments using only local image manipulations --- e.g. strengthening a given edge or removing a shadow boundary. Such operations would be tedious in a conventional intensity-based paint program and hard for users to get right in the gradient domain without real-time feedback. The core of our paint program is a simple-to-implement GPU multigrid method which allows integration of megapixel-sized full-color gradient fields at over 20 frames per second on modest hardware. By way of evaluation, we present example images produced with our program and characterize the iteration time and convergence rate of our integration method.

REFERENCES

• 1: Aseem Agarwala, Efficient gradient-domain compositing using quadtrees, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 2: Agrawal, A., and Raskar, R., 2007. Gradient domain manipulation techniques in vision and graphics. ICCV 2007 Course.
• 3: Jeff Bolz , Ian Farmer , Eitan Grinspun , Peter Schröoder, Sparse matrix solvers on the GPU: conjugate gradients and multigrid, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 4: Peter J. Burt , Edward H. Adelson, A multiresolution spline with application to image mosaics, ACM Transactions on Graphics (TOG), v.2 n.4, p.217-236, October 1983 [doi>10.1145/245.247]
• 5: James H. Elder , Richard M. Goldberg, Image Editing in the Contour Domain, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.3, p.291-296, March 2001 [doi>10.1109/34.910881]
• 6: Raanan Fattal , Dani Lischinski , Michael Werman, Gradient domain high dynamic range compression, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 7: Graham D. Finlayson , Steven D. Hordley , Mark S. Drew, Removing Shadows from Images, Proceedings of the 7th European Conference on Computer Vision-Part IV, p.823-836, May 28-31, 2002
• 8: Nolan Goodnight , Cliff Woolley , Gregory Lewin , David Luebke , Greg Humphreys, A multigrid solver for boundary value problems using programmable graphics hardware, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, July 26-27, 2003, San Diego, California
• 9: Michael Kazhdan , Hugues Hoppe, Streaming multigrid for gradient-domain operations on large images, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008
• 10: Land, E. H., and McCann, J. J. 1971. Lightness and retinex theory. Journal of the Optical Society of America (1917-1983) 61 (Jan.), 1--11.
• 11: Levin, A., Zomet, A., Peleg, S., and Weiss, Y., 2003. Seamless image stitching in the gradient domain. Hebrew University Tech Report 2003-82.
• 12: Dani Lischinski , Zeev Farbman , Matt Uyttendaele , Richard Szeliski, Interactive local adjustment of tonal values, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 13: Alexandrina Orzan , Adrien Bousseau , Holger Winnemöller , Pascal Barla , Joëlle Thollot , David Salesin, Diffusion curves: a vector representation for smooth-shaded images, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008
• 14: Patrick Pérez , Michel Gangnet , Andrew Blake, Poisson image editing, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 15: William H. Press , Saul A. Teukolsky , William T. Vetterling , Brian P. Flannery, Numerical recipes in C (2nd ed.): the art of scientific computing, Cambridge University Press, New York, NY, 1992
• 16: Roberts, A. J. 2001. Simple and fast multigrid solution of Poisson's equation using diagonally oriented grids. ANZIAM J. 43, E (July), E1--E36.
• 17: Arno Schödl , Richard Szeliski , David H. Salesin , Irfan Essa, Video textures, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.489-498, July 2000 [doi>10.1145/344779.345012]
• 18: Richard Szeliski, Locally adapted hierarchical basis preconditioning, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 19: Jack Tumblin , Amit Agrawal , Ramesh Raskar, Why I Want a Gradient Camera, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.103-110, June 20-26, 2005 [doi>10.1109/CVPR.2005.374]
• 20: Werner, H. 1935. Studies on contour: I. qualitative analyses. The American Journal of Psychology 47, 1 (Jan.), 40--64.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.4 Graphics Utilities

Keywords:
gradient, interactive, multigrid, painting, real-time