Color sketch generation

ABSTRACT

In this paper, we introduce an NPR system to generate color sketches in a free-hand drawing style. From observation, we found out that in a free-hand style both shape and color of image regions are stylized, which contributes cooperatively to the visual effect of a sketch. With the color regions obtained by our interactive segmentation algorithm, we create a stylized color sketch in two steps. First, in order to manifest the lighting and shading of each region, we shrink the boundary of the color regions with a luminance-based algorithm emphasizing the highlight parts, which enforces consistency with the free-hand artist style of the sketch. Second, the proposed color shift algorithm is applied to image regions to emphasize the main content of the sketch and acquires a visually pleasing combination of color. We choose the optimal combination by minimizing the energy function based on an artist drawn color database, artistic drawing rules and input image colors. The generated results show that our system can produce aesthetically pleasing sketches.

REFERENCES

• 1: William A. Barrett , Alan S. Cheney, Object-based image editing, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 2: Dorin Comaniciu , Peter Meer, Mean Shift: A Robust Approach Toward Feature Space Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.603-619, May 2002 [doi>10.1109/34.1000236]
• 3: Cooper, E. 2000. California: A Sketchbook. Chronicle Books.
• 4: Doug DeCarlo , Anthony Santella, Stylization and abstraction of photographs, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 5: William T. Freeman , Egon C. Pasztor , Owen T. Carmichael, Learning Low-Level Vision, International Journal of Computer Vision, v.40 n.1, p.25-47, Oct. 2000 [doi>10.1023/A:1026501619075]
• 6: Gooch, A. A., Olsen, S. C., Tumblin, J., and Gooch, B. 2005. Color2gray: Salience-preserving color removal. In Proceedings of ACM SIGGRAPH 05, 634--639.
• 7: Paul Haeberli, Paint by numbers: abstract image representations, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.207-214, September 1990, Dallas, TX, USA
• 8: Christopher G. Healey , Laura Tateosian , James T. Enns , Mark Remple, Perceptually based brush strokes for nonphotorealistic visualization, ACM Transactions on Graphics (TOG), v.23 n.1, p.64-96, January 2004 [doi>10.1145/966131.966135]
• 9: Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 [doi>10.1145/383259.383295]
• 10: Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 [doi>10.1145/280814.280951]
• 11: Aaron Hertzmann, Paint By Relaxation, Computer Graphics International 2001, p.47-54, July 03-06, 2001
• 12: Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. In Proceedings of ACM SIGGRAPH 2004.
• 13: Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. In Proceedings of ACM SIGGRAPH 04, 303--308.
• 14: Peter Litwinowicz, Processing images and video for an impressionist effect, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.407-414, August 1997 [doi>10.1145/258734.258893]
• 15: Meier, B. J., Spalter, A. M., and Karelitz, D. B. 2004. Interactive color palette tools. IEEE Computer Graphics and Applications 24, 3, 64--72.
• 16: Judea Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1988
• 17: Erik Reinhard , Michael Ashikhmin , Bruce Gooch , Peter Shirley, Color Transfer between Images, IEEE Computer Graphics and Applications, v.21 n.5, p.34-41, September 2001
• 18: Michio Shiraishi , Yasushi Yamaguchi, An algorithm for automatic painterly rendering based on local source image approximation, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.53-58, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340923]
• 19: Weiss, Y. 1996. Interpreting images by propagating bayesian beliefs. Advances in Neural Information Processing Systems, 908--914.
• 20: Tomihisa Welsh , Michael Ashikhmin , Klaus Mueller, Transferring color to greyscale images, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 21: Wyszecki, G., and Stiles, W. S. 1982. Color Science: Concepts and Methods, Quantitative Data and Formulae. Wiley Interscience Publishers, New York.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.4 Graphics Utilities
      I.3.7 Three-Dimensional Graphics and Realism

General Terms:
Algorithms, Design

Keywords:
boundary shrinking, color shift, non-photorealistic rendering