Example-based composite sketching of human portraits

ABSTRACT

Creating a portrait in the style of a particular artistic tradition or a particular artist is a difficult problem. Elusive to codify algorithmically, the nebulous qualities which combine to form artwork are often well captured using example-based approaches. These methods place the artist in the process, often during system training, in the hope that their talents may be tapped.Example based methods do not make this problem easy, however. Examples are precious, so training sets are small, reducing the number of techniques which may be employed. We propose a system which combines two separate but similar subsystems, one for the face and another for the hair, each of which employs a global and a local model. Facial exaggeration to achieve the desired stylistic look is handled during the global face phase. Each subsystem uses a divide-and-conquer approach, but while the face subsystem decomposes into separable subproblems for the eyes, mouth, nose, etc., the hair needs to be subdivided in a relatively arbitrary way, making the hair subproblem decomposition an important step which must be handled carefully with a structured model and a detailed model.

REFERENCES

• 1: A. Berman, A. Dadourian, and P. Vlahos. Method for removing from an image the background surrounding a selected object. U.S. Patent 6,134,346, 2000.
• 2: Simon Baker , Takeo Kanade, Hallucinating Faces, Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, p.83, March 26-30, 2000
• 3: S. Brennan. The caricature generator, 1985.
• 4: H. Chen, L. Liang, Y. Q. Xu, H. Y. Shum, and N. N. Zheng. Example-based automatic portraiture. In ACCV02, 2002.
• 5: H. Chen, Y. Q. Xu, H. Y. Shum, S. C. Zhu, and N. N. Zheng. Example-based facial sketch generation with non-parametric sampling. In ICCV01, pages II: 433--438, 2001.
• 6: T. Cootes and C. Taylor. Statistical models of appearance for computer vision, 1999.
• 7: T. F. Cootes , C. J. Taylor , D. H. Cooper , J. Graham, Active shape models—their training and application, Computer Vision and Image Understanding, v.61 n.1, p.38-59, Jan. 1995 [doi>10.1006/cviu.1995.1004]
• 8: Oliver Deussen , Thomas Strothotte, Computer-generated pen-and-ink illustration of trees, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.13-18, July 2000 [doi>10.1145/344779.344792]
• 9: William T. Freeman , Egon C. Pasztor , Owen T. Carmichael, Learning Low-Level Vision, International Journal of Computer Vision, v.40 n.1, p.25-47, Oct. 2000 [doi>10.1023/A:1026501619075]
• 10: Stephane Grabli, Franc¸ois Sillion, Stephen R. Marschner, and Jerome E. Lengyel. Image-based hair capture by inverse lighting. In Proc. Graphics Interface, pages 51--58, May 2002.
• 11: Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 [doi>10.1145/383259.383295]
• 12: Tae-Yong Kim , Ulrich Neumann, Interactive multiresolution hair modeling and editing, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 13: Seung-Yong Lee , Kyung-Yong Chwa , Sung Yong Shin, Image metamorphosis using snakes and free-form deformations, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.439-448, September 1995 [doi>10.1145/218380.218501]
• 14: Lin Liang , Hong Chen , Ying-Qing Xu , Heung-Yeung Shum, Example-Based Caricature Generation with Exaggeration, Proceedings of the 10th Pacific Conference on Computer Graphics and Applications, p.386, October 09-11, 2002
• 15: Victor Ostromoukhov, Digital facial engraving, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.417-424, July 1999 [doi>10.1145/311535.311604]
• 16: Lenn Redman. How to Draw Caricatures. Contemporary Books, 1984.
• 17: Christian Rössl , Leif Kobbelt, Line-Art Rendering of 3D-Models, Proceedings of the 8th Pacific Conference on Computer Graphics and Applications, p.87, October 03-05, 2000
• 18: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.197-206, Aug. 1990
• 19: Michael P. Salisbury , Sean E. Anderson , Ronen Barzel , David H. Salesin, Interactive pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.101-108, July 1994 [doi>10.1145/192161.192185]
• 20: Michael P. Salisbury , Michael T. Wong , John F. Hughes , David H. Salesin, Orientable textures for image-based pen-and-ink illustration, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.401-406, August 1997 [doi>10.1145/258734.258890]
• 21: Y weiss. Interpreting images by propagating bayesian beliefs. pages 908--915, 1997.
• 22: Georges Winkenbach , David H. Salesin, Computer-generated pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.91-100, July 1994 [doi>10.1145/192161.192184]
• 23: Georges Winkenbach , David H. Salesin, Rendering parametric surfaces in pen and ink, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.469-476, August 1996 [doi>10.1145/237170.237287]

INDEX TERMS

Keywords:
Non Photorealistic Rendering, computer vision