Hatching by example: a statistical approach

ABSTRACT

We present a new approach to synthetic (computer-aided) drawing with patches of strokes. Grouped strokes convey the local intensity level that is desired in drawing. The key point of our approach is learning by example: the system does not know a priori the distribution of the strokes. Instead, by analyzing a sample (training) patch of strokes, our system is able to synthesize freely an arbitrary sequence of strokes that "looks like" the given sample. Strokes are considered as parametrical curves represented by a vector of random variables following a Markovian distribution. Our method is based on Shannon's N-gram approach and is a direct extension of Efros's texture synthesis models [EL99; EF01]. Nevertheless, one major difference between our method and traditional texture synthesis is the use of such curves as a basic element instead of pixels. We define a statistical metric for comparison between different patches containing various layouts of strokes. We hope that our method performs a first step towards capturing a very difficult notion of style in drawing --- hatching style in our case. We illustrate our method by varied examples, ranging from typical hatching in traditional drawing to highly heterogeneous sets of strokes.

REFERENCES

• 1: Michael Ashikhmin, Synthesizing natural textures, Proceedings of the 2001 symposium on Interactive 3D graphics, p.217-226, March 2001 [doi>10.1145/364338.364405]
• 2: R. E. Bellman. Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton, New Jersey, U.S.A., 1961.
• 3: Y. Bengio. Markovian models for sequential data. Neural Computing Surveys, 2:129-162, 1999.
• 4: Christopher M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, Inc., New York, NY, 1995
• 5: H. Chen, Y. Xu, H.-Y. Shum, S. C. Zhu, and N. Zheng. Example-Based facial sketch generation with non-parametric sampling. In Proceedings of the Eighth International Conference On Computer Vision (ICCV-01), pages 433-438, Los Alamitos, CA, July 9-12 2001. IEEE Computer Society.
• 6: Debra Dooley , Michael F. Cohen, Automatic illustration of 3D geometric models: lines, Proceedings of the 1990 symposium on Interactive 3D graphics, p.77-82, February 1990, Snowbird, Utah, United States
• 7: Frédo Durand , Victor Ostromoukhov , Mathieu Miller , Francois Duranleau , Julie Dorsey, Decoupling Strokes and High-Level Attributes for Interactive Traditional Drawing, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.71-82, June 25-27, 2001
• 8: Alexei A. Efros , William T. Freeman, Image quilting for texture synthesis and transfer, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.341-346, August 2001 [doi>10.1145/383259.383296]
• 9: Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999
• 10: Gershon Elber, Line Art Rendering via a Coverage of Isoparametric Curves, IEEE Transactions on Visualization and Computer Graphics, v.1 n.3, p.231-239, September 1995 [doi>10.1109/2945.466718]
• 11: G. Elber. Interactive line art rendering of freeformsurfaces. In P. Brunet and R. Scopigno, editors, Computer Graphics Forum (Eurographics '99), volume 18(3), pages 1-12. The Eurographics Association and Blackwell Publishers, 1999.
• 12: Emil Praun , Hugues Hoppe , Matthew Webb , Adam Finkelstein, Real-time hatching, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.581, August 2001 [doi>10.1145/383259.383328]
• 13: W. T. Freeman, J. B. Tenenbaum, and E. Pasztor. An example-based approach tp style traslation for line drawings. Technical Report TR-99-11, MERL - A Mitsubishi Electric Research Laboratory, 1999.
• 14: Bruce Gooch , Amy Gooch, Non-Photorealistic Rendering, A. K. Peters, Ltd., Natick, MA, 2001
• 15: Bruce Gooch , Amy Gooch, Non-Photorealistic Rendering, A. K. Peters, Ltd., Natick, MA, 2001
• 16: Paul Haeberli, Paint by numbers: abstract image representations, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.207-214, Aug. 1990
• 17: J. Hamel and T. Strothotte. Capturing and re-using rendition styles for non-photorealistic rendering. In P. Brunet and R. Scopigno, editors, Computer Graphics Forum (Eurographics '99), volume 18(3), pages 173-182. The Eurographics Association and Blackwell Publishers, 1999.
• 18: Aaron Hertzmann , Denis Zorin, Illustrating smooth surfaces, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.517-526, July 2000 [doi>10.1145/344779.345074]
• 19: C. Reynolds. Stylized depiction in computer graphics non-photorealistic, painterly and 'toon rendering. An annotated survey of online resources, http://www.red3d.com/cwr/npr/, 2001.
• 20: Christian Rössl , Leif Kobbelt, Line-Art Rendering of 3D-Models, Proceedings of the 8th Pacific Conference on Computer Graphics and Applications, p.87, October 03-05, 2000
• 21: Michael P. Salisbury , Sean E. Anderson , Ronen Barzel , David H. Salesin, Interactive pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.101-108, July 1994 [doi>10.1145/192161.192185]
• 22: Mike Salisbury , Corin Anderson , Dani Lischinski , David H. Salesin, Scale-dependent reproduction of pen-and-ink illustrations, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.461-468, August 1996 [doi>10.1145/237170.237286]
• 23: Mario Costa Sousa and John W. Buchanan. Computer-Generated Graphite Pencil Rendering of 3D Polygonal Models. In Proceedings of EuroGraphics'99, pages C195-C207, 1999.
• 24: C. E. Shannon. Prediction and entropy of printed english. Bell Systems Technical Journal, 30:50-64, January 1951.
• 25: B. W. Silverman. Density Estimation for Statistics and Data Analysis. Chapman & Hall, London, 1986.
• 26: T. Strothotte, B. Preim, A. Raab, J. Schumann, and D. R. Forsey. How to render frames and influence people. Eurographics 94, 13(3):C/455-C/466, 1994.
• 27: Michael P. Salisbury , Michael T. Wong , John F. Hughes , David H. Salesin, Orientable textures for image-based pen-and-ink illustration, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.401-406, August 1997 [doi>10.1145/258734.258890]
• 28: Joshua B. Tenenbaum , William T. Freeman, Separating Style and Content with Bilinear Models, Neural Computation, v.12 n.6, p.1247-1283, June 2000 [doi>10.1162/089976600300015349]
• 29: Li-Yi Wei , Marc Levoy, Fast texture synthesis using tree-structured vector quantization, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.479-488, July 2000 [doi>10.1145/344779.345009]
• 30: Li-Yi Wei , Marc Levoy, Texture synthesis over arbitrary manifold surfaces, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.355-360, August 2001 [doi>10.1145/383259.383298]
• 31: Georges Winkenbach , David H. Salesin, Computer-generated pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.91-100, July 1994 [doi>10.1145/192161.192184]
• 32: Georges Winkenbach , David H. Salesin, Rendering parametric surfaces in pen and ink, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.469-476, August 1996 [doi>10.1145/237170.237287]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  G. Mathematics of Computing
  G.3 PROBABILITY AND STATISTICS
      Subjects: Statistical computing

General Terms:
Algorithms