Line-art illustration of dynamic and specular surfaces

ABSTRACT

Line-art illustrations are effective tools for conveying shapes and shading of complex objects. We present a set of new algorithms to render line-art illustrations of dynamic and specular (reflective and refractive) surfaces. We first introduce a real-time principal direction estimation algorithm to determine the line stroke directions on dynamic opaque objects using neighboring normal ray triplets. To render reflections or refractions in a line-art style, we develop a stroke direction propagation algorithm by using multi-perspective projections to propagate the stroke directions from the nearby opaque objects onto specular surfaces. Finally, we present an image-space stroke mapping method to draw line strokes using the computed or propagated stroke directions. We implement these algorithms using a GPU and demonstrate real-time illustrations of scenes with dynamic and specular 3D models in line-art styles.

REFERENCES

• 1: Alberto Bartesaghi , Guillermo Sapiro , Tom Malzbender , Dan Gelb, Three-dimensional shape rendering from multiple images, Graphical Models, v.67 n.4, p.332-346, July 2005 [doi>10.1016/j.gmod.2005.02.002]
• 2: David Blythe, The Direct3D 10 system, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 3: Simon Breslav , Karol Szerszen , Lee Markosian , Pascal Barla , Joëlle Thollot, Dynamic 2D patterns for shading 3D scenes, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 4: F. Cazals , M. Pouget, Estimating differential quantities using polynomial fitting of osculating jets, Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, June 23-25, 2003, Aachen, Germany
• 5: David Cohen-Steiner , Jean-Marie Morvan, Restricted delaunay triangulations and normal cycle, Proceedings of the nineteenth annual symposium on Computational geometry, June 08-10, 2003, San Diego, California, USA [doi>10.1145/777792.777839]
• 6: Scott T Davis , Chris Wyman, Interactive refractions with total internal reflection, Proceedings of Graphics Interface 2007, May 28-30, 2007, Montreal, Canada [doi>10.1145/1268517.1268548]
• 7: Diepstraten, J., and Ertl, T. 2004. Interactive rendering of reflective and transmissive surfaces in 3D toon shading. In Proc. GI Workshop Methoden und Werkzeuge zukuenftiger Computer-spiele 2004, 144--148.
• 8: William Donnelly , Andrew Lauritzen, Variance shadow maps, Proceedings of the 2006 symposium on Interactive 3D graphics and games, March 14-17, 2006, Redwood City, California [doi>10.1145/1111411.1111440]
• 9: Gershon Elber, Line Art Illustrations of Parametric and Implicit Forms, IEEE Transactions on Visualization and Computer Graphics, v.4 n.1, p.71-81, January 1998 [doi>10.1109/2945.675655]
• 10: Fleming, R. W., Torralba, A., and Adelson, E. H. 2004. Specular reflections and the perception of shape. Journal of Vision 4, 9, 798--820.
• 11: Gatzke, T., and Grimm, C. 2006. Estimating curvature on triangular meshes. International Journal of Shape Modeling 12, 1, 1--29.
• 12: Ahna Girshick , Victoria Interrante , Steven Haker , Todd Lemoine, Line direction matters: an argument for the use of principal directions in 3D line drawings, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.43-52, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340922]
• 13: Jack Goldfeather , Victoria Interrante, A novel cubic-order algorithm for approximating principal direction vectors, ACM Transactions on Graphics (TOG), v.23 n.1, p.45-63, January 2004 [doi>10.1145/966131.966134]
• 14: Grinspun, E., Gingold, Y., Reisman, J., and Zorin, D. 2006. Computing discrete shape operators on general meshes. Computer Graphics Forum 25, 3, 547--556.
• 15: Aaron Hertzmann , Denis Zorin, Illustrating smooth surfaces, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.517-526, July 2000 [doi>10.1145/344779.345074]
• 16: Henry Kang , Seungyong Lee , Charles K. Chui, Coherent line drawing, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274878]
• 17: Adam Lake , Carl Marshall , Mark Harris , Marc Blackstein, Stylized rendering techniques for scalable real-time 3D animation, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.13-20, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340918]
• 18: Hyunjun Lee , Sungtae Kwon , Seungyong Lee, Real-time pencil rendering, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France [doi>10.1145/1124728.1124735]
• 19: Leister, W. 1994. Computer generated copper plates. Computer Graphics Forum 13, 1, 69--77.
• 20: Meyer, M., Desbrun, M., Schröder, P., and Barr, A. H. 2003. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and Mathematics III. Springer, 35--57.
• 21: Nienhaus, M., and Doellner, J. 2003. Edge-enhancement -- an algorithm for real-time non-photorealistic rendering. International Winter School of Computer Graphics, Journal of WSCG 11, 2, 346--353.
• 22: Computational Line Geometry, Springer-Verlag New York, Inc., Secaucus, NJ, 2001
• 23: Emil Praun , Hugues Hoppe , Matthew Webb , Adam Finkelstein, Real-time hatching, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.581, August 2001 [doi>10.1145/383259.383328]
• 24: Szymon Rusinkiewicz, Estimating Curvatures and Their Derivatives on Triangle Meshes, Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium, p.486-493, September 06-09, 2004 [doi>10.1109/3DPVT.2004.54]
• 25: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA
• 26: Michael P. Salisbury , Michael T. Wong , John F. Hughes , David H. Salesin, Orientable textures for image-based pen-and-ink illustration, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.401-406, August 1997 [doi>10.1145/258734.258890]
• 27: Ryan Schmidt , Tobias Isenberg , Pauline Jepp , Karan Singh , Brian Wyvill, Sketching, scaffolding, and inking: a visual history for interactive 3D modeling, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274875]
• 28: Noah Snavely , C. Lawrence Zitnick , Sing Bing Kang , Michael Cohen, Stylizing 2.5-D video, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France [doi>10.1145/1124728.1124739]
• 29: G. Taubin, Estimating the tensor of curvature of a surface from a polyhedral approximation, Proceedings of the Fifth International Conference on Computer Vision, p.902, June 20-23, 1995
• 30: Corey Toler-Franklin , Adam Finkelstein , Szymon Rusinkiewicz, Illustration of complex real-world objects using images with normals, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274889]
• 31: Umenhoffer, T. 2007. Robust multiple specular reflections and refractions. In GPU Gems 3. Addison Wesley, ch. 17, 387--407.
• 32: Matthew Webb , Emil Praun , Adam Finkelstein , Hugues Hoppe, Fine tone control in hardware hatching, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France [doi>10.1145/508530.508540]
• 33: Ulrich Weidenbacher , Pierre Bayerl , Heiko Neumann , Roland Fleming, Sketching shiny surfaces: 3D shape extraction and depiction of specular surfaces, ACM Transactions on Applied Perception (TAP), v.3 n.3, p.262-285, July 2006 [doi>10.1145/1166087.1166094]
• 34: Georges Winkenbach , David H. Salesin, Computer-generated pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.91-100, July 1994 [doi>10.1145/192161.192184]
• 35: Georges Winkenbach , David H. Salesin, Rendering parametric surfaces in pen and ink, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.469-476, August 1996 [doi>10.1145/237170.237287]
• 36: Jingyi Yu , Leonard McMillan, Multiperspective Projection and Collineation, Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, p.580-587, October 17-20, 2005 [doi>10.1109/ICCV.2005.161]
• 37: Jingyi Yu , Xiaotian Yin , Xianfeng Gu , Leonard McMillan , Steven Gortler, Focal surfaces of discrete geometry, Proceedings of the fifth Eurographics symposium on Geometry processing, July 04-06, 2007, Barcelona, Spain
• 38: Xuan Yu , Feng Li , Jingyi Yu, Image-Space Caustics and Curvatures, Proceedings of the 15th Pacific Conference on Computer Graphics and Applications, p.181-188, October 29-November 02, 2007 [doi>10.1109/PG.2007.36]
• 39: Zander, J., Isenberg, T., Schlechtweg, S., and Strothotte, T. 2004. High quality hatching. Computer Graphics Forum 23, 3, 421--430.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Keywords:
dynamic surfaces, hatching, line-art illustration, principal direction, real-time rendering, reflection and refraction