Light warping for enhanced surface depiction

ABSTRACT

Recent research on the human visual system shows that our perception of object shape relies in part on compression and stretching of the reflected lighting environment onto its surface. We use this property to enhance the shape depiction of 3D objects by locally warping the environment lighting around main surface features. Contrary to previous work, which require specific illumination, material characteristics and/or stylization choices, our approach enhances surface shape without impairing the desired appearance.

Thanks to our novel local shape descriptor, salient surface features are explicitly extracted in a view-dependent fashion at various scales without the need of any pre-process. We demonstrate our system on a variety of rendering settings, using object materials ranging from diffuse to glossy, to mirror or refractive, with direct or global illumination, and providing styles that range from photorealistic to non-photorealistic. The warping itself is very fast to compute on modern graphics hardware, enabling real-time performance in direct illumination scenarios.

REFERENCES

• 1: Michael Ashikmin , Simon Premože , Peter Shirley, A microfacet-based BRDF generator, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.65-74, July 2000 [doi>10.1145/344779.344814]
• 2: Cignoni, P., Scopigno, R., and Tarini, M. 2005. A simple Normal Enhancement technique for Interactive Non-photorealistic Renderings. Comp. & Graph. 29, 1, 125--133.
• 3: Forrester Cole , Aleksey Golovinskiy , Alex Limpaecher , Heather Stoddart Barros , Adam Finkelstein , Thomas Funkhouser , Szymon Rusinkiewicz, Where do people draw lines?, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008
• 4: Doug DeCarlo , Adam Finkelstein , Szymon Rusinkiewicz , Anthony Santella, Suggestive contours for conveying shape, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 5: Philip Dutre , Kavita Bala , Philippe Bekaert , Peter Shirley, Advanced Global Illumination, AK Peters Ltd, 2006
• 6: Fleming, R. W., Torralba, A., and Adelson, E. H. 2004. Specular reflections and the perception of shape. J. Vis. 4, 9 (9), 798--820.
• 7: Fleming, R. W., Torralba, A., and Adelson, E. H. 2009. Three dimensional shape perception. Springer Verlag, ch. Shape from sheen. to appear.
• 8: Amy Gooch , Bruce Gooch , Peter Shirley , Elaine Cohen, A non-photorealistic lighting model for automatic technical illustration, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.447-452, July 1998 [doi>10.1145/280814.280950]
• 9: Todd Goodwin , Ian Vollick , Aaron Hertzmann, Isophote distance: a shading approach to artistic stroke thickness, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274880]
• 10: Ho, Y.-X., Landy, M. S., and Maloney, L. T. 2006. How direction of illumination affects visually perceived surface roughness. J. Vis. 6, 5 (5), 634--648.
• 11: Hodges, E. R. S. 2003. The Guild Handbook of Scientific Illustration. Wiley.
• 12: Hogarth, B. 1991. Dynamic Light and Shade. Watson Guptill.
• 13: Tilke Judd , Frédo Durand , Edward Adelson, Apparent ridges for line drawing, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 14: Gordon Kindlmann , Ross Whitaker , Tolga Tasdizen , Torsten Moller, Curvature-Based Transfer Functions for Direct Volume Rendering: Methods and Applications, Proceedings of the 14th IEEE Visualization 2003 (VIS'03), p.67, October 22-24, 2003 [doi>10.1109/VISUAL.2003.1250414]
• 15: Michael Kolomenkin , Ilan Shimshoni , Ayellet Tal, Demarcating curves for shape illustration, ACM Transactions on Graphics (TOG), v.27 n.5, December 2008
• 16: Krivánek, J., and Colbert, M. 2008. Real-time shading with filtered importance sampling. Comp. Graph. Forum (Proc. EUROGRAPHICS Symposium on Rendering 2008) 27, 4.
• 17: Langer, M., and Bülthoff, H. H. 1999. Perception of shape from shading on a cloudy day. Tech. Rep. 73, Tübingen, Germany, oct.
• 18: Chang Ha Lee , Xuejun Hao , Amitabh Varshney, Geometry-Dependent Lighting, IEEE Transactions on Visualization and Computer Graphics, v.12 n.2, p.197-207, March 2006 [doi>10.1109/TVCG.2006.30]
• 19: Yunjin Lee , Lee Markosian , Seungyong Lee , John F. Hughes, Line drawings via abstracted shading, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 20: Gavin Miller, Efficient algorithms for local and global accessibility shading, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.319-326, July 1994 [doi>10.1145/192161.192244]
• 21: Marc Nienhaus , Jürgen Döllner, Blueprints: illustrating architecture and technical parts using hardware-accelerated non-photorealistic rendering, Proceedings of Graphics Interface 2004, p.49-56, May 17-19, 2004, London, Ontario, Canada
• 22: Yutaka Ohtake , Alexander Belyaev , Hans-Peter Seidel, Ridge-valley lines on meshes via implicit surface fitting, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 23: Ostrovsky, Y., Cavanagh, P., and Sinha, P. 2001. Perceiving Illumination Inconsistencies in Scenes. In MIT AIM.
• 24: P. Perona , J. Malik, Scale-Space and Edge Detection Using Anisotropic Diffusion, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.7, p.629-639, July 1990 [doi>10.1109/34.56205]
• 25: Pharr, M., and Green, S. 2004. GPU Gems. Addison-Wesley, ch. Ambient Occlusion.
• 26: Ravi Ramamoorthi , Dhruv Mahajan , Peter Belhumeur, A first-order analysis of lighting, shading, and shadows, ACM Transactions on Graphics (TOG), v.26 n.1, p.2-es, January 2007 [doi>10.1145/1189762.1189764]
• 27: Tobias Ritschel , Kaleigh Smith , Matthias Ihrke , Thorsten Grosch , Karol Myszkowski , Hans-Peter Seidel, 3D unsharp masking for scene coherent enhancement, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008
• 28: Szymon Rusinkiewicz , Michael Burns , Doug DeCarlo, Exaggerated shading for depicting shape and detail, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 29: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA
• 30: Tarr, M. J., Kersten, D., and Bülthoff, H. H. 1998. Why the visual recognition system might encode the effects of illumination. Vision Reseach 28, 2259--2275.
• 31: Corey Toler-Franklin , Adam Finkelstein , Szymon Rusinkiewicz, Illustration of complex real-world objects using images with normals, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274889]
• 32: Romain Vergne , Pascal Barla , Xavier Granier , Christophe Schlick, Apparent relief: a shape descriptor for stylized shading, Proceedings of the 6th international symposium on Non-photorealistic animation and rendering, June 09-11, 2008, Annecy, France [doi>10.1145/1377980.1377987]
• 33: Holger Winnemöller , Sven C. Olsen , Bruce Gooch, Real-time video abstraction, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 34: Wood, P. 1994. Scientific Illustration: A Guide to Biological, Zoological, and Medical Rendering Techniques, Design, Printing, and Display, 2^nd ed. John Wiley and Sons, Inc., New York.
• 35: Long Zhang , Ying He , Xuexiang Xie , Wei Chen, Laplacian lines for real-time shape illustration, Proceedings of the 2009 symposium on Interactive 3D graphics and games, February 27-March 01, 2009, Boston, Massachusetts [doi>10.1145/1507149.1507170]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Curve, surface, solid, and object representations

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: 3D/stereo scene analysis
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.7 Feature Measurement
  I.5 PATTERN RECOGNITION
      I.5.2 Design Methodology
          Subjects: Feature evaluation and selection

General Terms:
Algorithms, Design, Measurement