How well do line drawings depict shape?

ABSTRACT

This paper investigates the ability of sparse line drawings to depict 3D shape. We perform a study in which people are shown an image of one of twelve 3D objects depicted with one of six styles and asked to orient a gauge to coincide with the surface normal at many positions on the object's surface. The normal estimates are compared with each other and with ground truth data provided by a registered 3D surface model to analyze accuracy and precision. The paper describes the design decisions made in collecting a large data set (275,000 gauge measurements) and provides analysis to answer questions about how well people interpret shapes from drawings. Our findings suggest that people interpret certain shapes almost as well from a line drawing as from a shaded image, that current computer graphics line drawing techniques can effectively depict shape and even match the effectiveness of artist's drawings, and that errors in depiction are often localized and can be traced to particular properties of the lines used. The data collected for this study will become a publicly available resource for further studies of this type.

REFERENCES

• 1: Maneesh Agrawala , Doantam Phan , Julie Heiser , John Haymaker , Jeff Klingner , Pat Hanrahan , Barbara Tversky, Designing effective step-by-step assembly instructions, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 2: Peter N. Belhumeur , David J. Kriegman , Alan L. Yuille, The Bas-Relief Ambiguity, International Journal of Computer Vision, v.35 n.1, p.33-44, Nov. 1999 [doi>10.1023/A:1008154927611]
• 3: Franck Caniard , Roland W. Fleming, Distortion in 3D shape estimation with changes in illumination, Proceedings of the 4th symposium on Applied perception in graphics and visualization, July 25-27, 2007, Tubingen, Germany [doi>10.1145/1272582.1272602]
• 4: Cole, F., Decarlo, D., Finkelstein, A., Kin, K., Morley, K., and Santella, A. 2006. Directing gaze in 3D models with stylized focus. Eurographics Symposium on Rendering (June), 377--387.
• 5: Forrester Cole , Aleksey Golovinskiy , Alex Limpaecher , Heather Stoddart Barros , Adam Finkelstein , Thomas Funkhouser , Szymon Rusinkiewicz, Where do people draw lines?, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008
• 6: Paul Debevec, Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.189-198, July 1998 [doi>10.1145/280814.280864]
• 7: Doug DeCarlo , Szymon Rusinkiewicz, Highlight lines for conveying shape, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274881]
• 8: Doug DeCarlo , Adam Finkelstein , Szymon Rusinkiewicz , Anthony Santella, Suggestive contours for conveying shape, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 9: Doug DeCarlo , Adam Finkelstein , Szymon Rusinkiewicz, Interactive rendering of suggestive contours with temporal coherence, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France [doi>10.1145/987657.987661]
• 10: Fleming, R. W., Torralba, A., and Adelson, E. H. 2004. Specular reflections and the perception of shape. Journal of Vision 4, 9, 798--820.
• 11: Fulvio, J. M., Singh, M., and Maloney, L. T. 2006. Combining achromatic and chromatic cues to transparency. Journal of Vision 6, 8, 760--776.
• 12: Bruce Gooch , Erik Reinhard , Amy Gooch, Human facial illustrations: Creation and psychophysical evaluation, ACM Transactions on Graphics (TOG), v.23 n.1, p.27-44, January 2004 [doi>10.1145/966131.966133]
• 13: Aaron Hertzmann , Denis Zorin, Illustrating smooth surfaces, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.517-526, July 2000 [doi>10.1145/344779.345074]
• 14: Victoria Interrante , Henry Fuchs , Stephen Pizer, Enhancing Transparent Skin Surfaces with Ridge and Valley Lines, Proceedings of the 6th conference on Visualization '95, p.52, October 29-November 03, 1995
• 15: Tobias Isenberg , Petra Neumann , Sheelagh Carpendale , Mario Costa Sousa , Joaquim A. Jorge, Non-photorealistic rendering in context: an observational study, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France [doi>10.1145/1124728.1124747]
• 16: Tilke Judd , Frédo Durand , Edward Adelson, Apparent ridges for line drawing, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 17: Kaplan, M., and Cohen, E. 2006. Producing models from drawings of curved surfaces. In Eurographics Workshop on Sketch-Based Interfaces and Modeling, 51--58.
• 18: Koenderink, J. J., van Doorn, A., and Kappers, A. 1992. Surface perception in pictures. Perception and Psychophysics 52, 487--496.
• 19: Koenderink, J. J., van Doorn, A., Christou, C., and Lappin, J. 1996. Shape constancy in pictorial relief. Perception 25, 155--164.
• 20: Koenderink, J. J., van Doorn, A., Kappers, A. M., and Todd, J. T. 2001. Ambiguity and the 'mental eye' in pictorial relief. Perception 30, 431--448.
• 21: Koenderink, J. J. 1984. What does the occluding contour tell us about solid shape? Perception 13, 321--330.
• 22: Michael Kolomenkin , Ilan Shimshoni , Ayellet Tal, Demarcating curves for shape illustration, ACM Transactions on Graphics (TOG), v.27 n.5, December 2008
• 23: Langer, M. S., and Bülthoff, H. H. 2001. A prior for global convexity in local shape-from-shading. Perception 30, 4, 403--410.
• 24: Yunjin Lee , Lee Markosian , Seungyong Lee , John F. Hughes, Line drawings via abstracted shading, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 25: Malik, J. 1987. Interpreting line drawings of curved objects. International Journal of Computer Vision 1, 1, 73--103.
• 26: Mamassian, P., and Landy, M. S. 1998. Observer biases in the 3d interpretation of line drawings. Vision Research 38.
• 27: Lee Markosian , Michael A. Kowalski , Daniel Goldstein , Samuel J. Trychin , John F. Hughes , Lubomir D. Bourdev, Real-time nonphotorealistic rendering, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.415-420, August 1997 [doi>10.1145/258734.258894]
• 28: Jason L. Mitchell , Moby Francke , Dhabih Eng, Illustrative rendering in Team Fortress 2, ACM SIGGRAPH 2007 courses, August 05-09, 2007, San Diego, California [doi>10.1145/1281500.1281666]
• 29: Yutaka Ohtake , Alexander Belyaev , Hans-Peter Seidel, Ridge-valley lines on meshes via implicit surface fitting, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 30: James P. O'Shea , Martin S. Banks , Maneesh Agrawala, The assumed light direction for perceiving shape from shading, Proceedings of the 5th symposium on Applied perception in graphics and visualization, August 09-10, 2008, Los Angeles, California [doi>10.1145/1394281.1394306]
• 31: Pauly, M., Keiser, R., and Gross, M. 2003. Multi-scale feature extraction on point-sampled surfaces. Computer Graphics Forum 22, 3 (Sept.), 281--290.
• 32: Phillips, F., Todd, J. T., Koenderink, J. J., and Kappers, A. M. 2003. Perceptual representation of visible surfaces. Perception and Psychophysics 65, 5, 747--762.
• 33: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA
• 34: Anthony Santella , Doug DeCarlo, Visual interest and NPR: an evaluation and manifesto, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France [doi>10.1145/987657.987669]
• 35: Jean-Philippe Thirion , Alexis Gourdon, The 3D marching lines algorithm, Graphical Models and Image Processing, v.58 n.6, p.503-509, Nov. 1996 [doi>10.1006/gmip.1996.0042]
• 36: Todd, J. T., Koenderink, J. J., van Doorn, A. J., and Kappers, A. M. 1996. Effects of changing viewing conditions on the perceived structure of smoothly curved surfaces. Journal of Experimental Psychology: Human Perception and Performance 22, 695--706.
• 37: Christian Wallraven , Heinrich H. Bülthoff , Douglas W. Cunningham , Jan Fischer , Dirk Bartz, Evaluation of real-world and computer-generated stylized facial expressions, ACM Transactions on Applied Perception (TAP), v.4 n.3, p.16-es, November 2007 [doi>10.1145/1278387.1278390]
• 38: Waltz, D. L. 1975. Understanding line drawings of scenes with shadows. In The Psychology of Computer Vision, P. Winston, Ed. McGraw-Hill, 19--92.
• 39: Willats, J. 1997. Art and Representation: New Principles in the Analysis of Pictures. Princeton University Press.
• 40: Holger Winnemöller , David Feng , Bruce Gooch , Satoru Suzuki, Using NPR to evaluate perceptual shape cues in dynamic environments, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274885]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Line and curve generation

Additional Classification:
  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems
          Subjects: Geometrical problems and computations

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
      I.3.7 Three-Dimensional Graphics and Realism
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis
      I.6.5 Model Development
          Subjects: Modeling methodologies

General Terms:
Algorithms, Design, Measurement, Performance

Keywords:
line drawings, non-photorealism, shape perception