The assumed light direction for perceiving shape from shading

ABSTRACT

Recovering 3D shape from shading is an ill-posed problem that the visual system can solve only by making use of additional information such as the position of the light source. Previous research has shown that people tend to assume light is above and slightly to the left of the object [Sun and Perona 1998]. We present a study to investigate whether the visual system also assumes the angle between the light direction and the viewing direction. We conducted a shape perception experiment in which subjects estimated surface orientation on smooth, virtual 3D shapes displayed monocularly using local Lambertian shading without cast shadows. We varied the angle between the viewing direction and the light direction within a range +/- 66 deg (above/below), and subjects indicated local surface orientation by rotating a gauge figure to appear normal to the surface [Koenderink et al. 1992]. Observer settings were more accurate and precise when the light was positioned above rather than below the viewpoint. Additionally, errors were minimized when the angle between the light direction and the viewing direction was 20--30 deg. Measurements of surface slant and tilt error support this result. These findings confirm the light-from-above prior and provide evidence that the angle between the viewing direction and the light direction is assumed to be 20--30 deg above the viewpoint.

REFERENCES

• 1: Adams, W., Graf, E., and Ernst, M. 2004. Experience can change the light-from-above prior. Nature Neuroscience 7, 10, 1057--1058.
• 2: Peter N. Belhumeur , David J. Kriegman , Alan L. Yuille, The Bas-Relief Ambiguity, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1060, June 17-19, 1997
• 3: Franck Caniard , Roland W. Fleming, Distortion in 3D shape estimation with changes in illumination, Proceedings of the 4th symposium on Applied perception in graphics and visualization, July 25-27, 2007, Tubingen, Germany [doi>10.1145/1272582.1272602]
• 4: Champion, R. A., and Adams, W. J. 2007. Modification of the convexity prior but not the light-from-above prior in visual search with shaded objects. Journal of Vision 7, 13 (10), 1--10.
• 5: R. L. Cook , K. E. Torrance, A Reflectance Model for Computer Graphics, ACM Transactions on Graphics (TOG), v.1 n.1, p.7-24, Jan. 1982 [doi>10.1145/357290.357293]
• 6: Doug DeCarlo , Adam Finkelstein , Szymon Rusinkiewicz , Anthony Santella, Suggestive contours for conveying shape, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 7: Stefan Gumhold, Maximum entropy light source placement, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
• 8: Hillis, J., Watt, S., Landy, M., and Banks, M. 2004. Slant from texture and disparity cues: Optimal cue combination. Journal of Vision 4, 12 (Dec.), 967--992.
• 9: Hoffman, D. M., Girshick, A. R., Akeley, K., and Banks, M. S. 2008. Vergenceaccommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3 (3), 1--30.
• 10: Koenderink, J., van Doorn, A., and Kappers, A. 1992. Surface perception in pictures. Perception and Psychophysics 5, 52, 487--496.
• 11: Koenderink, J., van Doorn, A., and Christou, C. 1996. Perturbation study of shading in pictures. Perception 25, 1009--1026.
• 12: Langer, M., and Bulthoff, H. 2001. A prior for global convexity in local shape-from-shading. Perception 30, 403--410.
• 13: Chang Ha Lee , Xuejun Hao , Amitabh Varshney, Geometry-Dependent Lighting, IEEE Transactions on Visualization and Computer Graphics, v.12 n.2, p.197-207, March 2006 [doi>10.1109/TVCG.2006.30]
• 14: Mamassian, P., and Goutcher, R. 2001. Prior knowledge on the illumination position. Cognition 81, B1--B9.
• 15: Mamassian, P., and Kersten, D. 1995. Illumination, shading and the perception of local orientation. Vision Research 36, 15, 2351--2367.
• 16: J. Oliensis, Shape from shading as a partially well-constrained problem, CVGIP: Image Understanding, v.54 n.2, p.163-183, Sept. 1991 [doi>10.1016/1049-9660(91)90061-S]
• 17: Michael Oren , Shree K. Nayar, Generalization of Lambert's reflectance model, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.239-246, July 1994 [doi>10.1145/192161.192213]
• 18: Bui Tuong Phong, Illumination for computer generated pictures, Communications of the ACM, v.18 n.6, p.311-317, June 1975 [doi>10.1145/360825.360839]
• 19: E. Prados , O. Faugeras, Shape from Shading: A Well-Posed Problem?, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2, p.870-877, June 20-26, 2005 [doi>10.1109/CVPR.2005.319]
• 20: Szymon Rusinkiewicz , Michael Burns , Doug DeCarlo, Exaggerated shading for depicting shape and detail, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 21: Shacked, R., and Lischinski, D. 2001. Automatic lighting design using a perceptual quality metric. In EG 2001 Proceedings, vol. 20(3). 215--226.
• 22: Stevens, K. A. 1983. Slant-tilt: The visual encoding of surface orientation. Biological Cybernetics 46, 183--195.
• 23: Sun, J., and Perona, P. 1998. Where is the sun? Nature Neuroscience 1, 3 (July), 183--184.
• 24: Torrance, K. E., and Sparrow, E. M. 1967. Theory for the off-specular reflection from roughened surfaces. Journal of the Optical Society of America 57, 9, 1105--1144.
• 25: Gregory J. Ward, Measuring and modeling anisotropic reflection, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.265-272, July 1992
• 26: Watt, S. J., Akeley, K., Ernst, M. O., and Banks, M. S. 2005. Focus cues affect perceived depth. Journal of Vision 5, 10 (Dec.), 834--862.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

General Terms:
Algorithms, Design, Experimentation, Measurement, Performance

Keywords:
Lambertian shading, light-from-above, shape perception, shape-from-shading