On seeing and rendering colour gradients

ABSTRACT

Ten years ago Greenberg and colleagues presented their framework for realistic image synthesis [Greenberg et al. 1997], aiming "to develop physically based lighting models and perceptually based rendering procedures for computer graphics that will produce synthetic images that are visually and measurably indistinguishable from real-world images", paraphrasing Sutherland's 'ultimate display' [Sutherland 1965]. They specifically encouraged vision researchers to use natural, complex and three-dimensional (3D) visual displays to get a better understanding of human vision and to develop more comprehensive visual models for computer graphics that will improve the efficiency of algorithms. In this paper we follow Greenberg et al.'s directive and analyse colour and luminance gradients in a complex 3D scene. The gradients arise from changes in the light source position and orientation of surfaces. Information in image gradients could apprise the visual system about intrinsic surface reflectance properties or extrinsic illumination phenomena, including shading, shadowing and inter-reflections. Colour gradients induced by inter-reflection may play a similar role to that of luminance gradients in shape-from-shading algorithms; it has been shown that 3D shape perception modulates the influence of inter-reflections on surface colour perception [Bloj et al. 1999]. Here we report a psychophysical study in which we tested whether observers were able to discriminate between gradients due to different light source positions and found that observers reliably detected a change in the gradient information when the light source position differed by only 4 deg from the reference scene (Experiment 1). This sensitivity was mainly based on the luminance information in the gradient (Experiment 2 and 3). We conclude that for a realistic impression of a scene a global illumination algorithm should model the luminance component of inter-reflections accurately, whereas it is less critical to accurately represent the spatial variation in chromaticity.

REFERENCES

• 1: Peter N. Belhumeur , David J. Kriegman , Alan L. Yuille, The Bas-Relief Ambiguity, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1060, June 17-19, 1997
• 2: Bijl, P., Koenderink, J., and Toet, A. 1989. Visibility of blobs with a Gaussian luminance profile. Vision Research, 29, 447--456.
• 3: Bloj, M. G., Kersten, D., and Hurlbert, A. C. 1999. Perception of three-dimensional shape influences colour perception through mutual illumination. Nature, 402, 877--879.
• 4: Bloj, M. G., Wolf, K., and Hurlbert, A. 2005. The perception of colour gradients {Abstract}. Journal of Vision, 2, 7, 154a.
• 5: Curran, W., and Johnston, A. 1994. Integration of shading and texture cues: testing the linear model. Vision Research, 34, 1863--1874.
• 6: Curran, W., and Johnston, A. 1996. The effect of illuminant position on perceived curvature. Vision Research, 36, 1399--1410.
• 7: Erens, R., Kappers, A., and Koenderink, J. 1993a. Estimating the Gradient Direction of a Luminance ramp. Vision Research, 33, 1639--1643.
• 8: Erens, R., Kappers, A., and Koenderink, J. 1993b. Perception of local shape from shading. Perception & Psychophysics, 54, 145--156.
• 9: D. Forsyth , A. Zisserman, Shape from shading in the light of mutual illumination, Image and Vision Computing, v.8 n.1, p.42-49, February 1990 [doi>10.1016/0262-8856(90)90055-A]
• 10: David Forsyth , Andrew Zisserman, Reflections on Shading, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.7, p.671-679, July 1991 [doi>10.1109/34.85657]
• 11: B. V. Funt , M. S. Drew, Color Space Analysis of Mutual Illumination, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.15 n.12, p.1319-1326, December 1993 [doi>10.1109/34.250838]
• 12: Brian V. Funt , Mark S. Drew , Michael Brockington, Recovering Shading from Color Images, Proceedings of the Second European Conference on Computer Vision, p.124-132, May 19-22, 1992
• 13: Donald P. Greenberg , Kenneth E. Torrance , Peter Shirley , James Arvo , Eric Lafortune , James A. Ferwerda , Bruce Walter , Ben Trumbore , Sumanta Pattanaik , Sing-Choong Foo, A framework for realistic image synthesis, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.477-494, August 1997 [doi>10.1145/258734.258914]
• 14: John Haddon , David Forsyth, Shading Primitives: Finding Folds and Shallow Grooves, Proceedings of the Sixth International Conference on Computer Vision, p.236, January 04-07, 1998
• 15: Berthold K. P. Horn , Michael J. Brooks, The variational approach to shape from shading, Computer Vision, Graphics, and Image Processing, v.33 n.2, p.174-208, Feb. 1986 [doi>10.1016/0734-189X(86)90114-3]
• 16: Ikeuchi, K., and Horn, B. K. P. 1981. Numerical Shape from Shading and Occluding Boundaries. Artifical Intelligence, 17, 141--184.
• 17: Knill, D. C., and Kersten, D. 1991. Apparent surface curvature affects lightness perception. Nature, 351, 228--230.
• 18: M. S. Langer, When Shadows Become Interreflections, International Journal of Computer Vision, v.34 n.2-3, p.193-204, Nov. 1999 [doi>10.1023/A:1008131719047]
• 19: Langer, M. S. 2001. A Model of How Interreflections Can Affect Color Appearance. Color Research and Application, 26(S1), 218--221.
• 20: MacAdam, D. L. 1942. Visual sensitivities to color differences in daylight. Journal of the Optical Society of America, 32, 247.
• 21: Macmillan, N. A., and Creelman, C. D. 2005. Detection Theory: A User's Guide (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
• 22: Madison, C., Thompson, W., Kersten, D., Shirley, P., and Smits, B. 2001. Use of interreflection and shadow for surface contact. Perception & Psychophysics, 63, 187--194.
• 23: McCann, J. J., Savoy, R. L., Hall, J. A., and Scarpetti, J. J. 1974. Visibility of Continuous Luminance Gradients. Vision Research, 14, 917--927.
• 24: Mullen, K. T. 1985. The Contrast Sensitivity of Human Colour Vision to Red-green and Blue-yellow Chromatic Gratings. Journal of Physiology, 359, 381--400.
• 25: Shree K. Nayar , Katsushi Ikeuchi , Takeo Kanade, Shape from interreflections, International Journal of Computer Vision, v.6 n.3, p.173-195, Aug. 1991 [doi>10.1007/BF00115695]
• 26: Pentland, A. P. 1982. Finding the Illuminant direction. Journal of the Optical Society of America, 72, 448--455.
• 27: Pentland, A. P. 1984. Local Shading Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 170--187.
• 28: Pokorny, J., and Smith, V. C. 1986. Colorimetry and color discrimination. In K. R. Boff, L. Kaufmann and J. P. Thomas (Eds.), Handbook of Perception (pp. 8--1 - 8--51). Ney York: John Wiley & Sons.
• 29: Ramachandran, V. S. 1988. Perception of shape from shading. Nature, 331, 163--166.
• 30: Ruppertsberg, A. I., and Bloj, M. 2006. Rendering complex scenes for psychophysics with RADIANCE: How accurate can you get? Journal of the Optical Society of America A, 23, 4, 759--768.
• 31: Ruppertsberg, A. I., and Bloj, M. 2007. Creating physically accurate visual stimuli for free: Spectral rendering with RADIANCE. Behavior Research Methods, in press.
• 32: Ruppertsberg, A. I., Mayat, F., Hurlbert, A., and Bloj, M. 2004. Sensitivity to colour gradients and its dependence on complexity of surround. Perception, 34, 248--249.
• 33: Shafer, S. A. 1985. Shadows and Silhouettes in Computer Vision. Boston: Kluwer Academic Publishers.
• 34: Sutherland, I. E. 1965. The ultimate display. Paper presented at the Proceedings of the IFIP Congress, 506--508.
• 35: Todd, J. T., and Mingolla, E. 1983. Perception of surface curvature and direction of illuminations from patterns of shading. Journal of Experimental Psychology: Human Perception, 9, 583--595.
• 36: Waltz, D. 1975. Understanding line drawings of Scenes with shadows. In P. Winston (Ed.), The Psychology of Computer Vision (pp. 19--91). New York: McGraw Hill.
• 37: Gregory J. Ward, The RADIANCE lighting simulation and rendering system, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.459-472, July 1994 [doi>10.1145/192161.192286]
• 38: Wright, W. D., and Pitt, F. H. G. 1934. Hue-discrimination in normal colour-vision. Proceedings of the Physical Society, 46, 459--473.
• 39: Wyszecki, G., and Stiles, W. S. 2000. Color Science (2 ed.). New York: John Wiley & Sons.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Additional Classification:
  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

Keywords:
RADIANCE, colour accuracy, global illumination, gradients, human vision, inter-reflections, luminance, psychophysics, shading, visual perception