Extracting and depicting the 3D shape of specular surfaces

ABSTRACT

Many materials including water, plastic and metal have specular surface characteristics. Specular reflections have commonly been considered a nuisance for the recovery of object shape. However, the way that reflections are distorted across the surface depends crucially on 3D curvature, suggesting that they could in fact be a useful source of information. Indeed, observers can have a vivid impression of 3D shape when an object is perfectly mirrored (i.e. the image contains nothing but specular reflections). This leads to the question what are the underlying mechanisms of our visual system to extract this 3D shape information from a perfectly mirrored object. In this paper we propose a biologically motivated recurrent model for the extraction of visual features relevant for the perception of 3D shape information from images of mirrored objects. We analyze qualitatively and quantitatively the results of computational model simulations and show that bidirectional recurrent information processing leads to better results then pure feedforward processing. Furthermore we utilize the model output to create a rough non-photorealistic sketch representation of a mirrored object, which emphasizes image features that are mandatory for 3D shape perception (e.g. occluding contour, regions of high curvature). Moreover, this sketch illustrates that the model generates a representation of object features independent of the surrounding scene reflected in the mirrored object.

REFERENCES

• 1: Attneave, F. 1954. Some informational aspects of visual perception. Psychological Review 61, 183--193.
• 2: Bullier, J. H., McCourt, M. E., and Henry., G. H. 1988. Physiological studies of the feedback connection to the striate cortex from areas 18 and 19 of the cat. Exp. Brain Res. 70, 90--98.
• 3: Daugman, J. 1988. Complete discrete 2d gabor transforms by neural networks for image analysis and compression. Trans. Acoustics, Speech, and Signal Proc. 36, 7, 1169--1179.
• 4: Paul Debevec , Tim Hawkins , Chris Tchou , Haarm-Pieter Duiker , Westley Sarokin , Mark Sagar, Acquiring the reflectance field of a human face, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.145-156, July 2000 [doi>10.1145/344779.344855]
• 5: Paul Debevec, Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.189-198, July 1998 [doi>10.1145/280814.280864]
• 6: Do Carmo, M. P. 1976. Differential Geometry of Curves and Surfaces. Prentice Hall.
• 7: Feldman, J., and Singh, M. 2005. Information along contours and object boundaries. Psychological Review 112, 243--252.
• 8: Fleming, R. W., Torralba, A., and Adelson, E. H. 2004. Specular reflections and the perception of shape. J. of Vision 4, 9, 798--820.
• 9: Grossberg, S., and Mingolla, E. 1985. Neural dynamics of form perception: Boundary completion, illusory figures and neon color spreading. Psych. Rev. 92, 2, 173--211.
• 10: Hubel, D. H., and Wiesel, T. N. 1968. Receptive fields and functional architecture of monkey striate cortex. J. of Physiology (London) 195, 215--243.
• 11: Interrante, V., and Kim, S. 2001. Investigating the effect of texture orientation on shape perception. Proc. Human Vision and Electronic Imaging 6, 330--339.
• 12: Interrante, V., Kim, S., and Hagh-Shenas, H. 2002. Conveying 3d shape with texture: Recent advances and experimental findings. Proc. Human Vision and Electronic Imaging 7, 197--206.
• 13: Kim, S., Hagh-Shenas, H., and Interrante, V. 2003. Showing shape with texture: Two directions seem better than one. Proc. Human Vision and Electronic Imaging 8, 332--339.
• 14: Koenderink, J. J., and Van Doorn, A. J. 1982. The shape of smooth objects and the way contours end. Perc. 11, 129--137.
• 15: Koenderink, J. J. 1984. What does the occluding contour tell us about solid shape. Perc. 13, 312--330.
• 16: Neumann, H., and Sepp, W. 1999. Recurrent v1-v2 interactions in early boundary processing. Biol. Cybern. 81, 425--444.
• 17: Michael Oren , Shree K. Nayar, A Theory of Specular Surface Geometry, International Journal of Computer Vision, v.24 n.2, p.105-124, Sept. 1997 [doi>10.1023/A:1007954719939]
• 18: Richards, W. A., Koenderink, J. J., and Hoffman, D. D. 1987. Inferring three-dimensional shapes from two-dimensional silhouettes. J. Opt. Soc. Am. A 4, 7, 1168--1175.
• 19: Silvio Savarese , Li Fei-Fei , Pietro Perona, What do reflections tell us about the shape of a mirror?, Proceedings of the 1st Symposium on Applied perception in graphics and visualization, August 07-08, 2004, Los Angeles, California [doi>10.1145/1012551.1012571]
• 20: Todd, J. T. 2004. The visual perception of 3d shape. Trends in Cognitive Sciences 9, 3, 115--121.
• 21: Von Der Heydt, R., Peterhans, E., and Baumgartner, G. 1984. Illusory contours and cortical neuron responses. Science 224, 1260--1262.

INDEX TERMS

Keywords:
3D shape perception, model of cortical form processing, non-photorealistic rendering