Recovery of material under complex illumination conditions

ABSTRACT

To calculate the inter-reflection between real objects and virtual ones in augmented reality, recovery of material for the real objects is necessary. In this paper, an approach is proposed to recover the material properties from a single high dynamic range image for a homogeneous object under complex illumination conditions. By the method, we first acquire a high dynamic range image for the object, and one or a few environment maps in high dynamic range as illumination of the object. Then a simulated annealing algorithm is employed to solve the inverse rendering problem. Finally, we obtain optimal parameter values for the reflection model in approximating the material of the object. In the course of optimization, image-based lighting and ray tracing techniques are used, and as a result the inter-reflection can be calculated in convenience. In addition, the transparent and translucent properties can be also recovered.

REFERENCES

• 1: R. T. Azuma. A survey of augmented reality. In Presence: Teleoperators and Virtual Environments 6, 4 (August 1997), 355--385.
• 2: Samuel Boivin , Andre Gagalowicz, Image-based rendering of diffuse, specular and glossy surfaces from a single image, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.107-116, August 2001 [doi>10.1145/383259.383270]
• 3: Paul E. Debevec , Jitendra Malik, Recovering high dynamic range radiance maps from photographs, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.369-378, August 1997 [doi>10.1145/258734.258884]
• 4: Paul Debevec, Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.189-198, July 1998 [doi>10.1145/280814.280864]
• 5: Paul Debevec , Tim Hawkins , Chris Tchou , Haarm-Pieter Duiker , Westley Sarokin , Mark Sagar, Acquiring the reflectance field of a human face, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.145-156, July 2000 [doi>10.1145/344779.344855]
• 6: George Drettakis , Luc Robert , Sylvain Bougnoux, Interactive Common Illumination for Computer Augmented Reality, Proceedings of the Eurographics Workshop on Rendering Techniques '97, p.45-56, June 16-18, 1997
• 7: A. Fournier, A. Guawan, and C. Romanzin. Common illumination between real and computer generated scenes. In Proc. Graphics Interface'93, 1993.
• 8: Hendrik P. A. Lensch , Michael Goesele , Jan Kautz , Wolfgang Heidrich , Hans-Peter Seidel, Image-Based Reconstruction of Spatially Varying Materials, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.103-114, June 25-27, 2001
• 9: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 10: C. Loscos, M. Frasson, G. Drettakis, B. Walte, X. Granier, and P. Poulin. Interactive virtual relighting and remodeling of real scenes. In Eurographics Workshop on Rendering'99, 1999.
• 11: Céline Loscos , George Drettakis , Luc Robert, Interactive Virtual Relighting of Real Scenes, IEEE Transactions on Visualization and Computer Graphics, v.6 n.4, p.289-305, October 2000 [doi>10.1109/2945.895874]
• 12: R. C. Love. Surface reflection model estimation from naturally illuminated image sequences. Ph.D. thesis. The University of Leeds, 1997.
• 13: S. Marschner, S. Westin, E. Lafortune, K. Torrance, and D. Greenberg. Image-based BRDF measurement including human skin. In Eurographics Workshop on Rendering, 1999.
• 14: S. Marschner, S. Westin, E. Lafortune, and K. Torrance. Image-based bidirectional reflectance distribution function measurement. In APPLIED OPTICS, Vol. 39, No. 16, 1 June 2000.
• 15: K. Nishino, Z. Zhang, and K. Ikeuchi. Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis. In Int. Conf. on Computer Vision, 2001.
• 16: Ravi Ramamoorthi , Pat Hanrahan, A signal-processing framework for inverse rendering, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.117-128, August 2001 [doi>10.1145/383259.383271]
• 17: I. Sato, Y. Sato, and K. Ikeuchi. Illumination distribution from brightness in shadows: adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In Int. Conf. on Computer Vision, 1999.
• 18: Imari Sato , Yoichi Sato , Katsushi Ikeuchi, Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene, IEEE Transactions on Visualization and Computer Graphics, v.5 n.1, p.1-12, January 1999 [doi>10.1109/2945.764865]
• 19: Yoichi Sato , Mark D. Wheeler , Katsushi Ikeuchi, Object shape and reflectance modeling from observation, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.379-387, August 1997 [doi>10.1145/258734.258885]
• 20: Gregory J. Ward, Measuring and modeling anisotropic reflection, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.265-272, July 1992
• 21: Gregory J. Ward, The RADIANCE lighting simulation and rendering system, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.459-472, July 1994 [doi>10.1145/192161.192286]
• 22: Yizhou Yu , Jitendra Malik, Recovering photometric properties of architectural scenes from photographs, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.207-217, July 1998 [doi>10.1145/280814.280874]
• 23: Yizhou Yu , Paul Debevec , Jitendra Malik , Tim Hawkins, Inverse global illumination: recovering reflectance models of real scenes from photographs, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.215-224, July 1999 [doi>10.1145/311535.311559]
• 24: Manoj Aggarwal, Narendra Ahuja, Split Aperture Imaging for High Dynamic Range. in Int'l Conf. on Computer Vision, Vol. 2, 2001, IEEE, pp. 10--17.

INDEX TERMS

Keywords:
augmented reality, high dynamic range image, image-based lighting, inverse rendering, reflection model