Frequency space environment map rendering

ABSTRACT

We present a new method for real-time rendering of objects with complex isotropic BRDFs under distant natural illumination, as specified by an environment map. Our approach is based on spherical frequency space analysis and includes three main contributions. Firstly, we are able to theoretically analyze required sampling rates and resolutions, which have traditionally been determined in an ad-hoc manner. We also introduce a new compact representation, which we call a spherical harmonic reflection map (SHRM), for efficient representation and rendering. Finally, we show how to rapidly prefilter the environment map to compute the SHRM---our frequency domain prefiltering algorithm is generally orders of magnitude faster than previous angular (spatial) domain approaches.

REFERENCES

• 1: BASRI, R., AND JACOBS, D. 2001. Lambertian reflectance and linear subspaces. In International Conference on Computer Vision, 383-390.
• 2: James F. Blinn , Martin E. Newell, Texture and reflection in computer generated images, Communications of the ACM, v.19 n.10, p.542-547, Oct. 1976 [doi>10.1145/360349.360353]
• 3: Brian Cabral , Nelson Max , Rebecca Springmeyer, Bidirectional reflection functions from surface bump maps, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.273-281, August 1987
• 4: Brian Cabral , Marc Olano , Philip Nemec, Reflection space image based rendering, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.165-170, July 1999 [doi>10.1145/311535.311553]
• 5: Kristin J. Dana , Bram van Ginneken , Shree K. Nayar , Jan J. Koenderink, Reflectance and texture of real-world surfaces, ACM Transactions on Graphics (TOG), v.18 n.1, p.1-34, Jan. 1999 [doi>10.1145/300776.300778]
• 6: Ned Greene, Environment mapping and other applications of world projections, IEEE Computer Graphics and Applications, v.6 n.11, p.21-29, November 1986 [doi>10.1109/MCG.1986.276658]
• 7: Ziyad S. Hakura , John M. Snyder , Jerome E. Lengyel, Parameterized environment maps, Proceedings of the 2001 symposium on Interactive 3D graphics, p.203-208, March 2001 [doi>10.1145/364338.364402]
• 8: J. T. Kajiya , T. L. Kay, Rendering fur with three dimensional textures, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.271-280, July 1989
• 9: Jan Kautz , Michael D. McCool, Interactive rendering with arbitrary BRDFs using separable approximations, ACM SIGGRAPH 99 Conference abstracts and applications, p.253, August 08-13, 1999, Los Angeles, California, United States [doi>10.1145/311625.312153]
• 10: KAUTZ, J., AND MCCOOL, M. 2000. Approximation of glossy reflection with pre-filtered environment maps. In Graphics Interface, 119-126.
• 11: Jan Kautz , Pere-Pau Vázquez , Wolfgang Heidrich , Hans-Peter Seidel, Unified Approach to Prefiltered Environment Maps, Proceedings of the Eurographics Workshop on Rendering Techniques 2000, p.185-196, June 26-28, 2000
• 12: KOENDERINK, J., AND VAN DOORN, A. 1998. Phenomenological description of bidirectional surface reflection. JOSA A 15, 11, 2903-2912.
• 13: Eric P. F. Lafortune , Sing-Choong Foo , Kenneth E. Torrance , Donald P. Greenberg, Non-linear approximation of reflectance functions, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.117-126, August 1997 [doi>10.1145/258734.258801]
• 14: MACROBERT, T. 1948. Spherical harmonics; an elementary treatise on harmonic functions, with applications. Dover Publications.
• 15: Tom Malzbender , Dan Gelb , Hans Wolters, Polynomial texture maps, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.519-528, August 2001 [doi>10.1145/383259.383320]
• 16: MARSCHNER, S., WESTIN, S., LAFORTUNE, E., TORRANCE, K., AND GREENBERG, D. 2000. Image-Based BRDF measurement including human skin. In EGRW 00, 139-152.
• 17: Michael D. McCool , Jason Ang , Anis Ahmad, Homomorphic factorization of BRDFs for high-performance rendering, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.171-178, August 2001 [doi>10.1145/383259.383276]
• 18: MILLER, G., AND HOFFMAN, C. 1984. Illumination and reflection maps: Simulated objects in simulated and real environments. SIGGRAPH 84 Advanced Computer Graphics Animation seminar notes.
• 19: MOHLENKAMP, M. 1999. A fast transform for spherical harmonics. The Journal of Fourier Analysis and Applications 5, 2/3, 159-184.
• 20: NISHINO, K., SATO, Y., AND IKEUCHI, K. 1999. Eigen-texture method: Appearance compression based on 3D model. In CVPR 99, 618-624.
• 21: Kekoa Proudfoot , William R. Mark , Svetoslav Tzvetkov , Pat Hanrahan, A real-time procedural shading system for programmable graphics hardware, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.159-170, August 2001 [doi>10.1145/383259.383275]
• 22: Ravi Ramamoorthi , Pat Hanrahan, An efficient representation for irradiance environment maps, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.497-500, August 2001 [doi>10.1145/383259.383317]
• 23: RAMAMOORTHI, R., AND HANRAHAN, P. 2001. On the relationship between radiance and irradiance: Determining the illumination from images of a convex lambertian object. JOSA A 18, 10, 2448-2459.
• 24: Ravi Ramamoorthi , Pat Hanrahan, A signal-processing framework for inverse rendering, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.117-128, August 2001 [doi>10.1145/383259.383271]
• 25: RUSINKIEWICZ, S. 1998. A new change of variables for efficient BRDF representation. In EGRW 98, 11-22.
• 26: SCHRÖDER, P., AND SWELDENS, W. 1995. Spherical wavelets: Texture processing. In EGRW 95, 252-263.
• 27: Françis X. Sillion , James R. Arvo , Stephen H. Westin , Donald P. Greenberg, A global illumination solution for general reflectance distributions, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.187-196, July 1991
• 28: TORRANCE, K., AND SPARROW, E. 1967. Theory for off-specular reflection from roughened surfaces. JOSA 57, 9, 1105-1114.
• 29: Stephen H. Westin , James R. Arvo , Kenneth E. Torrance, Predicting reflectance functions from complex surfaces, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.255-264, July 1992
• 30: Daniel N. Wood , Daniel I. Azuma , Ken Aldinger , Brian Curless , Tom Duchamp , David H. Salesin , Werner Stuetzle, Surface light fields for 3D photography, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.287-296, July 2000 [doi>10.1145/344779.344925]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

General Terms:
Algorithms, Theory

Keywords:
complexity analysis, environment maps, image-based rendering, signal-processing, spherical harmonics