Triple product wavelet integrals for all-frequency relighting

ABSTRACT

This paper focuses on efficient rendering based on pre-computed light transport, with realistic materials and shadows under all-frequency direct lighting such an environment maps. The basic difficulty is representation and computation in the 6D space of light direction, view direction, and surface position. While image-based and synthetic methods for real-time rendering have been proposed, they do not scale to high sampling rates with variation of both lighting and viewpoint. Current approaches are therefore limited to lower dimensionality (only lighting or viewpoint variation, not both) or lower sampling rates (low frequency lighting and materials). We propose a new mathematical and computational analysis of pre-computed light transport. We use factored forms, separately pre-computing and representing visibility and material properties. Rendering then requires computing triple product integrals at each vertex, involving the lighting, visibility and BRDF. Our main contribution is a general analysis of these triple product integrals, which are likely to have broad applicability in computer graphics and numerical analysis. We first determine the computational complexity in a number of bases like point samples, spherical harmonics and wavelets. We then give efficient linear and sublinear-time algorithms for Haar wavelets, incorporating non-linear wavelet approximation of lighting and BRDFs. Practically, we demonstrate rendering of images under new lighting and viewing conditions in a few seconds, significantly faster than previous techniques.

REFERENCES

• 1: Sameer Agarwal , Ravi Ramamoorthi , Serge Belongie , Henrik Wann Jensen, Structured importance sampling of environment maps, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 2: James Arvo , Kenneth Torrance , Brian Smits, A framework for the analysis of error in global illumination algorithms, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.75-84, July 1994 [doi>10.1145/192161.192179]
• 3: Brian Cabral , Marc Olano , Philip Nemec, Reflection space image based rendering, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.165-170, July 1999 [doi>10.1145/311535.311553]
• 4: Kristin J. Dana , Bram van Ginneken , Shree K. Nayar , Jan J. Koenderink, Reflectance and texture of real-world surfaces, ACM Transactions on Graphics (TOG), v.18 n.1, p.1-34, Jan. 1999 [doi>10.1145/300776.300778]
• 5: Paul E. Debevec , Jitendra Malik, Recovering high dynamic range radiance maps from photographs, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.369-378, August 1997 [doi>10.1145/258734.258884]
• 6: DEVORE, R. 1998. Nonlinear approximation. Acta Numerica 7, 51--150.
• 7: Julie Dorsey , James Arvo , Donald Greenberg, Interactive Design of Complex Time-Dependent Lighting, IEEE Computer Graphics and Applications, v.15 n.2, p.26-36, March 1995 [doi>10.1109/38.365003]
• 8: Reid Gershbein , Peter Schröder , Pat Hanrahan, Textures and radiosity: controlling emission and reflection with texture maps, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.51-58, July 1994 [doi>10.1145/192161.192171]
• 9: INUI, T., TANABE, Y., AND ONODERA, Y. 1990. Group theory and its applications in physics. Springer Verlag.
• 10: KAUTZ, J., AND MCCOOL, M. 1999. Interactive rendering with arbitrary BRDFs using separable approximations. In Eurographics Rendering Workshop 99, 247--260.
• 11: Jan Kautz , Peter-Pike Sloan , John Snyder, Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 12: Jaakko Lehtinen , Jan Kautz, Matrix radiance transfer, Proceedings of the 2003 symposium on Interactive 3D graphics, April 27-30, 2003, Monterey, California [doi>10.1145/641480.641495]
• 13: MACROBERT, T. 1948. Spherical harmonics; an elementary treatise on harmonic functions, with applications. Dover Publications.
• 14: MALLAT, S. 1999. A Wavelet Tour of Signal Processing. Academic Press.
• 15: MEYER, Y., COIFMAN, R., AND SALINGER, D. 1997. Wavelets: Calderon-Zygmund and Multilinear Operators. Cambridge Univ. Press.
• 16: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, All-frequency shadows using non-linear wavelet lighting approximation, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 17: NIMEROFF, J., SIMONCELLI, E., AND DORSEY, J. 1994. Efficient re-rendering of naturally illuminated environments. In Eurographics Workshop on Rendering 94, 359--373.
• 18: Ravi Ramamoorthi , Pat Hanrahan, Frequency space environment map rendering, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 19: RUSINKIEWICZ, S. 1998. A new change of variables for efficient BRDF representation. In Eurographics Rendering Workshop 98, 11--22.
• 20: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 21: Peter-Pike Sloan , Jesse Hall , John Hart , John Snyder, Clustered principal components for precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 22: Peter-Pike Sloan , Xinguo Liu , Heung-Yeung Shum , John Snyder, Bi-scale radiance transfer, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 23: Eric J. Stollnitz , Tony D. Derose , David H. Salesin, Wavelets for computer graphics: theory and applications, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1996
• 24: THORNBER, K., AND JACOBS, D. 2001. Broadened, specular reflection and linear subspaces. Tech. Rep. TR#2001-033, NEC.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation

Additional Classification:
  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
      G.1.2 Approximation
          Subjects: Wavelets and fractals; Nonlinear approximation

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Keywords:
Haar Wavelets, Image-Based Rendering, Non-linear Approximation, Pre-computed Radiance Transfer, Relighting