Interactive relighting with dynamic BRDFs

ABSTRACT

We present a technique for interactive relighting in which source radiance, viewing direction, and BRDFs can all be changed on the fly. In handling dynamic BRDFs, our method efficiently accounts for the effects of BRDF modification on the reflectance and incident radiance at a surface point. For reflectance, we develop a BRDF tensor representation that can be factorized into adjustable terms for lighting, viewing, and BRDF parameters. For incident radiance, there exists a non-linear relationship between indirect lighting and BRDFs in a scene, which makes linear light transport frameworks such as PRT unsuitable. To overcome this problem, we introduce precomputed transfer tensors (PTTs) which decompose indirect lighting into precomputable components that are each a function of BRDFs in the scene, and can be rapidly combined at run time to correctly determine incident radiance. We additionally describe a method for efficient handling of high-frequency specular reflections by separating them from the BRDF tensor representation and processing them using precomputed visibility information. With relighting based on PTTs, interactive performance with indirect lighting is demonstrated in applications to BRDF animation and material tuning.

REFERENCES

• 1: Michael Ashikmin , Simon Premože , Peter Shirley, A microfacet-based BRDF generator, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.65-74, July 2000 [doi>10.1145/344779.344814]
• 2: Larry Aupperle , Pat Hanrahan, A hierarchical illumination algorithm for surfaces with glossy reflection, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.155-162, August 02-06, 1993, Anaheim, CA [doi>10.1145/166117.166137]
• 3: Aner Ben-Artzi , Ryan Overbeck , Ravi Ramamoorthi, Real-time BRDF editing in complex lighting, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 4: James F. Blinn, Models of light reflection for computer synthesized pictures, Proceedings of the 4th annual conference on Computer graphics and interactive techniques, p.192-198, July 20-22, 1977, San Jose, California
• 5: Robert L. Cook , Kenneth E. Torrance, A reflectance model for computer graphics, Proceedings of the 8th annual conference on Computer graphics and interactive techniques, p.307-316, August 03-07, 1981, Dallas, Texas, United States
• 6: Kristin J. Dana , Bram van Ginneken , Shree K. Nayar , Jan J. Koenderink, Reflectance and texture of real-world surfaces, ACM Transactions on Graphics (TOG), v.18 n.1, p.1-34, Jan. 1999 [doi>10.1145/300776.300778]
• 7: Dempster, A. P., Laird, N. M., and Rubin, D. B. 1977. Maximum-likelihood from incomplete data via the em algorithm. J. Royal Statistical Society 39, 1, 1--38.
• 8: Julie Dorsey , James Arvo , Donald Greenberg, Interactive Design of Complex Time-Dependent Lighting, IEEE Computer Graphics and Applications, v.15 n.2, p.26-36, March 1995 [doi>10.1109/38.365003]
• 9: David Forsyth , Andrew Zisserman, Reflections on Shading, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.7, p.671-679, July 1991 [doi>10.1109/34.85657]
• 10: Reid Gershbein , Pat Hanrahan, A fast relighting engine for interactive cinematic lighting design, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.353-358, July 2000 [doi>10.1145/344779.344938]
• 11: Paul Green , Jan Kautz , Wojciech Matusik , Frédo Durand, View-dependent precomputed light transport using nonlinear Gaussian function approximations, Proceedings of the 2006 symposium on Interactive 3D graphics and games, March 14-17, 2006, Redwood City, California [doi>10.1145/1111411.1111413]
• 12: Miloš Hašan , Fabio Pellacini , Kavita Bala, Direct-to-indirect transfer for cinematic relighting, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 13: James T. Kajiya, Anisotropic reflection models, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.15-21, July 1985
• 14: James T. Kajiya, The rendering equation, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.143-150, August 1986
• 15: Kautz, J., and McCool, M. D. 1999. Interactive rendering with arbitrary brdfs using separable approximations. In Eurographics Rendering Workshop, 281--292.
• 16: Anders Wang Kristensen , Tomas Akenine-Möller , Henrik Wann Jensen, Precomputed local radiance transfer for real-time lighting design, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 17: Lieven De Lathauwer , Bart De Moor , Joos Vandewalle, On the Best Rank-1 and Rank-(R₁,R₂,. . .,R_N) Approximation of Higher-Order Tensors, SIAM Journal on Matrix Analysis and Applications, v.21 n.4, p.1324-1342, March – May 2000 [doi>10.1137/S0895479898346995]
• 18: Liu, X., Sloan, P., Shum, H.-Y., and Snyder, J. 2004. All-frequency precomputed radiance transfer for glossy objects. In Eurographics Symp. Rendering, 337--344.
• 19: Wojciech Matusik , Hanspeter Pfister , Matt Brand , Leonard McMillan, A data-driven reflectance model, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 20: Wojciech Matusik , Hanspeter Pfister , Matthew Brand , Leonard McMillan, Efficient isotropic BRDF measurement, Proceedings of the 14th Eurographics workshop on Rendering, June 25-27, 2003, Leuven, Belgium
• 21: Michael D. McCool , Jason Ang , Anis Ahmad, Homomorphic factorization of BRDFs for high-performance rendering, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.171-178, August 2001 [doi>10.1145/383259.383276]
• 22: Mark Meyer , John Anderson, Statistical acceleration for animated global illumination, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 23: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, All-frequency shadows using non-linear wavelet lighting approximation, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 24: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, Triple product wavelet integrals for all-frequency relighting, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 25: Ngan, A., Durand, F., and Matusik, W. 2005. Experimental analysis of brdf models. In Eurographics Symp. Rendering, 117--226.
• 26: Michael Oren , Shree K. Nayar, Generalization of Lambert's reflectance model, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.239-246, July 1994 [doi>10.1145/192161.192213]
• 27: Fabio Pellacini , Kiril Vidimče , Aaron Lefohn , Alex Mohr , Mark Leone , John Warren, Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 28: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA
• 29: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 30: Peter-Pike Sloan , Jesse Hall , John Hart , John Snyder, Clustered principal components for precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 31: Eric Tabellion , Arnauld Lamorlette, An approximate global illumination system for computer generated films, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 32: Yu-Ting Tsai , Zen-Chung Shih, All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 33: M. Alex O. Vasilescu , Demetri Terzopoulos, TensorTextures: multilinear image-based rendering, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 34: Wang, R., Tran, J., and Luebke, D. 2004. All-frequency relighting of non-diffuse objects using separable brdf approximation. In Eurographics Symp. Rendering, 345--354.
• 35: Hongcheng Wang , Qing Wu , Lin Shi , Yizhou Yu , Narendra Ahuja, Out-of-core tensor approximation of multi-dimensional matrices of visual data, ACM SIGGRAPH 2005 Papers, July 31-August 04, 2005, Los Angeles, California
• 36: Rui Wang , John Tran , David Luebke, All-frequency relighting of glossy objects, ACM Transactions on Graphics (TOG), v.25 n.2, p.293-318, April 2006 [doi>10.1145/1138450.1138456]
• 37: Gregory J. Ward, Measuring and modeling anisotropic reflection, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.265-272, July 1992

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Reflectance

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Intensity, color, photometry, and thresholding
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Raytracing

General Terms:
Algorithms, Design

Keywords:
bidirectional reflectance distribution function, global illumination, precomputed radiance transfer, relighting, tensor factorization