A fast relighting engine for interactive cinematic lighting design

ABSTRACT

We present new techniques for interactive cinematic lighting design of complex scenes that use procedural shaders. Deep-framebuffers are used to store the geometric and optical information of the visible surfaces of an image. The geometric information is represented as collections of oriented points, and the optical information is represented as bi-directional reflection distribution functions, or BRDFs. The BRDFs are generated by procedurally defined surface texturing functions that spatially vary the surfaces' appearances. The deep-framebuffer information is rendered using a multi-pass algorithm built on the OpenGL graphics pipeline. In order to handle both physically-correct as well as non-realistic reflection models used in the film industry, we factor the BRDF into independent components that map onto both the lighting and texturing units of the graphics hardware. A similar factorization is used to control the lighting distribution. Using these techniques, lighting calculations can be evaluated 2500 times faster than previous methods. This allows lighting changes to be rendered at rates of 20Hz in static environments that contain millions of objects of with dozens of unique procedurally defined surface properties and scores of lights.

REFERENCES

• 1: [1] Lightscape visualization system.
• 2: Ronen Barzel, Lighting controls for computer cinematography, Journal of Graphics Tools, v.2 n.1, p.1-20, 1997
• 3: [3] J. F. Blinn. Raster graphics. In K. Booth, editor, Tutorial: Computer Graphics. IEEE Computer Society, 1979.
• 4: Normand Brière , Pierre Poulin, Hierarchical view-dependent structures for interactive scene manipulation, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.83-90, August 1996 [doi>10.1145/237170.237211]
• 5: [5] Sharon Calahan. Storytelling through lighting, a computer perspective. In Tony Apodaca and Larry Gritz, editors, Advanced Renderman: Creating CGI for Motion Pictures, pages 337-382. Morgan Kaufman Publishers, San Francisco, 1999.
• 6: Robert L. Cook, Shade trees, ACM SIGGRAPH Computer Graphics, v.18 n.3, p.223-231, July 1984
• 7: [7] NVIDIA Corporation. GeForce 256 Graphics Accelerator Specifications, December 1999.
• 8: Julie Dorsey , James Arvo , Donald Greenberg, Interactive Design of Complex Time-Dependent Lighting, IEEE Computer Graphics and Applications, v.15 n.2, p.26-36, March 1995 [doi>10.1109/38.365003]
• 9: Julie O'B. Dorsey , Françis X. Sillion , Donald P. Greenberg, Design and simulation of opera lighting and projection effects, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.41-50, July 1991
• 10: [10] J. P. Grossman and Willian J. Dally. Point sample rendering. In George Drettakis and Nelson Max, editors, Eurographics Rendering Workshop, Eurographics, pages 181-192, 1998.
• 11: Brian Guenter , Todd B. Knoblock , Erik Ruf, Specializing shaders, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.343-350, September 1995 [doi>10.1145/218380.218470]
• 12: Pat Hanrahan , Jim Lawson, A language for shading and lighting calculations, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.289-298, Aug. 1990
• 13: [13] Paul S. Heckbert. Techniques for real-time frame buffer animation. In Computer FX 84 Conference, October 1984.
• 14: Wolfgang Heidrich , Hans-Peter Seidel, Realistic, hardware-accelerated shading and lighting, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.171-178, July 1999 [doi>10.1145/311535.311554]
• 15: John K. Kawai , James S. Painter , Michael F. Cohen, Radioptimization: goal based rendering, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.147-154, September 1993 [doi>10.1145/166117.166136]
• 16: [16] Marc Levoy and Turner Whitted. The use of points as a display primitive. Technical Report 85-022, UNC-Chapel Hill Computer Science, 1985.
• 17: [17] Rong Lu, Jan J. Koenderink, and Astrid M. Kappers. Optical properties (bidirectional reflection distribution functions) of velvet. In Applied Optics, volume 37, pages 5974-5984, 1998.
• 18: [18] M. Minnaert. The reciprocity principle in lunar photometry. In Astrophys. J., volume 93, pages 403-410, 1941.
• 19: Ken Perlin, An image synthesizer, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.287-296, Jul. 1985
• 20: Pierre Poulin , Alain Fournier, Lights from highlights and shadows, Proceedings of the 1992 symposium on Interactive 3D graphics, p.31-38, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147160]
• 21: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA
• 22: Chris Schoeneman , Julie Dorsey , Brian Smits , James Arvo , Donald Greenberg, Painting with light, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.143-146, September 1993 [doi>10.1145/166117.166135]
• 23: Mark Segal , Carl Korobkin , Rolf van Widenfelt , Jim Foran , Paul Haeberli, Fast shadows and lighting effects using texture mapping, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.249-252, July 1992
• 24: C. H. Séquin , E. K. Smyrl, Parameterized Ray-tracing, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.307-314, July 1989
• 25: [25] Kenneth R. Sloan and Christopher M. Brown. Color map techniques. Computer Graphics and Image Processing, 10: 297-317, 1979.
• 26: [26] Steve Upstill. The RenderMan Companion. Addison Wesley, 1992.
• 27: [27] Gregory J. Ward. The radiance lighting simulation and rendering system.
• 28: Lee Westover, Footprint evaluation for volume rendering, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.367-376, Aug. 1990

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms; Bitmap and framebuffer operations
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

General Terms:
Algorithms, Design, Human Factors, Measurement, Performance, Theory

Keywords:
animation, illumination, image-based rendering, optics, rendering, rendering hardware, texture mapping