Real-time smoke rendering using compensated ray marching

ABSTRACT

We present a real-time algorithm called compensated ray marching for rendering of smoke under dynamic low-frequency environment lighting. Our approach is based on a decomposition of the input smoke animation, represented as a sequence of volumetric density fields, into a set of radial basis functions (RBFs) and a sequence of residual fields. To expedite rendering, the source radiance distribution within the smoke is computed from only the low-frequency RBF approximation of the density fields, since the high-frequency residuals have little impact on global illumination under low-frequency environment lighting. Furthermore, in computing source radiances the contributions from single and multiple scattering are evaluated at only the RBF centers and then approximated at other points in the volume using an RBF-based interpolation. A slice-based integration of these source radiances along each view ray is then performed to render the final image. The high-frequency residual fields, which are a critical component in the local appearance of smoke, are compensated back into the radiance integral during this ray march to generate images of high detail.

The runtime algorithm, which includes both light transfer simulation and ray marching, can be easily implemented on the GPU, and thus allows for real-time manipulation of viewpoint and lighting, as well as interactive editing of smoke attributes such as extinction cross section, scattering albedo, and phase function. Only moderate preprocessing time and storage is needed. This approach provides the first method for real-time smoke rendering that includes single and multiple scattering while generating results comparable in quality to offline algorithms like ray tracing.

REFERENCES

• 1: Biri, V., Michelin, S., and Arquès, D., 2004. Real-time single scattering with shadows. http://igm.univmlv.fr/~biri/indexCA_en.html.
• 2: James F. Blinn, Light reflection functions for simulation of clouds and dusty surfaces, ACM SIGGRAPH Computer Graphics, v.16 n.3, p.21-29, July 1982
• 3: Jeff Bolz , Ian Farmer , Eitan Grinspun , Peter Schröoder, Sparse matrix solvers on the GPU: conjugate gradients and multigrid, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 4: Cerezo, E., Pérez, F., Pueyo, X., Serón, F. J., and Sillion, F. X. 2005. A survey on participating media rendering techniques. The Visual Computer 21, 5, 303--328.
• 5: David Cohen-Steiner , Pierre Alliez , Mathieu Desbrun, Variational shape approximation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 6: Crane, K., Llamas, I., and Tariq, S. 2007. Real-time simulation and rendering of 3d fluids. GPU Gems 3, Chapter 30.
• 7: Yoshinori Dobashi , Kazufumi Kaneda , Hideo Yamashita , Tsuyoshi Okita , Tomoyuki Nishita, A simple, efficient method for realistic animation of clouds, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.19-28, July 2000 [doi>10.1145/344779.344795]
• 8: D. S. Ebert , Richard E. Parent, Rendering and animation of gaseous phenomena by combining fast volume and scanline A-buffer techniques, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.357-366, Aug. 1990
• 9: Ronald Fedkiw , Jos Stam , Henrik Wann Jensen, Visual simulation of smoke, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.15-22, August 2001 [doi>10.1145/383259.383260]
• 10: Geist, R., Rasche, K., Westall, J., and Schalkoff, R. J. 2004. Lattice-boltzmann lighting. In Rendering Techniques, 355--362.
• 11: Harris, M. J., and Lastra, A. 2001. Real-time cloud rendering. In Eurographics, 76--84.
• 12: Kyle Hegeman , Michael Ashikhmin , Simon Premože, A lighting model for general participating media, Proceedings of the 2005 symposium on Interactive 3D graphics and games, April 03-06, 2005, Washington, District of Columbia [doi>10.1145/1053427.1053446]
• 13: Wojciech Jarosz , Craig Donner , Matthias Zwicker , Henrik Wann Jensen, Radiance caching for participating media, ACM SIGGRAPH 2007 sketches, August 05-09, 2007, San Diego, California [doi>10.1145/1278780.1278848]
• 14: Henrik Wann Jensen , Per H. Christensen, Efficient simulation of light transport in scences with participating media using photon maps, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.311-320, July 1998 [doi>10.1145/280814.280925]
• 15: James T. Kajiya , Brian P Von Herzen, Ray tracing volume densities, ACM SIGGRAPH Computer Graphics, v.18 n.3, p.165-174, July 1984
• 16: Joe Kniss , Simon Premoze , Charles Hansen , Peter Shirley , Allen McPherson, A Model for Volume Lighting and Modeling, IEEE Transactions on Visualization and Computer Graphics, v.9 n.2, p.150-162, April 2003 [doi>10.1109/TVCG.2003.1196003]
• 17: Eric P. Lafortune , Yves D. Willems, Rendering participating media with bidirectional path tracing, Proceedings of the eurographics workshop on Rendering techniques '96, p.91-100, December 1996, Porto, Portugal
• 18: Sylvain Lefebvre , Hugues Hoppe, Perfect spatial hashing, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 19: Marc Levoy, Efficient ray tracing of volume data, ACM Transactions on Graphics (TOG), v.9 n.3, p.245-261, July 1990 [doi>10.1145/78964.78965]
• 20: Narasimhan, S. G., and Nayar, S. K. 2003. Shedding light on the weather. In IEEE Comp. Vision Patt. Rec., 665--672.
• 21: NVIDIA, 2007. CUDA homepage. http://developer.nvidia.com/object/cuda.html.
• 22: Premoze, S., Ashikhmin, M., Ramamoorthi, R., and Nayar, S. 2004. Practical rendering of multiple scattering effects in participating media. In Eurographics Symposium on Rendering, 363--374.
• 23: Zhong Ren , Rui Wang , John Snyder , Kun Zhou , Xinguo Liu , Bo Sun , Peter-Pike Sloan , Hujun Bao , Qunsheng Peng , Baining Guo, Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 24: Riley, K., Ebert, D. S., Kraus, M., Tessendorf, J., and Hansen, C. 2004. Efficient rendering of atmospheric phenomena. In Eurographics Symposium on Rendering, 375--386.
• 25: Holly E. Rushmeier , Kenneth E. Torrance, The zonal method for calculating light intensities in the presence of a participating medium, ACM SIGGRAPH Computer Graphics, v.21 n.4, p.293-302, July 1987
• 26: Holly Edith Rushmeier, Realistic image synthesis for scenes with radiatively participating media, Cornell University, Ithaca, NY, 1988
• 27: Joshua Schpok , Joseph Simons , David S. Ebert , Charles Hansen, A real-time cloud modeling, rendering, and animation system, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 28: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 29: Peter-Pike Sloan , Ben Luna , John Snyder, Local, deformable precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 30: Jos Stam , Eugene Fiume, Depicting fire and other gaseous phenomena using diffusion processes, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.129-136, September 1995 [doi>10.1145/218380.218430]
• 31: Stam, J. 1994. Stochastic rendering of density fields. In Graphics Interface, 51--58.
• 32: Stam, J. 1995. Multiple scattering as a diffusion process. In Eurographics Workshop on Rendering, 41--50.
• 33: Bo Sun , Ravi Ramamoorthi , Srinivasa G. Narasimhan , Shree K. Nayar, A practical analytic single scattering model for real time rendering, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 34: Szirmay-Kalos, L., Sbert, M., and Ummenhoffer, T. 2005. Real-time multiple scattering in participating media with illumination networks. In Rendering Techniques, 277--282.
• 35: Kun Zhou , Qiming Hou , Minmin Gong , John Snyder , Baining Guo , Heung-Yeung Shum, Fogshop: Real-Time Design and Rendering of Inhomogeneous, Single-Scattering Media, Proceedings of the 15th Pacific Conference on Computer Graphics and Applications, p.116-125, October 29-November 02, 2007 [doi>10.1109/PG.2007.28]
• 36: Ciyou Zhu , Richard H. Byrd , Peihuang Lu , Jorge Nocedal, Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization, ACM Transactions on Mathematical Software (TOMS), v.23 n.4, p.550-560, Dec. 1997 [doi>10.1145/279232.279236]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Intensity, color, photometry, and thresholding
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Raytracing
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis

General Terms:
Algorithms, Design, Measurement, Performance

Keywords:
environment lighting, multiple scattering, participating media, perfect hashing, single scattering