Precomputed radiance transfer for X3D based mixed reality applications

ABSTRACT

We present a lightweight framework composed of two extensions to introduce precomputed radiance transfer (PRT) to X3D. Depending on the basis function, PRT is used to simulate shading, complex light transfer and effects like subsurface scattering and caustics in real time by projecting incident light and transfer functions into frequency space, which allows the solution of the integration of the rendering equation through a simple dot product. Light transfer from incident to transferred radiance thus becomes a matter of solving dot products of coefficient vectors, which can be easily evaluated on the GPU. In this paper, we identify the minimal set of components needed for an X3D application to use spherical harmonic based PRT, and discuss how further enhancements to PRT can be implemented, like new basis functions and other features.

REFERENCES

• 1: Avalon, 2008. Avalon. http://www.instantreality.org/.
• 2: Blanco, M., Florez, M., and Bermejo, M. 1997. Evaluation of the rotation matrices in the basis of real spherical harmonics. Journal of Molecular Structure: THEOCHEM 419, 19--27(9).
• 3: Choi, C. H., Ivanic, J., Gordon, M. S., and Ruedenberg, K. 1999. Rapid and stable determination of rotation matrices between spherical harmonics by direct recursion. The Journal of Chemical Physics 111, 19, 8825--8831.
• 4: Ingrid Daubechies, Ten lectures on wavelets, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1992
• 5: Gautron, P., Křivánek, J., Pattanaik, S. N., and Bouatouch, K. 2004. A novel hemispherical basis for accurate and efficient rendering. In Rendering Techniques 2004, Eurographics Symposium on Rendering, 321--330.
• 6: Green, R. 2003. Spherical harmonic lighting: The gritty details. Archives of the Game Developers Conference.
• 7: Yvonne Jung , Tobias Franke , Patrick Dähne , Johannes Behr, Enhancing X3D for advanced MR appliances, Proceedings of the twelfth international conference on 3D web technology, April 15-18, 2007, Perugia, Italy [doi>10.1145/1229390.1229394]
• 8: Jaroslav Křivánek , Jaakko Konttinen , Sumanta Pattanaik , Kadi Bouatouch , Jiří Žára, Fast approximation to spherical harmonics rotation, ACM SIGGRAPH 2006 Sketches, July 30-August 03, 2006, Boston, Massachusetts [doi>10.1145/1179849.1180042]
• 9: Jaakko Lehtinen , Jan Kautz, Matrix radiance transfer, Proceedings of the 2003 symposium on Interactive 3D graphics, April 27-30, 2003, Monterey, California [doi>10.1145/641480.641495]
• 10: Microsoft, 2008. D3dx functions. http://msdn.microsoft.com/.
• 11: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, All-frequency shadows using non-linear wavelet lighting approximation, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 12: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, Triple product wavelet integrals for all-frequency relighting, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 13: Ravi Ramamoorthi , Pat Hanrahan, An efficient representation for irradiance environment maps, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.497-500, August 2001 [doi>10.1145/383259.383317]
• 14: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 15: Peter-Pike Sloan , Jesse Hall , John Hart , John Snyder, Clustered principal components for precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 16: Szirmay-Kalos, L., Szecsi, L., and Sbert, M. 2006. Gpugi: Global illumination effects on the gpu. In Eurographics 2006: Tutorials, Eurographics Association, 1201--1278.
• 17: Wächter, C., and Keller, A. 2006. Instant ray tracing: The bounding interval hierarchy. Proceedings of the 17th Eurographics Symposium on Rendering, 139--149.
• 18: Web3DConsortium, 2007. X3d. http://www.web3d.org/x3d/specifications/ISO-IEC-FDIS-19775-1.2/index.html.
• 19: Wong, T.-T., and Leung, C.-S. 2007. Is there anything comparable to spherical harmonics but simpler? Game Developers Conference.
• 20: Kun Xu , Yun-Tao Jia , Hongbo Fu , Shimin Hu , Chiew-Lan Tai, Spherical Piecewise Constant Basis Functions for All-Frequency Precomputed Radiance Transfer, IEEE Transactions on Visualization and Computer Graphics, v.14 n.2, p.454-467, March 2008 [doi>10.1109/TVCG.2007.70442]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Languages

Keywords:
X3D, image based lighting, mixed reality, precomputed radiance transfer, real time, shader