Modeling and rendering of heterogeneous translucent materials using the diffusion equation

ABSTRACT

In this article, we propose techniques for modeling and rendering of heterogeneous translucent materials that enable acquisition from measured samples, interactive editing of material attributes, and real-time rendering. The materials are assumed to be optically dense such that multiple scattering can be approximated by a diffusion process described by the diffusion equation. For modeling heterogeneous materials, we present the inverse diffusion algorithm for acquiring material properties from appearance measurements. This modeling algorithm incorporates a regularizer to handle the ill-conditioning of the inverse problem, an adjoint method to dramatically reduce the computational cost, and a hierarchical GPU implementation for further speedup. To render an object with known material properties, we present the polygrid diffusion algorithm, which solves the diffusion equation with a boundary condition defined by the given illumination environment. This rendering technique is based on representation of an object by a polygrid, a grid with regular connectivity and an irregular shape, which facilitates solution of the diffusion equation in arbitrary volumes. Because of the regular connectivity, our rendering algorithm can be implemented on the GPU for real-time performance. We demonstrate our techniques by capturing materials from physical samples and performing real-time rendering and editing with these materials.

REFERENCES

• 1: Arridge, S. and Lionheart, B. 1998. Non-uniqueness in diffusion-based optical tomography. Optical Letters 23, 882--884.
• 2: Boas, D., Brooks, D., DiMarzio, C., Kilmer, M., Gauette, R., and Zhang, Q. 2001. Imaging the body with diffuse optical tomography. IEEE Signal Proc. Magazine 18, 6, 57--75.
• 3: Jeff Bolz , Ian Farmer , Eitan Grinspun , Peter Schröoder, Sparse matrix solvers on the GPU: conjugate gradients and multigrid, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 4: Nathan A. Carr , Jesse D. Hall , John C. Hart, GPU algorithms for radiosity and subsurface scattering, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, July 26-27, 2003, San Diego, California
• 5: Yanyun Chen , Xin Tong , Jiaping Wang , Stephen Lin , Baining Guo , Heung-Yeung Shum, Shell texture functions, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 6: Paul Debevec , Tim Hawkins , Chris Tchou , Haarm-Pieter Duiker , Westley Sarokin , Mark Sagar, Acquiring the reflectance field of a human face, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.145-156, July 2000 [doi>10.1145/344779.344855]
• 7: Paul E. Debevec , Jitendra Malik, Recovering high dynamic range radiance maps from photographs, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.369-378, August 1997 [doi>10.1145/258734.258884]
• 8: Craig Donner , Henrik Wann Jensen, Light diffusion in multi-layered translucent materials, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 9: Julie Dorsey , Alan Edelman , Henrik Wann Jensen , Justin Legakis , Hans Køhling Pedersen, Modeling and rendering of weathered stone, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.225-234, July 1999 [doi>10.1145/311535.311560]
• 10: Gibson, A., Hebden, J., and Arridge, S. 2005. Recent advances in diffuse optical imaging. Phys. Medicine Biol. 50, R1--R43.
• 11: Giles, M. B. and Pierce, N. A. 1999. An introduction to the adjoint approach to design. In ERCOFTAC Workshop on Adjoint Methods.
• 12: Michael Goesele , Hendrik P. A. Lensch , Jochen Lang , Christian Fuchs , Hans-Peter Seidel, DISCO: acquisition of translucent objects, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 13: Xianfeng Gu , Shing-Tung Yau, Global conformal surface parameterization, Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, June 23-25, 2003, Aachen, Germany
• 14: Tom Haber , Tom Mertens , Philippe Bekaert , Frank Van Reeth, A computational approach to simulate subsurface light diffusion in arbitrarily shaped objects, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia
• 15: Pat Hanrahan , Wolfgang Krueger, Reflection from layered surfaces due to subsurface scattering, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.165-174, September 1993 [doi>10.1145/166117.166139]
• 16: Xuejun Hao , Amitabh Varshney, Real-time rendering of translucent meshes, ACM Transactions on Graphics (TOG), v.23 n.2, p.120-142, April 2004 [doi>10.1145/990002.990004]
• 17: Ishimaru, A. 1978. Wave Propagation and Scattering in Random Media. Academic Press.
• 18: Henrik Wann Jensen , Juan Buhler, A rapid hierarchical rendering technique for translucent materials, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 19: Henrik Wann Jensen , Per H. Christensen, Efficient simulation of light transport in scences with participating media using photon maps, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.311-320, July 1998 [doi>10.1145/280814.280925]
• 20: Henrik Wann Jensen , Stephen R. Marschner , Marc Levoy , Pat Hanrahan, A practical model for subsurface light transport, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.511-518, August 2001 [doi>10.1145/383259.383319]
• 21: Tao Ju , Scott Schaefer , Joe Warren, Mean value coordinates for closed triangular meshes, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 22: Vladislav Kraevoy , Alla Sheffer, Cross-parameterization and compatible remeshing of 3D models, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 23: Jens Krüger , Rüdiger Westermann, Linear algebra operators for GPU implementation of numerical algorithms, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 24: Lensch, H. P. A., Goesele, M., Bekaert, P., Magnor, J. K. M. A., Lang, J., and Seidel, H.-P. 2003. Interactive rendering of translucent objects in Comput. Graph. For. 22, 2, 195--205.
• 25: Li, H., Pellacini, F., and Torrance, K. E. 2005. A hybrid monte carlo method for accurate and efficient subsurface scattering. In Rendering Techniques. 283--290.
• 26: Lions, J.-L. 1971. Optimal Control Systems Governed by Partial Differential Equations. Springer-Verlarg.
• 27: Antoine McNamara , Adrien Treuille , Zoran Popović , Jos Stam, Fluid control using the adjoint method, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 28: Tom Mertens , Jan Kautz , Philippe Bekaert , Hans-Peter Seidelz , Frank Van Reeth, Interactive rendering of translucent deformable objects, Proceedings of the 14th Eurographics workshop on Rendering, June 25-27, 2003, Leuven, Belgium
• 29: Srinivasa G. Narasimhan , Mohit Gupta , Craig Donner , Ravi Ramamoorthi , Shree K. Nayar , Henrik Wann Jensen, Acquiring scattering properties of participating media by dilution, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 30: Narasimhan, S. G. and Nayar, S. K. 2003. Shedding light on the weather. In Proccedings of the IEEE Computer Vision and Pattern Recognition (CVPR). 665--672.
• 31: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, All-frequency shadows using non-linear wavelet lighting approximation, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 32: Nicodemus, F. E., Richmond, J. C., Hsia, J. J., Ginsberg, I. W., and Limperis, T. 1977. Geometrical Considerations and Nomenclature for Reflectance. National Bureau of Standards (US).
• 33: Pieter Peers , Karl vom Berge , Wojciech Matusik , Ravi Ramamoorthi , Jason Lawrence , Szymon Rusinkiewicz , Philip Dutré, A compact factored representation of heterogeneous subsurface scattering, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 34: Matt Pharr , Pat Hanrahan, Monte Carlo evaluation of non-linear scattering equations for subsurface reflection, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.75-84, July 2000 [doi>10.1145/344779.344824]
• 35: Serban D. Porumbescu , Brian Budge , Louis Feng , Kenneth I. Joy, Shell maps, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 36: William H. Press , Saul A. Teukolsky , William T. Vetterling , Brian P. Flannery, Numerical recipes in C (2nd ed.): the art of scientific computing, Cambridge University Press, New York, NY, 1992
• 37: John Schreiner , Arul Asirvatham , Emil Praun , Hugues Hoppe, Inter-surface mapping, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 38: Schweiger, M., Arridge, S., M., H., and D.T., D. 1995. The finite element method for the propagation of light in scattering media: Boundary and source conditions. Medical Phys. 22, 11, 1779--1792.
• 39: Martin Schweiger , Adam Gibson , Simon R. Arridge, Computational Aspects of Diffuse Optical Tomography, Computing in Science and Engineering, v.5 n.6, p.33-41, November 2003 [doi>10.1109/MCISE.2003.1238702]
• 40: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 41: Stam, J. 1995. Multiple scattering as a diffusion process. In E. Rendering Workshop. 41--50.
• 42: Marco Tarini , Kai Hormann , Paolo Cignoni , Claudio Montani, PolyCube-Maps, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 43: Xin Tong , Jiaping Wang , Stephen Lin , Baining Guo , Heung-Yeung Shum, Modeling and rendering of quasi-homogeneous materials, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 44: Greg Turk, Re-tiling polygonal surfaces, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.55-64, July 1992
• 45: Rui Wang , John Tran , David Luebke, All-frequency interactive relighting of translucent objects with single and multiple scattering, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 46: Zhang, Z. 1999. Flexible camera calibration by viewing a plane from unknown orientations. In Proccedings IEEE International Conference on Computer Vision (ICCV). 666--673.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques

General Terms:
Algorithms

Keywords:
Appearance modeling and rendering, diffusion approximation, subsurface scattering