Anisotropic diffusion for Monte Carlo noise reduction

ABSTRACT

Monte Carlo sampling can be used to estimate solutions to global light transport and other rendering problems. However, a large number of observations may be needed to reduce the variance to acceptable levels. Rather than computing more observations within each pixel, if spatial coherence exists in image space it can be used to reduce visual error by averaging estimators in adjacent pixels. Anisotropic diffusion is a space-variant noise reduction technique that can selectively preserve texture, edges, and other details using a map of image coherence. The coherence map can be estimated from depth and normal information as well as interpixel color distance. Incremental estimation of the reduction in variance, in conjunction with statistical normalization of interpixel color distances, yields an energy-preserving algorithm that converges to a spatially nonconstant steady state.

REFERENCES

• 1: ACTON, S.T. 1998. Multigrid anisotropic diffusion. IEEE Trans. Image Process. 7, 3 (March), 280-291.
• 2: James Arvo , David Kirk, Particle transport and image synthesis, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.63-66, September 1990, Dallas, TX, USA
• 3: BLACK, M.g., SAPIRO, G., MARIMONT, D.H., AND HEEGER, D. 1998. Robust anisotropic diffusion. IEEE Trans. Image Process. 7, 3 (March), 421-432.
• 4: Mark R. Bolin , Gary W. Meyer, A perceptually based adaptive sampling algorithm, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.299-309, July 1998 [doi>10.1145/280814.280924]
• 5: J Canny, A computational approach to edge detection, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.8 n.6, p.679-698, Nov. 1986 [doi>10.1109/TPAMI.1986.4767851]
• 6: Francine Catté , Pierre-Louis Lions , Jean-Michel Morel , Tomeu Coll, Image selective smoothing and edge detection by nonlinear diffusion, SIAM Journal on Numerical Analysis, v.29 n.1, p.182-193, Feb. 1992 [doi>10.1137/0729012]
• 7: COMMISSION INTERNATIONALE DE L'ECLAIRAGE. 1986. CIE Colorimetry Standard, Tech. Rep., Central Bureau of the CIE.
• 8: COTTET, G. H. AND AYYYADI, M.E. 1998. A Volterra type model for image processing. IEEE Trans. Image Process. 7, 3 (March), 292-303.
• 9: COTTET, G.-H. AND GERMAIN, L. 1993. Image processing through reaction combined with nonlinear diffusion. Math. Comput. 61,204 (Oct.), 659-673.
• 10: Edward R. Dougherty , Jaakko T. Astola, An Introduction to Nonlinear Image Processing, Society of Photo-Optical Instrumentation Engineers (SPIE), Bellingham, WA, 1994
• 11: EVANS, G.F. 1998. Efficient spectral Monte Carlo global illumination. Master's Thesis, University of Waterloo.
• 12: Glenn F. Evans , Micheal D. McCool, Stratified wavelength clusters for efficient spectral Monte Carlo rendering, Proceedings of the 1999 conference on Graphics interface '99, p.42-49, September 1999, Kingston, Ontario, Canada
• 13: James A. Ferwerda , Peter Shirley , Sumanta N. Pattanaik , Donald P. Greenberg, A model of visual masking for computer graphics, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.143-152, August 1997 [doi>10.1145/258734.258818]
• 14: Andrew S. Glassner, Principles of Digital Image Synthesis, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1994
• 15: GREENBERG, D., COHEN, M., AND TORRANCE, K. 1986. Radiosity: A method for computing global illumination. Visual Comput. 2, 5 (Sept.), 291-297.
• 16: Roy Hall, Illumination and color in computer generated imagery, Springer-Verlag New York, Inc., New York, NY, 1988
• 17: Henrik Wann Jensen , Per H. Christensen, Efficient simulation of light transport in scences with participating media using photon maps, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.311-320, July 1998 [doi>10.1145/280814.280925]
• 18: James T. Kajiya, The rendering equation, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.143-150, August 1986
• 19: Alexander Keller, Instant radiosity, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.49-56, August 1997 [doi>10.1145/258734.258769]
• 20: David Kirk , James Arvo, Unbiased sampling techniques for image synthesis, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.153-156, July 1991
• 21: Gregory Ward Larson , Holly Rushmeier , Christine Piatko, A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes, IEEE Transactions on Visualization and Computer Graphics, v.3 n.4, p.291-306, October 1997 [doi>10.1109/2945.646233]
• 22: Mark E. Lee , Richard A. Redner, Filtering: A note on the Use of Nonlinear Filtering in Computer Graphics, IEEE Computer Graphics and Applications, v.10 n.3, p.23-29, May 1990 [doi>10.1109/38.55149]
• 23: Dani Lischinski , Filippo Tampieri , Donald P. Greenberg, Discontinuity Meshing for Accurate Radiosity, IEEE Computer Graphics and Applications, v.12 n.6, p.25-39, November 1992 [doi>10.1109/38.163622]
• 24: Peter Litwinowicz, Processing images and video for an impressionist effect, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.407-414, August 1997 [doi>10.1145/258734.258893]
• 25: MARROQUIN, J.L. 1993. Deterministic interactive particle models for image processing and computer graphics. CVGIP: Graph. Models and Image Process. 55, 5 (Sept.), 408-417.
• 26: MENDENHALL, W., SCHAEFFER, R.L., AND WACKERLY, D.D. 1981. Mathematical Statistics with Applications (2nd ed.). Duxbury Press.
• 27: MYSZKOWSKI, K. 1998. The visible differences predictor: Applications to global illumination problems. In Proceedings of the Eurographics Rendering Workshop, 223-236.
• 28: P. Perona , J. Malik, Scale-Space and Edge Detection Using Anisotropic Diffusion, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.7, p.629-639, July 1990 [doi>10.1109/34.56205]
• 29: PURGATHOFER, W. 1987. A statistical method for adaptive stochastic sampling. In Comput. Graph. (August), 157-162.
• 30: Richard A. Redner , Mark E. Lee , Samuel P. Uselton, Smooth B-spline illumination maps for bidirectional ray tracing, ACM Transactions on Graphics (TOG), v.14 n.4, p.337-362, Oct. 1995 [doi>10.1145/225294.225296]
• 31: Holly E. Rushmeier , Gregory J. Ward, Energy preserving non-linear filters, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.131-138, July 1994 [doi>10.1145/192161.192189]
• 32: Philippe Saint-Marc , Jer-Sen Chen , Gérard Medioni, Adaptive Smoothing: A General Tool for Early Vision, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.6, p.514-529, June 1991 [doi>10.1109/34.87339]
• 33: Michael P. Salisbury , Michael T. Wong , John F. Hughes , David H. Salesin, Orientable textures for image-based pen-and-ink illustration, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.401-406, August 1997 [doi>10.1145/258734.258890]
• 34: Peter Shirley , Changyaw Wang , Kurt Zimmerman, Monte Carlo techniques for direct lighting calculations, ACM Transactions on Graphics (TOG), v.15 n.1, p.1-36, Jan. 1996 [doi>10.1145/226150.226151]
• 35: Philipp Slusallek , Marc Stamminger , Wolfgang Heidrich , Jan-Christian Popp , Hans-Peter Seidel, Composite Lighting Simulations with Lighting Networks, IEEE Computer Graphics and Applications, v.18 n.2, p.22-31, March 1998 [doi>10.1109/38.656787]
• 36: R. Szeliski , D. Terzopoulos, From splines to fractals, ACM SIGGRAPH Computer Graphics, v.23 n.3, p.51-60, July 1989
• 37: TER HARR ROMENY, B., FLORACK, L., KOENDERINK, J., AND VIERGEVER, M. 1997. Scale-Space Theory in Computer Vision. LNCS 1252, Springer-Verlag.
• 38: D Terzopoulos, Image analysis using multigrid relaxation methods, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.8 n.2, p.129-139, March 1986 [doi>10.1109/TPAMI.1986.4767767]
• 39: VEACH, E. AND GUIBAS, L. 1994. Bidirectional estimators for light transport. In Proceedings of the Eurographics Rendering Workshop (June), 147-162.
• 40: Eric Veach , Leonidas J. Guibas, Optimally combining sampling techniques for Monte Carlo rendering, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.419-428, September 1995 [doi>10.1145/218380.218498]
• 41: Eric Veach , Leonidas J. Guibas, Metropolis light transport, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.65-76, August 1997 [doi>10.1145/258734.258775]
• 42: Bruce Walter , Philip M. Hubbard , Peter Shirley , Donald P. Greenberg, Global illumination using local linear density estimation, ACM Transactions on Graphics (TOG), v.16 n.3, p.217-259, July 1997 [doi>10.1145/256157.256158]
• 43: Gregory J. Ward, The RADIANCE lighting simulation and rendering system, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.459-472, July 1994 [doi>10.1145/192161.192286]
• 44: WEICKERT, J., TER HAAR ROMENY, B. M., AND VIERGEVER, M.A. 1998. Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans. Image Process. 7, 3 (March), 398- 410.
• 45: Ross T. Whitaker, Geometry-limited diffusion in the characterization of geometric patches in images, CVGIP: Image Understanding, v.57 n.1, p.111-120, Jan. 1993 [doi>10.1006/ciun.1993.1007]
• 46: Ross T. Whitaker , Stephen M. Pizer, A multi-scale approach to nonuniform diffusion, CVGIP: Image Understanding, v.57 n.1, p.99-110, Jan. 1993 [doi>10.1006/ciun.1993.1006]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION

General Terms:
Algorithms, Design

Keywords:
Monte Carlo methods, anisotropic diffusion, global illumination, image processing, image synthesis, light transport, noise reduction, space-variant filtering