Depicting procedural caustics in single images

ABSTRACT

We present a powerful technique to simulate and approximate caustics in images. Our algorithm is designed to produce good results without the need to painstakingly paint over pixels. The ability to edit global illumination through image processing allows interaction with images at a level which has not yet been demonstrated, and significantly augments and extends current image-based material editing approaches. We show by means of a set of psychophysical experiments that the resulting imagery is visually plausible and on par with photon mapping, albeit without the need for hand-modeling the underlying geometry.

REFERENCES

• 1: Born, M., and Wolf, E. 1999. Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light, 7^th ed. Cambridge University Press, Cambridge, UK.
• 2: David, H. A. 1988. The Method of Paired Comparisons. Charles Griffin & Company, London.
• 3: Hui Fang , John C. Hart, Textureshop: texture synthesis as a photograph editing tool, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 4: Hui Fang , John C. Hart, RotoTexture: Automated Tools for Texturing Raw Video, IEEE Transactions on Visualization and Computer Graphics, v.12 n.6, p.1580-1589, November 2006 [doi>10.1109/TVCG.2006.102]
• 5: Kendall, M. G., and Babington-Smith, B. 1940. On the method of paired comparisons. Biometrica 31, 3/4, 324--345.
• 6: Erum Arif Khan , Erik Reinhard , Roland W. Fleming , Heinrich H. Bülthoff, Image-based material editing, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 7: Kovesi, P. 1996. Invariant measures of image features from phase information. PhD thesis, The University of Western Australia.
• 8: Kovesi, P. 1997. Symmetry and asymmetry from local phase. In 10^th Australian Joint Converence on Artificial Intelligence, 2--4.
• 9: Kovesi, P. 1999. Image features from phase congruency. Videre: Journal of Computer Vision Research 1, 3, 2--26.
• 10: Kruger, J., Burger, K., and Westermann, R. 2006. Interactive screen-space accurate photon tracing. In Proceedings of the Eurographics Symposium on Rendering, 319--329.
• 11: Langer, M., and Bülthoff, H. H. 2000. Depth discrimination from shading under diffuse lighting. Perception 29, 6, 649--660.
• 12: Patrick Ledda , Alan Chalmers , Tom Troscianko , Helge Seetzen, Evaluation of tone mapping operators using a High Dynamic Range display, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 13: Ankit Mohan , Jack Tumblin , Prasun Choudhury, Editing Soft Shadows in a Digital Photograph, IEEE Computer Graphics and Applications, v.27 n.2, p.23-31, March 2007 [doi>10.1109/MCG.2007.30]
• 14: Morrone, M. C., and Burr, D. C. 1988. Feature detection in human vision: A phase-dependent energy model. Proceedings of the Royal Society of London B 235, 1280, 221--245.
• 15: Byong Mok Oh , Max Chen , Julie Dorsey , Frédo Durand, Image-based modeling and photo editing, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.433-442, August 2001 [doi>10.1145/383259.383310]
• 16: Openheim, A. V., and Lim, J. S. 1981. The importance of phase in signals. Proceedings of the IEEE 69, 5, 529--541.
• 17: Te Pas, S. F., and Pont, S. C. 2005. Estimations of light source direction depend critically on material brdfs. Perception. Supplement ECVP05 34, 212.
• 18: Pearson, E. S., and Hartley, H. O. 1966. Biometrika Tables for Statisticians, 3^rd ed., vol. 1. Cambridge University Press.
• 19: Piotrowski, L. N., and Campbell, F. W. 1982. A demonstration of the visual importance and flexibility of spatial-frequency amplitude and phase. Perception 11, 3, 337--346.
• 20: Azriel Rosenfeld, Axial representations of shape, Computer Vision, Graphics, and Image Processing, v.33 n.2, p.156-173, Feb. 1986 [doi>10.1016/0734-189X(86)90113-1]
• 21: Setyawan, I., and Lagendijk, R. L. 2004. Human perception of geometric distortions in images. In Proceedings of SPIE, Security, Steganography and Watermarking of Multimedia Contents VI, 256--267.
• 22: Musawir A. Shah , Jaakko Konttinen , Sumanta Pattanaik, Caustics Mapping: An Image-Space Technique for Real-Time Caustics, IEEE Transactions on Visualization and Computer Graphics, v.13 n.2, p.272-280, March 2007 [doi>10.1109/TVCG.2007.32]
• 23: Szirmay-Kalos, L., Aszódi, B., Lazányi, I., and Premecz, M. 2005. Approximate ray-tracing on the GPU with distance impostors. Computer Graphics Forum 24, 3, 695--704.
• 24: C. Tomasi , R. Manduchi, Bilateral Filtering for Gray and Color Images, Proceedings of the Sixth International Conference on Computer Vision, p.839, January 04-07, 1998
• 25: Tyler, C. W., Ed. 1996. Human Symmetry Perception and its Computational Analysis. VSP International Science Publishers, Utrecht.
• 26: Wagemans, J. 1995. Detection of visual symmetries. Spatial Vision 9, 1, 9--32.
• 27: Wei Hu , Kaihuai Qin, Interactive Approximate Rendering of Reflections, Refractions, and Caustics, IEEE Transactions on Visualization and Computer Graphics, v.13 n.1, p.46-57, January 2007 [doi>10.1109/TVCG.2007.14]
• 28: Wichmann, F. A., Braun, D. I., and Gegenfurtner, K. R. 2006. Phase noise and the classication of natural images. Vision Research 46, 8/9, 1520--1529.
• 29: Wu, J., and Yang, C.-X. 2005. Detecting image symmetry based on phase information. In Proceedings of the Fourth International Conference on Machine Learning and Cybernetics, 5150--5153.
• 30: Wyman, C., and Dachsbacher, C. 2008. Improving image-space caustics via variable-sized splatting. Journal of Graphics Tools 13, 1, 1--17.
• 31: Chris Wyman , Scott Davis, Interactive image-space techniques for approximating caustics, Proceedings of the 2006 symposium on Interactive 3D graphics and games, March 14-17, 2006, Redwood City, California [doi>10.1145/1111411.1111439]
• 32: Chris Wyman, An approximate image-space approach for interactive refraction, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 33: Wyman, C. 2007. Interactive refractions and caustics using image-space techniques. In ShaderX5: Advanced Rendering Techniques, W. Engel, Ed. Charles River Media, 359--371.
• 34: Chris Wyman, Hierarchical caustic maps, Proceedings of the 2008 symposium on Interactive 3D graphics and games, February 15-17, 2008, Redwood City, California [doi>10.1145/1342250.1342276]
• 35: Zhitao Xiao , Zhengxin Hou , Changyun Miao , Jianming Wang, Using phase information for symmetry detection, Pattern Recognition Letters, v.26 n.13, p.1985-1994, 1 October 2005 [doi>10.1016/j.patrec.2005.02.003]
• 36: Xiaoyan Yuan, Iris Feature Extraction Using 2D Phase Congruency, Proceedings of the Third International Conference on Information Technology and Applications (ICITA'05) Volume 2, p.437-441, July 04-07, 2005 [doi>10.1109/ICITA.2005.166]
• 37: Zabrodsky, H. 1993. Computational Aspects of Pattern Characterization. Continuous Symmetry. PhD thesis, Hebrew University in Jerusalem.
• 38: Steve Zelinka , Hui Fang , Michael Garland , John C. Hart, Interactive material replacement in photographs, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
        I.4.10 Image Representation

Keywords:
high dynamic range imaging, image processing, image-based material editing