Image enhancement by unsharp masking the depth buffer

ABSTRACT

We present a simple and efficient method to enhance the perceptual quality of images that contain depth information. Similar to an unsharp mask, the difference between the original depth buffer content and a low-pass filtered copy is utilized to determine information about spatially important areas in a scene. Based on this information we locally enhance the contrast, color, and other parameters of the image. Our technique aims at improving the perception of complex scenes by introducing additional depth cues. The idea is motivated by artwork and findings in the field of neurology, and can be applied to images of any kind, ranging from complex landscape data and technical artifacts, to volume rendering, photograph, and video with depth information.

REFERENCES

• 1: Adams, A. 1980. The Camera. The Ansel Adams Photography Series. Littel, Brown and Company.
• 2: Azeddine Beghdadi , Alain le Negrate, Contrast enhancement technique based on local detection of edges, Computer Vision, Graphics, and Image Processing, v.46 n.2, p.162-174, May 1989 [doi>10.1016/0734-189X(89)90166-7]
• 3: Bunnell, M. 2005. Dynamic ambient occlusion and indirect lighting. In GPU Gems 2. Addison-Wesley, 223--233.
• 4: Cignoni, P., Scopigno, R., and Tarini, M. 2005. A simple normal enhancement technique for interactive non-photorealistic renderings. Computer & Graphics 29, 1 (feb), 125--133.
• 5: Oliver Deussen , Thomas Strothotte, Computer-generated pen-and-ink illustration of trees, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.13-18, July 2000 [doi>10.1145/344779.344792]
• 6: DiCarlo, J. M., and Wandell, B. A. 2000. Rendering high dynamic range images. In Proceedings of SPIE: Image Sensors, vol. 3965, 392--401.
• 7: Eysenck, M., and Keane, M. 2000. Cognitive Psychology. Psychology Press.
• 8: Amy Gooch , Bruce Gooch , Peter Shirley , Elaine Cohen, A non-photorealistic lighting model for automatic technical illustration, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.447-452, July 1998 [doi>10.1145/280814.280950]
• 9: Hummel, R. A. 1975. Histogram modification techniques. Computer Graphics and Image Processing 4, 3 (sep), 209--224.
• 10: Patrick Ledda , Alan Chalmers , Tom Troscianko , Helge Seetzen, Evaluation of tone mapping operators using a High Dynamic Range display, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 11: McHugh, S., 2005. Digital photography tutorials. http://www.cambridgeincolour.com/tutorials.htm.
• 12: Meylan, L., and Süsstrunk, S. 2004. Bio-inspired color image enhancement. In Proceedings of SPIE: Human Vision and Electronic Imaging, vol. 5292, 46--56.
• 13: Franck Neycenssac, Contrast enhancement using the Laplacian-of-a-Gaussian filter, CVGIP: Graphical Models and Image Processing, v.55 n.6, p.447-463, Nov. 1993 [doi>10.1006/cgip.1993.1034]
• 14: Pharr, M., and Green, S. 2004. Ambient occlusion. In GPU Gems. Addison-Wesley, 279--292.
• 15: Ramesh Raskar , Kar-Han Tan , Rogerio Feris , Jingyi Yu , Matthew Turk, Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 16: Erik Reinhard , Kate Devlin, Dynamic Range Reduction Inspired by Photoreceptor Physiology, IEEE Transactions on Visualization and Computer Graphics, v.11 n.1, p.13-24, January 2005 [doi>10.1109/TVCG.2005.9]
• 17: Erik Reinhard , Michael Stark , Peter Shirley , James Ferwerda, Photographic tone reproduction for digital images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 18: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.197-206, Aug. 1990
• 19: Scharstein, D., and Szeliski, R. 2003. High-accuracy stereo depth maps using structured light. In Proceedings of Computer Vision and Pattern Recognition, 195--202.
• 20: Starck, J., Murtagh, F., Candes, E., and Donoho, D. 2003. Gray and color image contrast enhancement by the curvelet transform. IEEE Transactions on Image Processing 12, 6, 706--717.
• 21: Stark, J. 2000. Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Transactions on Image Processing 9, 5 (may), 889--896.
• 22: Georges Winkenbach , David H. Salesin, Computer-generated pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.91-100, July 1994 [doi>10.1145/192161.192184]
• 23: C. Lawrence Zitnick , Sing Bing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski, High-quality video view interpolation using a layered representation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Keywords:
artistic tone reproduction, complex scenes, image enhancement, non-photorealistic rendering