Two methods for display of high contrast images

ABSTRACT

High contrast images are common in night scenes and other scenes that include dark shadows and bright light sources. These scenes are difficult to display because their contrasts greatly exceed the range of most display devices for images. As a result, the image constrasts are compressed or truncated, obscuring subtle textures and details. Humans view and understand high contrast scenes easily, “adapting” their visual response to avoid compression or truncation with no apparent loss of detail. By imitating some of these visual adaptation processes, we developed methods for the improved display of high-contrast images. The first builds a display image from several layers of lighting and surface properties. Only the lighting layers are compressed, drastically reducing contrast while preserving much of the image detail. This method is practical only for synthetic images where the layers can be retained from the rendering process. The second method interactively adjusts the displayed image to preserve local contrasts in a small “foveal” neighborhood. Unlike the first method, this technique is usable on any image and includes a new tone reproduction operator. Both methods use a sigmoid function for contrast compression. This function has no effect when applied to small signals but compresses large signals to fit within an asymptotic limit. We demonstrate the effectiveness of these approaches by comparing processed and unprocessed images.

REFERENCES

• 1: ADELSON, E.H. 1993. Perceptual organization and the judgment of brightness. Science 262, 2042-2044.
• 2: AREND, L. 1994. Surface colors, illumination, and surface geometry: Intrinsic-image models of human color perception. In Lightness, Brightness, and Transparency, A. L. Gilchrist, Ed., Lawrence Erlbaum, Hillsdale, NJ, 159-214.
• 3: Ian Ashdown, Radiosity: a programmer's perspective, John Wiley & Sons, Inc., New York, NY, 1995
• 4: BARROW, H. G. AND TENENBAUM, J. 1978. Recovering intrinsic scene characteristics from images. In Computer Vision Systems, A. R. Hanson and E. M. Riseman, Eds., Academic, San Diego, CA, 3-26.
• 5: BLACKWELL, H. R. 1946. Contrast thresholds of the human eye. J. Opt. Soc. Am. 36, 11 (Nov.), 624-643.
• 6: Peter J. Burt , Edward H. Adelson, A multiresolution spline with application to image mosaics, ACM Transactions on Graphics (TOG), v.2 n.4, p.217-236, October 1983 [doi>10.1145/245.247]
• 7: CHIU, K., HERF, M., SHIRLEY, P., SWAMY, S., WANG, C., AND ZIMMERMAN, K. 1993. Spatially nonuniform scaling functions for high contrast images. In Proceedings of Graphics Interface '93 (May), 245-254.
• 8: James A. Ferwerda , Sumanta N. Pattanaik , Peter Shirley , Donald P. Greenberg, A model of visual adaptation for realistic image synthesis, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.249-258, August 1996 [doi>10.1145/237170.237262]
• 9: GILCHRIST, A. L. 1990. The perception of surface blacks and whites. In The Perceptual World, I. Rock, Ed., W. H. Freeman, New York, 63-78.
• 10: GILCHRIST, A.L. 1994. Introduction: Absolute versus relative theories of lightness perception. In Lightness, Brightness, and Transparency, A. L. Gilchrist, Ed., Lawrence Erlbaum, Hillsdale, NJ, 1-34.
• 11: GILCHRIST, A. L. AND JACOBSEN, A. 1984. Perception of lightness and illumination in a world of one reflectance. Perception 13, 5-19.
• 12: HENNEMAN, R.H. 1935. A photometric study of the perception of object color. Arch. Psychol. 179, 5-89.
• 13: HODGMAN, C. D., WEAST, R. C., AND SELBY, S. M., EDS. 1971. Handbook of Chemistry and Physics (42nd ed.). Chemical Rubber Publishing, Cleveland, OH, 2954-2955.
• 14: HOOD, D. C. AND FINKELSTEIN, M.A. 1986. Sensitivity to light. In Handbook of Perception and Human Performance, Volume I: Sensory Processes and Perception, K. R. Boff, L. Kaufman, and J. P. Thomas, Eds., Wiley, New York, Chapt. 5, 5.3-5.6.
• 15: HUNT, R. W.G. 1975. The Reproduction of Colour (3rd ed.). Fountain Press, Kings Langley, 5-3 through 5-6. (5th edition available.)
• 16: JOBSON, D. J., RAHMAN, Z., AND WOODELL, G.A. 1997a. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 7 (July), 965-976.
• 17: JOBSON, D. J., RAHMAN, Z., AND WOODELL, G.A. 1997b. Properties and performance of a center/surround retinex. IEEE Trans. Image Process. 6, 3 (March), 451-462.
• 18: KAUFMAN, L. 1986. Section I: Theory and methods, Overview: 10. Scaling. In Handbook of Perception and Human Performance. Volume I: Sensory Processes and Perception, K. R. Boff, L. Kaufman, and J. P. Thomas, Eds., Wiley, New York, 1.55-1.66.
• 19: John K. Kawai , James S. Painter , Michael F. Cohen, Radioptimization: goal based rendering, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.147-154, September 1993 [doi>10.1145/166117.166136]
• 20: Eihachiro Nakamae , Kazufumi Kaneda , Takashi Okamoto , Tomoyuki Nishita, A lighting model aiming at drive simulators, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.395-404, September 1990, Dallas, TX, USA
• 21: OPPENHEIM, A. V., SCHAFER, R. W., AND STOCKHAM, T. G. 1968. Nonlinear filtering of multiplied and convolved signals. Proc. IEEE 56, 8 (August), 1264-1291.
• 22: RAHMAN, Z., JOBSON, D. J., AND WOODELL, G.A. 1996. Multi-scale retinex for color image enhancement. In Proceedings, International Conference on Image Processing, Lausanne, Switzerland, Sept. 16-19. Vol. 3, 1003-1006.
• 23: RIPPS, H. AND WEALE, R.A. 1969. The visual stimulus. In The Eye (2nd ed.), Volume 2A: Visual function in Man: Part I: On Human Vision, H. Davson and L. T. Graham Jr., Eds., Academic, New York, 43-99.
• 24: SCHLICK, C. 1995. Quantization techniques for visualization of high dynamic range pictures. In Photorealistic Rendering Techniques, Proceedings of the Fifth Eurographics Rendering Workshop, (Berlin, 13-15 June), G. Sakas, P. Shirley, and S. Mueller, Eds., 7-20.
• 25: SCHUBERT, J. AND GILCHRIST, A.L. 1992. Relative luminance is not derived from absolute luminance. Investig. Opthalmol. Vis. Sci. 33, 4 (April), 1258.
• 26: SHAPLEY, R. AND ENROTH-CUGELL, C. 1983. Visual adaptation and retinal gain controls. In Progress in Retinal Research, Volume 3, N. N. Osborne and G. J. Chader, Eds., Pergamon Press, Oxford, Chap. 9, 263-346, see p. 283.
• 27: Greg Spencer , Peter Shirley , Kurt Zimmerman , Donald P. Greenberg, Physically-based glare effects for digital images, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.325-334, September 1995 [doi>10.1145/218380.218466]
• 28: STEVENS, J. C. AND STEVENS, S.S. 1963. Brightness function: Effects of adaptation. J. Opt. Soc. Am. 53, 3 (March), 375-385.
• 29: STEVENS, S.S. 1961. To honor Fechner and repeal his law. Science 133, 12 (Jan. 13), 80-86.
• 30: STEVENS, S. S. AND STEVENS, J.C. 1960. Brightness function: Parametric effects of adaptation and contrast. J. Opt. Soc. Am. 50, 11 (Nov.) (Program of the 1960 Annual Meeting), 1139.
• 31: STOCKHAM, T.G. 1972. Image processing in the context of a visual model. Proc. IEEE 60, 7 (July), 828-842.
• 32: TANAKA, T. AND OHNISHI, N. 1997. Painting-like image emphasis based on human vision systems. In EUROGRAPHICS '97, Vol. 16(3), Budapest, Hungary, D. Fellner and L. Szirmay-Kalos, Eds., The Eurographics Association, C253-C260.
• 33: TECHNICAL COMMITTEE 3.1, C. 1981. An Analytic Model for Describing the Influence of Lighting Parameters upon Visual Performance, Volume I: Technical Foundations. Commission Internationale de l'Eclairage (CIE).
• 34: Jack Tumblin , Holly Rushmeier, Tone Reproduction for Realistic Images, IEEE Computer Graphics and Applications, v.13 n.6, p.42-48, November 1993 [doi>10.1109/38.252554]
• 35: VAN ALLSBURG, C. 1984. The Mysteries of Harris Burdick. Houghton Mifflin, New York.
• 36: WALRAVEN, J., ENROTH-CUGELL, C., HOOD, D. C., MACLEOD, D. A. I., AND SCHNAPF, J.L. 1990. The control of visual sensitivity: Receptoral and postreceptoral processes. In Visual Perception: The Neurophysiological Foundations, L. Spillmann and J. S. Werner, Eds., Chapt. 5, Academic, San Diego, CA, 53-101.
• 37: WARD, G. 1991. Real pixels. In Graphics Gems//, J. Arvo, Ed., AP Professional, Cambridge, MA, Chapt. 11.5, 80-85.
• 38: Greg Ward, A contrast-based scalefactor for luminance display, Graphics gems IV, Academic Press Professional, Inc., San Diego, CA, 1994
• 39: Gregory J. Ward, The RADIANCE lighting simulation and rendering system, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.459-472, July 1994 [doi>10.1145/192161.192286]
• 40: Gregory Ward Larson , Holly Rushmeier , Christine Piatko, A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes, IEEE Transactions on Visualization and Computer Graphics, v.3 n.4, p.291-306, October 1997 [doi>10.1109/2945.646233]
• 41: WATKINS, C. AND COY, S. 1992. Photo-Realism and Ray Tracing in C. M & T Press. Also available in Essential Books on Graphics Programming. CD-ROM compilation, Dr. Dobb's J., Miller Freeman, San Francisco, CA, 1995.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.0 General
          Subjects: Image displays
      I.4.1 Digitization and Image Capture
          Subjects: Quantization
      I.4.3 Enhancement
          Subjects: Grayscale manipulation

General Terms:
Algorithms, Human Factors, Measurement

Keywords:
adaptation, tone reproduction, visual appearance