Subband encoding of high dynamic range imagery

ABSTRACT

The transition from traditional 24-bit RGB to high dynamic range (HDR) images is hindered by excessively large file formats with no backwards compatibility. In this paper, we propose a simple approach to HDR encoding that parallels the evolution of color television from its grayscale beginnings. A tone-mapped version of each HDR original is accompanied by restorative information carried in a subband of a standard 24-bit RGB format. This subband contains a compressed ratio image, which when multiplied by the tone-mapped foreground, recovers the HDR original. The tone-mapped image data may be compressed, permitting the composite to be delivered in a standard JPEG wrapper. To naïve software, the image looks like any other, and displays as a tone-mapped version of the original. To HDR-enabled software, the foreground image is merely a tone-mapping suggestion, as the original pixel data are available by decoding the information in the subband. We present specifics of the method and the results of encoding a series of synthetic and natural HDR images, using various published global and local tone-mapping operators to generate the foreground images. Errors are visible in only a very small percentage of the pixels after decoding, and the technique requires only a modest amount of additional space for the subband data, independent of image size.

REFERENCES

• 1: Michael Ashikhmin, A tone mapping algorithm for high contrast images, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 2: Simon Baker , Takeo Kanade, Limits on Super-Resolution and How to Break Them, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.9, p.1167-1183, September 2002 [doi>10.1109/TPAMI.2002.1033210]
• 3: Michael Ashikhmin, A tone mapping algorithm for high contrast images, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 4: Scott Daly, The visible differences predictor: an algorithm for the assessment of image fidelity, Digital images and human vision, MIT Press, Cambridge, MA, 1993
• 5: Paul E. Debevec , Jitendra Malik, Recovering high dynamic range radiance maps from photographs, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.369-378, August 1997 [doi>10.1145/258734.258884]
• 6: Paul Debevec, Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.189-198, July 1998 [doi>10.1145/280814.280864]
• 7: Frédo Durand , Julie Dorsey, Fast bilateral filtering for the display of high-dynamic-range images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 8: Raanan Fattal , Dani Lischinski , Michael Werman, Gradient domain high dynamic range compression, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 9: IEC. 2003. 61966-2-2. Extended RGB colour space -- scRGB, Multimedia systems and equipment - Colour measurement and management -- Part 2--2: Colour management.
• 10: JOLLIFFE, C. B., 1950. Answers to Questions about Color Television. <u>members.aol.com/ajaynejr/rca2.htm.</u>
• 11: JOURLIN, M., PINOLI, J-C., 1988. A model for logarithmic image processing, Journal of Microscopy, 149(1), pp. 21--35.
• 12: KAINS, F., BOGART, R., HESS, D., SCHNEIDER, P., ANDERSON, B., 2002. OpenEXR. <u>www.openexr.org/.</u>
• 13: LEFFLER, S., WARMERDAM, F., KISELEV, A., 1999. libTIFF. <u>remotesensing.org/libtiff.</u>
• 14: MOON P., AND SPENCER, D. 1945. The Visual Effect of Non-Uniform Surrounds. Journal of the Optical Society of America, 35, 3, 233--248.
• 15: Sumanta N. Pattanaik , James A. Ferwerda , Mark D. Fairchild , Donald P. Greenberg, A multiscale model of adaptation and spatial vision for realistic image display, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.287-298, July 1998 [doi>10.1145/280814.280922]
• 16: Erik Reinhard , Michael Stark , Peter Shirley , James Ferwerda, Photographic tone reproduction for digital images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 17: SEETZEN, H., WHITEHEAD, L., AND WARD, G. 2003. A High Dynamic Range Display Using Low and High Resolution Modulators. In Proceedings of the Society for Information Display International Symposium, Baltimore, MD.
• 18: STOKES, M., ANDERSON, M., CHANDRASEKAR, S., AND MOTTA, R. A. 1996. Standard Default Color Space for the Internet. <u>www.w3.org/Graphics/Color/sRGB.</u>
• 19: TUMBLIN, J., AND TURK, G. 1999. LCIS: A Boundary Hierarchy for Detail-Preserving Contrast Reduction. ACM Trans. on Graphics, 21,3, 83--90.
• 20: Gregory K. Wallace, The JPEG still picture compression standard, Communications of the ACM, v.34 n.4, p.30-44, April 1991 [doi>10.1145/103085.103089]
• 21: Gregory Ward Larson , Holly Rushmeier , Christine Piatko, A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes, IEEE Transactions on Visualization and Computer Graphics, v.3 n.4, p.291-306, October 1997 [doi>10.1109/2945.646233]
• 22: WARD LARSON, G. 1998. Overcoming Gamut and Dynamic Range Limitations in Digital Images. Proc. of IS&T 6th Color Imaging Conf.
• 23: WARD, G. 1991. Real Pixels. In Graphics Gems II, edited by James Arvo, Academic Press, 80--83.
• 24: Gregory J. Ward, The RADIANCE lighting simulation and rendering system, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.459-472, July 1994 [doi>10.1145/192161.192286]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
        I.4.10 Image Representation

Keywords:
high dynamic range image formats, image processing, lossy compression