Rendering from compressed high dynamic range textures on programmable graphics hardware

ABSTRACT

High dynamic range (HDR) images are increasingly employed in games and interactive applications for accurate rendering and illumination. One disadvantage of HDR images is their large data size; unfortunately, even though solutions have been proposed for future hardware, commodity graphics hardware today does not provide any native compression for HDR textures.

In this paper, we perform extensive study of possible methods for supporting compressed HDR textures on commodity graphics hardware. A desirable solution must be implementable on DX9 generation hardware, as well as meet the following requirements. First, the data size should be small and the reconstruction quality must be good. Second, the decompression must be efficient; in particular, bilinear/trilinear/anisotropic texture filtering ought to be performed via native texture hardware instead of custom pixel shader filtering.

We present a solution that optimally meets these requirements. Our basic idea is to convert a HDR texture to a custom LUVW space followed by an encoding into a pair of 8-bit DXT textures. Since DXT format is supported on modern commodity graphics hardware, our approach has wide applicability. Our compression ratio is 3:1 for FP16 inputs, allowing applications to store 3 times the number of HDR texels in the same memory footprint. Our decompressor is efficient and can be implemented as a short pixel program. We leverage existing texturing hardware for fast decompression and native texture filtering, allowing HDR textures to be utilized just like traditional 8-bit DXT textures. Our reduced data size has a further advantage: it is even faster than rendering from uncompressed HDR textures due to our reduced texture memory access. Given the quality and efficiency, we believe our approach suitable for games and interactive applications.

REFERENCES

• 1: Andrew C. Beers , Maneesh Agrawala , Navin Chaddha, Rendering from compressed textures, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.373-378, August 1996 [doi>10.1145/237170.237276]
• 2: David Blythe, The Direct3D 10 system, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 3: Simon Fenney, Texture compression using low-frequency signal modulation, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, July 26-27, 2003, San Diego, California
• 4: Nolan Goodnight , Rui Wang , Cliff Woolley , Greg Humphreys, Interactive time-dependent tone mapping using programmable graphics hardware, Proceedings of the 14th Eurographics workshop on Rendering, June 25-27, 2003, Leuven, Belgium
• 5: Green, C., and McTaggart, G., 2006. High performance HDR rendering on DX9-class hardware, Mar. Poster presented at the ACM Symposium on Interactive 3D Graphics and Games.
• 6: Industrial Light & Magic, 2003. OpenEXR. http://www.openexr.com/.
• 7: Iourcha, K., Nayak, K., and Hong, Z., 1997. System and method for fixed-rate block-based image compression with inferred pixel values". US Patent 5,956,431. See also http://en.wikipedia.org/wiki/S3TC/.
• 8: Yuanzhen Li , Lavanya Sharan , Edward H. Adelson, Compressing and companding high dynamic range images with subband architectures, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 9: Rafal Mantiuk , Grzegorz Krawczyk , Karol Myszkowski , Hans-Peter Seidel, Perception-motivated high dynamic range video encoding, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 10: Jacob Munkberg , Petrik Clarberg , Jon Hasselgren , Tomas Akenine-Möller, High dynamic range texture compression for graphics hardware, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 11: Erik Reinhard , Greg Ward , Sumanta Pattanaik , Paul Debevec, High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005
• 12: Kimmo Roimela , Tomi Aarnio , Joonas Itäranta, High dynamic range texture compression, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 13: Jacob Ström , Tomas Akenine-Möller, iPACKMAN: high-quality, low-complexity texture compression for mobile phones, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, July 30-31, 2005, Los Angeles, California [doi>10.1145/1071866.1071877]
• 14: Greg Ward , Maryann Simmons, Subband encoding of high dynamic range imagery, Proceedings of the 1st Symposium on Applied perception in graphics and visualization, August 07-08, 2004, Los Angeles, California [doi>10.1145/1012551.1012566]
• 15: Gregory J. Ward, The RADIANCE lighting simulation and rendering system, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.459-472, July 1994 [doi>10.1145/192161.192286]
• 16: Ruifeng Xu , Sumanta N. Pattanaik , Charles E. Hughes, High-Dynamic-Range Still-Image Encoding in JPEG 2000, IEEE Computer Graphics and Applications, v.25 n.6, p.57-64, November 2005 [doi>10.1109/MCG.2005.133]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
          Subjects: Graphics processors
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.2 Compression (Coding)

  K. Computing Milieux
  K.8 PERSONAL COMPUTING
      K.8.0 General
          Subjects: Games

General Terms:
Design, Performance

Keywords:
game programming, games & GPUs, graphics hardware, high dynamic range image, texture compression, texturing techniques