High dynamic range preserving compression of light fields and reflectance fields

ABSTRACT

Surface structures at meso- and micro-scale are almost impossible to convincingly reproduce with analytical BRDFs. Therefore, image-based methods like light fields, surface light fields, reflectance fields and bidirectional texture functions became widely accepted to represent spatially nonuniform surfaces. For all of these techniques a set of input photographs from varying view and/or light directions is taken that usually by far exceeds the available graphics memory. The recent development of HDR photography additionally increased the amount of data generated by current acquisition systems since every image needs to be stored as an array of floating point numbers. Furthermore, statistical compression methods -- like principal component analysis (PCA) -- that are commonly used for compression are optimal for linearly distributed values and thus cannot handle the high dynamic range radiance values appropriately.

In this paper, we address both of these problems introduced by the acquisition of high dynamic range light and reflectance fields. Instead of directly compressing the radiance data with a truncated PCA, a non-linear transformation is applied to input values in advance to assure an almost uniform distribution. This does not only significantly improve the approximation quality after an arbitrary tone mapping operator is applied to the reconstructed HDR images, but also allows to efficiently quantize the principal components and even apply hardware-supported texture compression without much further loss of quality. Thus, in addition to the improved visual quality, the storage requirements are reduced by more than an order of magnitude.

REFERENCES

• 1: Wei-Chao Chen , Jean-Yves Bouguet , Michael H. Chu , Radek Grzeszczuk, Light field mapping: efficient representation and hardware rendering of surface light fields, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 2: Kristin J. Dana , Bram van Ginneken , Shree K. Nayar , Jan J. Koenderink, Reflectance and texture of real-world surfaces, ACM Transactions on Graphics (TOG), v.18 n.1, p.1-34, Jan. 1999 [doi>10.1145/300776.300778]
• 3: P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar. Acquiring the reflectance field of a human face. ACM Transactions on Graphics, 19(1):145--156, 2000.
• 4: Paul E. Debevec , Jitendra Malik, Recovering high dynamic range radiance maps from photographs, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.369-378, August 1997 [doi>10.1145/258734.258884]
• 5: J. Kautz. Hardware rendering with bidirectional reflectances. Technical Report TR-99-02, Dept. Comp. Sci., U. of Waterloo, 1999.
• 6: Jan Kautz , Michael D. McCool, Interactive rendering with arbitrary BRDFs using separable approximations, ACM SIGGRAPH 99 Conference abstracts and applications, p.253, August 08-13, 1999, Los Angeles, California, United States [doi>10.1145/311625.312153]
• 7: A. N. Krylov. O čislennom rešenii uravneniâ, kotorym v tehničeskih voprosah opredelâûtsâ častoty malyh kolebanij material'nyh sistem. Izvestiâ Akademii Nauk SSSR, VII(4):491--539, 1931.
• 8: C. Lanczos. An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. Journal of Research of the National Bureau of Standards, 45(4):255--282, 1950.
• 9: Lutz Latta , Andreas Kolb, Homomorphic factorization of BRDF-based lighting computation, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 10: Patrick Ledda , Alan Chalmers , Tom Troscianko , Helge Seetzen, Evaluation of tone mapping operators using a High Dynamic Range display, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 11: Yuanzhen Li , Lavanya Sharan , Edward H. Adelson, Compressing and companding high dynamic range images with subband architectures, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 12: M. D. McCool, J. Ang, and A. Ahmad. Homomorphic factorization of BRDFs for high-performance rendering. ACM Transactions on Graphics, 20(1):185--194, 2001.
• 13: G. Müller, J. Meseth, and R. Klein. Compression and real-time rendering of measured btfs using local pca. In Vision, Modeling and Visualisation 2003, pages 271--280, November 2003.
• 14: G. Müller, J. Meseth, M. Sattler, R. Sarlette, and R. Klein. Acquisition, synthesis and rendering of bidirectional texture functions. Computer Graphics Forum, 24(1):83--109, March 2005.
• 15: G. Müller, R. Sarlette, and R. Klein. Data-driven local coordinate systems for image-based rendering. Computer Graphics Forum, 25(3), September 2006.
• 16: Jacob Munkberg , Petrik Clarberg , Jon Hasselgren , Tomas Akenine-Möller, High dynamic range texture compression for graphics hardware, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 17: K. Nishino, Y. Sato, and K. Ikeuchi. Appearance compression and synthesis based on 3d model for mixed reality. In ICCV (1), pages 38--45, 1999.
• 18: Kimmo Roimela , Tomi Aarnio , Joonas Itäranta, High dynamic range texture compression, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 19: C. Wynn. Real-time brdf-based lighting using cube-maps. NVidia Corporation, 2001.
• 20: Ruifeng Xu , Sumanta N. Pattanaik , Charles E. Hughes, High-Dynamic-Range Still-Image Encoding in JPEG 2000, IEEE Computer Graphics and Applications, v.25 n.6, p.57-64, November 2005 [doi>10.1109/MCG.2005.133]