Polynomial texture maps

ABSTRACT

In this paper we present a new form of texture mapping that produces increased photorealism. Coefficients of a biquadratic polynomial are stored per texel, and used to reconstruct the surface color under varying lighting conditions. Like bump mapping, this allows the perception of surface deformations. However, our method is image based, and photographs of a surface under varying lighting conditions can be used to construct these maps. Unlike bump maps, these Polynomial Texture Maps (PTMs) also capture variations due to surface self-shadowing and interreflections, which enhance realism. Surface colors can be efficiently reconstructed from polynomial coefficients and light directions with minimal fixed-point hardware. We have also found PTMs useful for producing a number of other effects such as anisotropic and Fresnel shading models and variable depth of focus. Lastly, we present several reflectance function transformations that act as contrast enhancement operators. We have found these particularly useful in the study of ancient archeological clay and stone writings.

REFERENCES

• Banks 94: David C. Banks, Illumination in diverse codimensions, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.327-334, July 1994 [doi>10.1145/192161.192246]
• Blinn 78: James Frederick Blinn, Computer display of curved surfaces., 1978
• Blythe 99: Blythe, D., McReynolds, T., "Lighting and Shading Techniques for Interactive Applications", Course Notes (Siggraph 99 Course 1 2), August, 1999, p. 101.
• Born 80: Born, Max, Wolf, Emil, "Principles of Optics", 6 th edition, Appendix VII, Cambridge University Press, Cambridge, 1980.
• Cabral 87: Brian Cabral , Nelson Max , Rebecca Springmeyer, Bidirectional reflection functions from surface bump maps, ACM SIGGRAPH Computer Graphics, v.21 n.4, p.273-281, July 1987
• Dana 99: Kristin J. Dana , Bram van Ginneken , Shree K. Nayar , Jan J. Koenderink, Reflectance and texture of real-world surfaces, ACM Transactions on Graphics (TOG), v.18 n.1, p.1-34, Jan. 1999 [doi>10.1145/300776.300778]
• Debevec 00: Paul Debevec , Tim Hawkins , Chris Tchou , Haarm-Pieter Duiker , Westley Sarokin , Mark Sagar, Acquiring the reflectance field of a human face, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.145-156, July 2000 [doi>10.1145/344779.344855]
• Epstein 95: Epstein, R., Hallinan, P., Yuille, A., "5 +/- 2 Eigenimages Suffice: An Empircal Investigation of Low- Dimensional Lighting Models, IEEE Workshop on Physics-Based Vision: 108-116, 1995.
• Epstein 96: R. Epstein , Alan L. Yuille , Peter N. Belhumeur, Learning Object Representation form Lighting Variations, Proceedings of the International Workshop on Object Representation in Computer Vision II, p.179-199, April 13-14, 1996
• Georghiades 99: Athinodoros S. Georghiades , Peter N. Belhumeur , David J. Kriegman, Illumination-Based Image Synthesis: Creating Novel Images of Human Faces Under Differing Pose and Lighting, Proceedings of the IEEE Workshop on Multi-View Modeling & Analysis of Visual Scenes, p.47, June 21-23, 1999
• Golub 89: Golub, G., van Loan, C., "Matrix Computations", Johns Hopkins University Press, Baltimore, 1989.
• Gortler 96: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• Hall 89: Roy Hall, Illumination and color in computer generated imagery, Springer-Verlag New York, Inc., New York, NY, 1988
• He 91: Xiao D. He , Kenneth E. Torrance , François X. Sillion , Donald P. Greenberg, A comprehensive physical model for light reflection, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.175-186, July 1991
• Heidrich 99: Wolfgang Heidrich , Hans-Peter Seidel, Realistic, hardware-accelerated shading and lighting, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.171-178, July 1999 [doi>10.1145/311535.311554]
• Kilgard 00: Kilgard. M.,"A Practical and Robust Bump-mapping Technique for Today's GPUs", Game Developers Conference (GDC) 2000: Advanced OpenGL, also available at nvidia.com.
• Lafortune 97: Eric P. F. Lafortune , Sing-Choong Foo , Kenneth E. Torrance , Donald P. Greenberg, Non-linear approximation of reflectance functions, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.117-126, August 1997 [doi>10.1145/258734.258801]
• Levoy 96: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• Malzbender 00: Malzbender, T., Gelb, D., Wolters, H., Zuckerman, B., "Enhancement of Shape Perception by Surface Reflectance Transformation", Hewlett-Packard Technical Report HPL-2000-38, March 2000.
• Marschner 99: Marschner, S., Westin, S., Lafortune, E., Torrance, K., Greenberg, D., "Image-Based BRDF Measurement Including Human Skin", Rendering Techniques 99: Proceedings of the 1 0 th Eurographics Workshop on Rendering, June 1999, ISBN 3-211-83382-X, pp. 131-144.
• Motta 00: Motta, G., "Compression of Polynomial Texture Maps", Hewlett-Packard Laboratories Technical Report, HPL- 2000-143, October 30, 2000.
• Nicodemus 77: Nicodemus, F.E., Richmond, J.C., Hsai, J.J., "Geometrical Considerations and Nomenclature for Reflectance", U.S. Dept. of Commerce, National Bureau of Standards, October 1977.
• Nimeroff 94: Nimeroff, J., Simoncelli, E., Dorsey, J., "Efficient Re-rendering of Naturally Illuminated Environments", Eurographics Rendering Workshop Proceedings 1994, pp. 359- 374.
• Nishino 99: Nishino, K., Sato, Y., Katsushi, I., "Eigen-texture Method - Appearance Compression based on 3D Model", IEEE Computer Vision and Pattern Recognition, June 23-25 1999, Vol. 1, pp.618-624.
• Phong 75: Bui Tuong Phong, Illumination for computer generated pictures, Communications of the ACM, v.18 n.6, p.311-317, June 1975 [doi>10.1145/360825.360839]
• Ramamoorthi 01: Ravi Ramamoorthi , Pat Hanrahan, An efficient representation for irradiance environment maps, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.497-500, August 2001 [doi>10.1145/383259.383317]
• Rushmeier 97: Holly E. Rushmeier , Gabriel Taubin , André Guéziec, Appying Shape from Lighting Variation to Bump Map Capture, Proceedings of the Eurographics Workshop on Rendering Techniques '97, p.35-44, June 16-18, 1997
• Schilling 96: Andreas Schilling , Günter Knittel , Wolfgang Strasser, Texram: A Smart Memory for Texturing, IEEE Computer Graphics and Applications, v.16 n.3, p.32-41, May 1996 [doi>10.1109/38.491183]
• Schilling 97: Andreas Schilling, Towards real-time photorealistic rendering: challenges and solutions, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware, p.7-15, August 03-04, 1997, Los Angeles, California, United States [doi>10.1145/258694.258701]
• Sillion 91: Françis X. Sillion , James R. Arvo , Stephen H. Westin , Donald P. Greenberg, A global illumination solution for general reflectance distributions, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.187-196, July 1991
• Stalling 97: Detlev Stalling , Malte Zöckler , Hans-Christian Hege, Fast Display of Illuminated Field Lines, IEEE Transactions on Visualization and Computer Graphics, v.3 n.2, p.118-128, April 1997 [doi>10.1109/2945.597795]
• Stam 99: Jos Stam, Diffraction shaders, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.101-110, July 1999 [doi>10.1145/311535.311546]
• Teo 97: Patrick C. Teo , Eero P. Simoncelli , David J. Heeger, Efficient Linear Re-rendering for Interactive Lighting Design, Stanford University, Stanford, CA, 1997
• Watson 80: Watson, G.A., "Approximation Theory and Numerical Methods", A.J.Wiley & Sons, Chichester, 1980.
• Wood 00: Daniel N. Wood , Daniel I. Azuma , Ken Aldinger , Brian Curless , Tom Duchamp , David H. Salesin , Werner Stuetzle, Surface light fields for 3D photography, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.287-296, July 2000 [doi>10.1145/344779.344925]
• Wong 97: Tien-Tsin Wong , Pheng-Ann Heng , Siu-Hang Or , Wai-Yin Ng, Image-based Rendering with Controllable Illumination, Proceedings of the Eurographics Workshop on Rendering Techniques '97, p.13-22, June 16-18, 1997

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Reflectance

General Terms:
Experimentation, Performance, Theory

Keywords:
graphics hardware, illumination, image processing, image-based rendering, reflectance & shading models, texture mapping