Interactive multi-pass programmable shading

ABSTRACT

Programmable shading is a common technique for production animation, but interactive programmable shading is not yet widely available. We support interactive programmable shading on virtually any 3D graphics hardware using a scene graph library on top of OpenGL. We treat the OpenGL architecture as a general SIMD computer, and translate the high-level shading description into OpenGL rendering passes. While our system uses OpenGL, the techniques described are applicable to any retained mode interface with appropriate extension mechanisms and hardware API with provisions for recirculating data through the graphics pipeline. We present two demonstrations of the method. The first is a constrained shading language that runs on graphics hardware supporting OpenGL 1.2 with a subset of the ARB imaging extensions. We remove the shading language constraints by minimally extending OpenGL. The key extensions are color range (supporting extended range and precision data types) and pixel texture (using framebuffer values as indices into texture maps). Our second demonstration is a renderer supporting the RenderMan Interface and RenderMan Shading Language on a software implementation of this extended OpenGL. For both languages, our compiler technology can take advantage of extensions and performance characteristics unique to any particular graphics hardware.

REFERENCES

• 1: BIRCH, P., BLYTHE, D., GRANTHAM, B., JONES. M., SCHAFER, M. SE- GAL, M., AND TANNER, C. An OpenGL++ Specification. SGI, March i997.
• 2: BLYTHE, D., GRANTHAM, B., KILGARD, M. J., MCREYNOLDS, T., NEL- SON, S. R., FOWLER, C., HUI, S., AND WOMACK, P. Advanced graphics programming techniques using OpenGL: Course notes. In Proceedings of SIGGRAPH '99 (July 1999).
• 3: BOCK, D. Tech watch: Volume rendering. Computer Graphics Worm 22, 5 (May 1999).
• 4: Preston Briggs, Register allocation via graph coloring, Rice University, Houston, TX, 1992
• 5: Brian Cabral , Nancy Cam , Jim Foran, Accelerated volume rendering and tomographic reconstruction using texture mapping hardware, Proceedings of the 1994 symposium on Volume visualization, p.91-98, October 17-18, 1994, Tysons Corner, Virginia, United States [doi>10.1145/197938.197972]
• 6: Brian Cabral , Marc Olano , Philip Nemec, Reflection space image based rendering, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.165-170, July 1999 [doi>10.1145/311535.311553]
• 7: Robert L. Cook, Shade trees, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.223-231, January 1984
• 8: Brian Corrie , Paul Mackerras, Data shaders, Proceedings of the 4th conference on Visualization '93, October 25-29, 1993, San Jose, California
• 9: Roger A. Crawfis , Michael J. Allison, A scientific visualization synthesizer, Proceedings of the 2nd conference on Visualization '91, October 22-25, 1991, San Diego, California
• 10: Paul J. Diefenbach , Norman I. Badler, Multi-pass pipeline rendering: realism for dynamic environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.59-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253308]
• 11: Christopher W. Fraser , David R. Hanson , Todd A. Proebsting, Engineering a simple, efficient code-generator generator, ACM Letters on Programming Languages and Systems (LOPLAS), v.1 n.3, p.213-226, Sept. 1992 [doi>10.1145/151640.151642]
• 12: Larry Gritz , James K. Hahn, BMRT: a global illumination implementation of the RenderMan standard, Journal of Graphics Tools, v.1 n.3, p.29-48, 1996
• 13: Paul Haeberli , Kurt Akeley, The accumulation buffer: hardware support for high-quality rendering, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.309-318, September 1990, Dallas, TX, USA
• 14: Pat Hanrahan , Jim Lawson, A language for shading and lighting calculations, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.289-298, September 1990, Dallas, TX, USA
• 15: Mark Harris, Extending microcode compaction for real architectures, Proceedings of the 20th annual workshop on Microprogramming, p.40-53, December 01-04, 1987, Colorado Springs, Colorado, United States [doi>10.1145/255305.255312]
• 16: John C. Hart , Nate Carr , Masaki Kameya , Stephen A. Tibbitts , Terrance J. Coleman, Antialiased parameterized solid texturing simplified for consumer-level hardware implementation, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware, p.45-53, August 08-09, 1999, Los Angeles, California, United States [doi>10.1145/311534.311575]
• 17: Wolfgang Heidrich , Hans-Peter Seidel, Realistic, hardware-accelerated shading and lighting, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.171-178, July 1999 [doi>10.1145/311535.311554]
• 18: Wolfgang Heidrich , Rüdiger Westermann , Hans-Peter Seidel , Thomas Ertl, Applications of pixel textures in visualization and realistic image synthesis, Proceedings of the 1999 symposium on Interactive 3D graphics, p.127-134, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300538]
• 19: JAQUAYS, P., AND HOOK, B. Quake 3: Arena shader manual, revision 10. In Game Developer 'S Conference Hardcore Technical Seminar Notes (December 1999), C. Hecker and J. Lander, Eds., Miller Freeman Game Group.
• 20: KAUTZ, J., AND McCOOL, M. D. Interactive rendering with arbitrary brdfs using separable approximations. Eurographics Rendering Workshop 1999 (June 1999). Held in Granada, Spain.
• 21: Alexander Keller, Instant radiosity, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.49-56, August 1997 [doi>10.1145/258734.258769]
• 22: Olof S. Kylander , Karin Kylander, Gimp the Official Handbook with Cdrom, Coriolis Value, 1999
• 23: MAX, N., DEUSSEN, O., AND KEATING, B. Hierarchical image-based rendering using texture mapping hardware. Rendering Techniques '99 (Proceedings of the lOth Eurographics Workshop on Rendering) (June 1999), 57-62.
• 24: Michael D. McCool , Wolfgang Heidrich, Texture shaders, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware, p.117-126, August 08-09, 1999, Los Angeles, California, United States [doi>10.1145/311534.311585]
• 25: OLANO, M., HART, J. C., HEIDRICH, W., MCCOOL, M., MARK, B., AND PROUDFOOT, K. Approaches for procedural shading on graphics hardware: Course notes. In Proceedings of SIGGRAPH 2000 (July 2000).
• 26: Marc Olano , Anselmo Lastra, A shading language on graphics hardware: the pixelflow shading system, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.159-168, July 1998 [doi>10.1145/280814.280857]
• 27: OPENGL ARB. Extension specification documents, http://www.opengl.org- /Documentation/Extensions.html, March 1999.
• 28: PIXAR. The RenderMan Inte~ace Specification: Version 3.1. Pixar Animation Studios, September 1999.
• 29: SEGAL, M., AKELEY, K., FRAZIER, C., AND LEECH, J. The OpenGL Graphics System: A Specification (Version 1.2.1). Silicon Graphics, Inc., 1999.
• 30: SGI TECHNICAL PUBLICATIONS. Cosmo 3D Programmer's Guide. SGI Technical Publications, 1998.
• 31: Karl Sims, Particle animation and rendering using data parallel computation, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.405-413, September 1990, Dallas, TX, USA
• 32: UPSTILL, S. The RenderMan Companion. Addison-Wesley, 1989.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Texture
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms
      I.3.6 Methodology and Techniques
          Subjects: Languages
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.7 Feature Measurement
          Subjects: Texture

General Terms:
Algorithms, Design, Languages, Measurement, Performance, Theory

Keywords:
OpenGL, graphics hardware, graphics systems, illumination, interactive rendering, languages, multi-pass rendering, non-realistic rendering, procedural shading, programmable shading, rendering, texture mapping, texture synthesis