A real-time procedural shading system for programmable graphics hardware

ABSTRACT

Real-time graphics hardware is becoming programmable, but this programmable hardware is complex and difficult to use given current APIs. Higher-level abstractions would both increase programmer productivity and make programs more portable. However, it is challenging to raise the abstraction level while still providing high performance. We have developed a real-time procedural shading language system designed to achieve this goal.

Our system is organized around multiple computation frequencies. For example, computations may be associated with vertices or with fragments/pixels. Our system's shading language provides a unified interface that allows a single procedure to include operations from more than one computation frequency.

Internally, our system virtualizes limited hardware resources to allow for arbitrarily-complex computations. We map operations to graphics hardware if possible, or to the host CPU as a last resort. This mapping is performed by compiler back-end modules associated with each computation frequency. Our system can map vertex operations to either programmable vertex hardware or to the host CPU, and can map fragment operations to either programmable fragment hardware or to multipass OpenGL. By carefully designing all the components of the system, we are able to generate highly-optimized code. We demonstrate our system running in real-time on a variety of hardware.

REFERENCES

• 1: Anthony A. Apodaca , Larry Gritz , Brian A. Barsky, Advanced RenderMan: Creating CGI for Motion Picture, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 2: David C. Banks, Illumination in diverse codimensions, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.327-334, July 1994 [doi>10.1145/192161.192246]
• 3: Robert L. Cook, Shade trees, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.223-231, January 1984
• 4: Christopher W. Fraser , David R. Hanson, A Retargetable C Compiler: Design and Implementation, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 5: Pat Hanrahan , Jim Lawson, A language for shading and lighting calculations, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.289-298, September 1990, Dallas, TX, USA
• 6: Wolfgang Heidrich , Hans-Peter Seidel, Realistic, hardware-accelerated shading and lighting, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.171-178, July 1999 [doi>10.1145/311535.311554]
• 7: P. Jaquays and B. Hook. Quake 3: Arena Shader Manual, Revision 10, Sept. 1999.
• 8: M. J. Kilgard. A Practical and Robust Bump-mapping Technique for Today's GPU's. Technical report, NVIDIA Corporation, July 2000. Available at http://www.nvidia.com/.
• 9: E. Lindholm. Vertex Programs for Fixed Function Pipeline. NVIDIA Technical Presentation (from www.nvidia.com), Nov. 2000.
• 10: Erik Lindholm , Mark J. Kligard , Henry Moreton, A user-programmable vertex engine, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.149-158, August 2001 [doi>10.1145/383259.383274]
• 11: William R. Mark , Kekoa Proudfoot, Compiling to a VLIW fragment pipeline, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware, p.47-56, August 2001, Los Angeles, California, United States [doi>10.1145/383507.383526]
• 12: William R. Mark , Kekoa Proudfoot, The F-buffer: a rasterization-order FIFO buffer for multi-pass rendering, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware, p.57-64, August 2001, Los Angeles, California, United States [doi>10.1145/383507.383527]
• 13: M. D. McCool. SMASH: A Next-Generation API for Programmable Graphics Accelerators. Technical Report CS- 2000-14, University of Waterloo, Aug. 2000.
• 14: Microsoft. DirectX 8.0 Programmer's Reference, Oct. 2000.
• 15: Steven Molnar , John Eyles , John Poulton, PixelFlow: high-speed rendering using image composition, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.231-240, July 1992
• 16: NVIDIA Corporation. NVIDIA OpenGL Extension Specifications, May 2001. http://www.nvidia.com/developer/.
• 17: Marc Olano , Anselmo Lastra, A programmable pipeline for graphics hardware, 1998
• 18: Marc Olano , Anselmo Lastra, A shading language on graphics hardware: the pixelflow shading system, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.159-168, July 1998 [doi>10.1145/280814.280857]
• 19: Mark S. Peercy , Marc Olano , John Airey , P. Jeffrey Ungar, Interactive multi-pass programmable shading, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.425-432, July 2000 [doi>10.1145/344779.344976]
• 20: Ken Perlin, An image synthesizer, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.287-296, July 1985
• 21: M. Segal, K. Akeley, C. Frazier, and J. Leech. The OpenGL Graphics System: A Specification (Version 1.2), Mar. 1998.
• 22: Xiaoyuan Tu , Demetri Terzopoulos, Artificial fishes: physics, locomotion, perception, behavior, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.43-50, July 1994 [doi>10.1145/192161.192170]
• 23: Steve Upstill, RenderMan Companion: A Programmer's Guide to Realistic Computer Graphics, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation

Additional Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications
          Subjects: Specialized application languages

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
          Subjects: Graphics processors
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

General Terms:
Algorithms, Performance, Reliability

Keywords:
graphics hardware, graphics systems, rendering, shading languages