Real-time programmable shading

ABSTRACT

One of the main techniques used by software renderers to produce stunningly realistic images is programmable shading—executing an arbitrarily complex program to compute the color at each pixel. Thus far, programmable shading has only been available on software rendering systems that run on general-purpose computers. Rendering each image can take from minutes to hours.Parallel rendering engines, on the other hand, have steadily increased in generality and in performance. We believe that they are nearing the point where they will be able to perform moderately complex shading at real-time rates. Some of the obstacles to this are imposed by hardware, such as limited amounts of frame-buffer memory and the enormous computational resources that are needed to shade in real time. Other obstacles are imposed by software. For example, users generally are not granted access to the hardware at the level required for programmable shading.This paper first explores the capabilities that are needed to perform programmable shading in real times. We then describe the design issues and algorithms for a prototype shading architecture on PixelFlow, an experimental graphics engine under construction. We demonstrate through examples and simulation that PixelFlow will be able to perform high-quality programmable shading at real-time (30 to 60 Hz) rates. We hope that our experience will be useful to shading implementors on other hardware graphics systems.

REFERENCES

• 1: Robert L. Cook , Loren Carpenter , Edwin Catmull, The Reyes image rendering architecture, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.95-102, August 1987
• 2: T. Whitted , D. M. Weimer, A Software Testbed for the Development of 3D Raster Graphics Systems, ACM Transactions on Graphics (TOG), v.1 n.1, p.43-58, Jan. 1982 [doi>10.1145/357290.357295]
• 3: Robert L. Cook, Shade trees, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.223-231, January 1984
• 4: Pat Hanrahan , Jim Lawson, A language for shading and lighting calculations, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.289-298, September 1990, Dallas, TX, USA
• 5: Ken Perlin, An image synthesizer, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.287-296, Jul. 1985
• 6: Upstill, S., The RenderMan Companion, Addison-Wesley. 1990.
• 7: Kurt Akeley, Reality Engine graphics, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.109-116, September 1993 [doi>10.1145/166117.166131]
• 8: Henry Fuchs , John Poulton , John Eyles , Trey Greer , Jack Goldfeather , David Ellsworth , Steve Molnar , Greg Turk , Brice Tebbs , Laura Israel, Pixel-planes 5: a heterogeneous multiprocessor graphics system using processor-enhanced memories, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.79-88, July 1989
• 9: Michael Deering , Stephanie Winner , Bic Schediwy , Chris Duffy , Neil Hunt, The triangle processor and normal vector shader: a VLSI system for high performance graphics, Proceedings of the 15th annual conference on Computer graphics and interactive techniques, p.21-30, June 1988
• 10: Tebbs, B., U. Neumann, J. Eyles, G. Turk, and D. Ellsworth, "Parallel Architectures and Algorithms for Real-Time Synthesis of High Quality Images using Deferred Shading", UNC CS Technical Report TR92-034.
• 11: N. Gharachorloo , S. Gupta , R. F. Sproull , I. E. Sutherland, A characterization of ten rasterization techniques, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.355-368, July 1989
• 12: Steven Molnar , John Eyles , John Poulton, PixelFlow: high-speed rendering using image composition, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.231-240, July 1992
• 13: Geoffrey Y. Gardner, Visual simulation of clouds, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.297-304, July 1985
• 14: Lance Williams, Pyramidal parametrics, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.1-11, July 25-29, 1983, Detroit, Michigan, United States
• 15: James F. Blinn, Simulation of wrinkled surfaces, Proceedings of the 5th annual conference on Computer graphics and interactive techniques, p.286-292, August 23-25, 1978
• 16: Ned Greene, Environment mapping and other applications of world projections, IEEE Computer Graphics and Applications, v.6 n.11, p.21-29, November 1986 [doi>10.1109/MCG.1986.276658]
• 17: Lance Williams, Casting curved shadows on curved surfaces, Proceedings of the 5th annual conference on Computer graphics and interactive techniques, p.270-274, August 23-25, 1978
• 18: William T. Reeves , David H. Salesin , Robert L. Cook, Rendering antialiased shadows with depth maps, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.283-291, August 1987
• 19: John Rhoades , Greg Turk , Andrew Bell , Andrei State , Ulrich Neumann , Amitabh Varshney, Real-time procedural textures, Proceedings of the 1992 symposium on Interactive 3D graphics, p.95-100, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147171]
• 20: Akeley K., Smith K. P., Neider J., OpenGL Reference Manual, Addison-Wesley, 1992.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
          Subjects: Parallel processing
      I.3.6 Methodology and Techniques
          Subjects: Languages

General Terms:
Algorithms, Design, Experimentation, Languages, Performance