Image rendering by adaptive refinement

ABSTRACT

This paper describes techniques for improving the performance of image rendering on personal workstations by using CPU cycles going idle while the user is examining a static image on the screen. In that spirit, we believe that a renderer's work is never done. Our goal is to convey the most information to the user as early as possible, with image quality constantly improving with time. We do this by first generating a crude image rapidly and then adaptively refining it where necessary as long as the user does not change viewing parameters. The renderer operates in a succession of phases, first displaying only vertices of polygons, next polygon edges, then flat shading polygons, then shadowing polygons, then Gouraud shading polygons, then Phong shading polygons, and finally anti-aliasing. Performance is enhanced by each phase using results from previous phases and trimming the amount of data needed by the next phase. In this way, only a fraction of the pixels in an image may be Phong shaded while the rest may be Gouraud or flat shaded. Similarly anti-aliasing is performed only on pixels around which there is significant color change. The system features fast response to user intervention, encourages user intervention at any moment, and makes useful the idle cycles in a personal computer.

REFERENCES

• ATHERTON78: Peter Atherton , Kevin Weiler , Donald Greenberg, Polygon shadow generation, ACM SIGGRAPH Computer Graphics, v.12 n.3, p.275-281, August 1978
• BAUMGART75: Baumgart, Bruce G. A Polyhedron Representation for Computer Vision. NCC 1975, pp. 589-596.
• BLOOMENTHAL83: Jules Bloomenthal, Edge Inference with Applications to Antialiasing, ACM SIGGRAPH Computer Graphics, v.17 n.3, p.157-162, July 1983
• CARPENTER84: Loren Carpenter, The A -buffer, an antialiased hidden surface method, ACM SIGGRAPH Computer Graphics, v.18 n.3, p.103-108, July 1984
• CATMULL74: Edwin Earl Catmull, A subdivision algorithm for computer display of curved surfaces., 1974
• CLARK76: James H. Clark, Hierarchical geometric models for visible surface algorithms, Communications of the ACM, v.19 n.10, p.547-554, Oct. 1976 [doi>10.1145/360349.360354]
• COOK84: Robert L. Cook, Shade trees, ACM SIGGRAPH Computer Graphics, v.18 n.3, p.223-231, July 1984
• CROW84: Franklin C. Crow, Summed-area tables for texture mapping, ACM SIGGRAPH Computer Graphics, v.18 n.3, p.207-212, July 1984
• FORREST85: Forrest, A.R. Antialiasing in Practice in Fundamental Algorithms for Computer Graphics, Ed. Earnshaw, R.A. in Proc. of NATO ASI Series. Springer-Verlag, 1985 pp. 113-134.
• FOURNIER82: Alain Fournier , Don Fussell , Loren Carpenter, Computer rendering of stochastic models, Communications of the ACM, v.25 n.6, p.371-384, June 1982 [doi>10.1145/358523.358553]
• FUCHS82: Fuchs, H., S.M. Pizer, E.R. Heinz, L.C. Tsai, and S.H. Bloomberg Adding a True 3-D Display to a Raster Graphic System. IEEE Computer Graphics and Applications, 2, No. 7 September 1982 pp. 73-78.
• FUCHS85: Henry Fuchs , Jack Goldfeather , Jeff P. Hultquist , Susan Spach , John D. Austin , Frederick P. Brooks, Jr. , John G. Eyles , John Poulton, Fast spheres, shadows, textures, transparencies, and imgage enhancements in pixel-planes, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.111-120, Jul. 1985
• HALL83: Hall, Roy A., and Donald P. Greenberg A Testbed for Realistic Image Synthesis. IEEE Computer Graphics and Applications, 3, No. 8 November 1983 pp. 10-20.
• HILL83: F. S. Hill, Jr. , Sheldon Walker, Jr. , Fuwen Gao, Interactive image query system using progressive transmission, ACM SIGGRAPH Computer Graphics, v.17 n.3, p.323-330, July 1983
• HUNTER78: Gregory Michael Hunter, Efficient computation and data structures for graphics., 1978
• JACKINS80: Jack.ins, C., and Tanimoto, S.L. Oct-trees and Their Use in Representing Three-Dimensional Objects. Computer Graphics and Image Processing, 14, No. 3 November 1980 pp. 249-270.
• KNOWLTON80: Knowlton, Ken Progressive Transmission of Grey-Scale and Binary Pictures by Simple, Efficient, and Lossless Encoding Schemes. Proceedings of the IEEE, 68, No. 7 July 1980 pp. 885-896.
• LANE80: Jeffrey M. Lane , Loren C. Carpenter , Turner Whitted , James F. Blinn, Scan line methods for displaying parametrically defined surfaces, Communications of the ACM, v.23 n.1, p.23-34, Jan. 1980 [doi>10.1145/358808.358815]
• LEE85: Mark E. Lee , Richard A. Redner , Samuel P. Uselton, Statistically optimized sampling for distributed ray tracing, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.61-68, Jul. 1985
• MACDOUGAL84: Paul Duncan Macdougal, Generation and management of object description hierarchies for the simplification of image generation (graphics, rendering, modeling), 1984
• MEAGHER80: Meagher, D. Octree: A New Technique for the Representation, Manipulation and Display of Arbitrary 3-D Objects by Computer. Technical Report IPL-TR-80-111. Rensselaer Polytechnic Institute. 1980.
• MILLS84: Mills, Peter H., Henry Fuchs, and Stephen M. Pizer High-Speed Interaction on a Vibrating Mirror 3D Display. Proceedings of SPIE, 507 August 1984 pp. 93-101.
• NEWMAN73: William M. Newman , Robert F. Sproull, Principles of interactive computer graphics (2nd ed.), McGraw-Hill, Inc., New York, NY, 1979
• POULTON85: Poulton, John, Henry Fuchs, John D. Austin, John G. Eyles, Justin Heinecke, Cheng-Hong Hsieh, Jack Goldfeather, Jeff P. Hultquist, Susan Spach PIXEL-PLANES: Building a VLSI-Based Graphic System Proceedings of the 1985 Chapel Hill Conference on VLSI Computer Science Press pp. 35-60.
• SAMET84: Hanan Samet, The Quadtree and Related Hierarchical Data Structures, ACM Computing Surveys (CSUR), v.16 n.2, p.187-260, June 1984 [doi>10.1145/356924.356930]
• SLOAN79: Sloan, Kenneth R., Jr., and Steven L. Tanimoto Progressive Refinement of Raster Images. IEEE Transactions on Computers, c-28, No. 11 November 1979 pp. 871-874.
• STRAUSS84: Strass, P., M. Shantis, and D. Laidlaw SCEFO: A Standard Scene Format for image Creation and Animation. Brown University Graphics Group Memo, 1984.
• VANDAM86: Van Dam, A. Personal communication. 1986.
• WHITTED80: Turner Whitted, An improved illumination model for shaded display, Communications of the ACM, v.23 n.6, p.343-349, June 1980 [doi>10.1145/358876.358882]

INDEX TERMS

Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Visible line/surface algorithms

General Terms:
Algorithms