Surfels: surface elements as rendering primitives

ABSTRACT

Surface elements (surfels) are a powerful paradigm to efficiently render complex geometric objects at interactive frame rates. Unlike classical surface discretizations, i.e., triangles or quadrilateral meshes, surfels are point primitives without explicit connectivity. Surfel attributes comprise depth, texture color, normal, and others. As a pre-process, an octree-based surfel representation of a geometric object is computed. During sampling, surfel positions and normals are optionally perturbed, and different levels of texture colors are prefiltered and stored per surfel. During rendering, a hierarchical forward warping algorithm projects surfels to a z-buffer. A novel method called visibility splatting determines visible surfels and holes in the z-buffer. Visible surfels are shaded using texture filtering, Phong illumination, and environment mapping using per-surfel normals. Several methods of image reconstruction, including supersampling, offer flexible speed-quality tradeoffs. Due to the simplicity of the operations, the surfel rendering pipeline is amenable for hardware implementation. Surfel objects offer complex shape, low rendering cost and high image quality, which makes them specifically suited for low-cost, real-time graphics, such as games.

REFERENCES

• 1: Animatek. Caviar Technology. Web page. http://www.animatek.com/.
• 2: Loren Carpenter, The A -buffer, an antialiased hidden surface method, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.103-108, January 1984
• 3: Edwin Earl Catmull, A subdivision algorithm for computer display of curved surfaces., 1974
• 4: Chun-Fa Chang , Gary Bishop , Anselmo Lastra, LDI tree: a hierarchical representation for image-based rendering, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.291-298, July 1999 [doi>10.1145/311535.311571]
• 5: Shenchang Eric Chen, QuickTime VR: an image-based approach to virtual environment navigation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.29-38, September 1995 [doi>10.1145/218380.218395]
• 6: William J. Dally , Leonard McMillan , Gary Bishop , Henry Fuchs, The Delta Tree: An Object-Centered Approach to Image-Based Rendering, Massachusetts Institute of Technology, Cambridge, MA, 1996
• 7: M. Deering. Data Complexity for Virtual Reality: Where do all the Triangles Go? In IEEE Virtual Reality Annual International Symposium (VRAIS), pages 357-363. Seattle, WA, September 1993.
• 8: David S. Ebert , F. Kenton Musgrave , Darwyn Peachey , Ken Perlin , Steven Worley, Texturing and modeling: a procedural approach, Academic Press Professional, Inc., San Diego, CA, 1994
• 9: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 10: L. Gritz. Blue Moon Rendering Tools. Web page. http://www.bmrt.org/.
• 11: J. R Grossman. Point Sample Rendering. Master's thesis, Department of Electrical Engineering and Computer Science, MIT, August 1998.
• 12: J. R Grossman and W. Dally. Point Sample Rendering. In Rendering Techniques '98, pages 181-192. Springer, Wien, Vienna, Austria, July 1998.
• 13: Paul S Heckbert, Survey of texture mapping, IEEE Computer Graphics and Applications, v.6 n.11, p.56-67, November 1986 [doi>10.1109/MCG.1986.276672]
• 14: R Heckbert. Fundamentals of Texture Mapping and Image Warping. Master's thesis, University of California at Berkeley, Department of Electrical Engineering and Computer Science, June 17 1989.
• 15: Gabor T. Herman, Discrete multidimensional Jordan surfaces, CVGIP: Graphical Models and Image Processing, v.54 n.6, p.507-515, Nov. 1992 [doi>10.1016/1049-9652(92)90070-E]
• 16: Arie Kaufman , Daniel Cohen , Roni Yagel, Volume Graphics, Computer, v.26 n.7, p.51-64, July 1993 [doi>10.1109/MC.1993.274942]
• 17: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 18: M. Levoy and T. Whitted. The Use of Points as Display Primitives. Technical Report TR 85-022, The University of North Carolina at Chapel Hill, Department of Computer Science, 1985.
• 19: D. Lischinski and A. Rappoport. Image-Based Rendering for Non-Diffuse Synthetic Scenes. In Rendering Techniques '98, pages 301-314. Springer, Wien, Vienna, Austria, June 1998.
• 20: Nelson Max, Hierarchical rendering of trees from precomputed multi-layer z-buffers, Proceedings of the eurographics workshop on Rendering techniques '96, p.165-174, December 1996, Porto, Portugal
• 21: Leonard McMillan , Gary Bishop, Plenoptic modeling: an image-based rendering system, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.39-46, September 1995 [doi>10.1145/218380.218398]
• 22: V. Popescu and A. Lastra. High Quality 3D Image Warping by Separating Visibility from Reconstruction. Technical Report TR99-002, University of North Carolina, January 15 1999.
• 23: William T. Reeves, Particle systems—a technique for modeling a class of fuzzy objects, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.359-375, July 25-29, 1983, Detroit, Michigan, United States
• 24: G. Schaufler. Per-Object Image Warping with Layered Impostors. In Rendering Techniques '98, pages 145-156. Springer, Wien, Vienna, Austria, June 1998.
• 25: Jonathan Shade , Steven Gortler , Li-wei He , Richard Szeliski, Layered depth images, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.231-242, July 1998 [doi>10.1145/280814.280882]
• 26: A.R. Smith. Smooth Operator. The Economist, pages 73-74, March 6 1999. Science and Technology Section.
• 27: Jay Torborg , James T. Kajiya, Talisman: commodity realtime 3D graphics for the PC, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.353-363, August 1996 [doi>10.1145/237170.237274]
• 28: Douglas Voorhies , Jim Foran, Reflection vector shading hardware, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.163-166, July 1994 [doi>10.1145/192161.192193]
• 29: Lee Westover, Footprint evaluation for volume rendering, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.367-376, September 1990, Dallas, TX, USA

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Viewing algorithms

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Texture
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Graphics data structures and data types
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.7 Feature Measurement
          Subjects: Texture

General Terms:
Design, Measurement, Performance, Theory

Keywords:
rendering systems, texture mapping