Spatially-encoded far-field representations for interactive walkthroughs

ABSTRACT

We introduce the notion of spatially encoded video and use it for efficiently representing image-based impostors for interactive walkthroughs. As part of a pre-process, we automatically decompose the model and compute the far-fields. The resulting texture images are organized along multiple dimensions and can be accessed in a user-steered order at interactive rates. Our encoding algorithm can compress the impostors size by two orders of magnitude. Furthermore, the storage cost for additional impostors or samples grows sub-linearly. The resulting system has been applied to a complex CAD environment composed of 13 million triangles. We are able to render it at interactive rates on a PC with little loss in image quality.

REFERENCES

• ABC95: Maneesh Agrawala , Andrew C. Beers , Navin Chaddha, Model-based motion estimation for synthetic animations, Proceedings of the third ACM international conference on Multimedia, p.477-488, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215312]
• ACW+99: Daniel Aliaga , Jon Cohen , Andrew Wilson , Eric Baker , Hansong Zhang , Carl Erikson , Kenny Hoff , Tom Hudson , Wolfgang Stuerzlinger , Rui Bastos , Mary Whitton , Fred Brooks , Dinesh Manocha, MMR: an interactive massive model rendering system using geometric and image-based acceleration, Proceedings of the 1999 symposium on Interactive 3D graphics, p.199-206, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300554]
• AL99: Daniel G. Aliaga , Anselmo Lastra, Automatic image placement to provide a guaranteed frame rate, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.307-316, July 1999 [doi>10.1145/311535.311574]
• Ali96: Daniel G. Aliaga, Visualization of complex models using dynamic texture-based simplification, Proceedings of the 7th conference on Visualization '96, p.101-ff., October 28-29, 1996, San Francisco, California, United States
• BAC96: Andrew C. Beers , Maneesh Agrawala , Navin Chaddha, Rendering from compressed textures, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.373-378, August 1996 [doi>10.1145/237170.237276]
• COMF99: Daniel Cohen-Or , Yair Mann , Shachar Fleishman, Deep compression for streaming texture intensive animations, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.261-267, July 1999 [doi>10.1145/311535.311564]
• DCV98: L. Darsa, B. Costa, and A. Varshney. Walkthroughs of complex environments using image-based simplification. Computer and Graphics, 22( 1 ):55-69, 1998.
• DSSD99: X. Decoret, G. Schaufler, E Sillion, and J. Dorsey. Multilayered impostors for accelerated rendering. Computer Graphics Forum, 18(3), 1999.
• GD98: J. Grossman and W. J. Dally. Point sample rendering. Eurogrphits Workshop on Rencrring, pages 181-192.1998.
• GGSC96: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• GYM93: Brian K. Guenter , Hee Cheol Yun , Russell M. Mersereau, Motion compensated compression of computer animation frames, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.297-304, September 1993 [doi>10.1145/166117.166155]
• HLS00: Ziyad S. Hakura , Jerome Edward Lengyel , John M. Snyder, Parameterized Animation Compression, Proceedings of the Eurographics Workshop on Rendering Techniques 2000, p.101-112, June 26-28, 2000
• Leg91: Didier Le Gall, MPEG: a video compression standard for multimedia applications, Communications of the ACM, v.34 n.4, p.46-58, April 1991 [doi>10.1145/103085.103090]
• Lev95: Marc Levoy, Polygon-assisted JPEG and MPEG compression of synthetic images, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.21-28, September 1995 [doi>10.1145/218380.218392]
• LF99: Paul Lalonde , Alain Fournier, Interactive rendering of wavelet projected light fields, Proceedings of the 1999 conference on Graphics interface '99, p.107-114, September 1999, Kingston, Ontario, Canada
• LH96: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• LS97: Jed Lengyel , John Snyder, Rendering with coherent layers, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.233-242, August 1997 [doi>10.1145/258734.258856]
• MG00: M. Magnor and B. Girod. Model-based coding of multiviewnoint imanerv. SPIE Confercwe on Visunl Communications and image Pressing, pages 14-22, 2000.
• MMB97: William R. Mark , Leonard McMillan , Gary Bishop, Post-rendering 3D warping, Proceedings of the 1997 symposium on Interactive 3D graphics, p.7-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253292]
• MO95: N. Max and K. Ohsaki. Rendering trees from precomputed Z- buffer views. In Eurographrcs Renderrng Workshop 1995, 1995.
• MRP98: G. Miller, S. Rubin, and D. Poncelen. Lazy decompression of surface light fields for pre-computer global illumination. Proc. qf Eurographics Workshop on Rendering, pages 281-292, 1998.
• MS95: Paulo W. C. Maciel , Peter Shirley, Visual navigation of large environments using textured clusters, Proceedings of the 1995 symposium on Interactive 3D graphics, p.95-ff., April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199420]
• PZvBG00: Hanspeter Pfister , Matthias Zwicker , Jeroen van Baar , Markus Gross, Surfels: surface elements as rendering primitives, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.335-342, July 2000 [doi>10.1145/344779.344936]
• RAL98: M. M. Rafferty , D. G. Aliaga , A. A. Lastra, 3D Image Warping in Architectural Walkthroughs, Proceedings of the Virtual Reality Annual International Symposium, p.228, March 14-18, 1998
• SDB97: F. Sillion, G. Drettakis,, and B. Bodelet. Efficient impostor manipulation for real-time wualization of urban scenery. In Computer Graphics Forum, volume 16,1997.
• SGwHS98: Jonathan Shade , Steven Gortler , Li-wei He , Richard Szeliski, Layered depth images, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.231-242, July 1998 [doi>10.1145/280814.280882]
• SLS+96: Jonathan Shade , Dani Lischinski , David H. Salesin , Tony DeRose , John Snyder, Hierarchical image caching for accelerated walkthroughs of complex environments, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.75-82, August 1996 [doi>10.1145/237170.237209]
• SS96: G. Schaufler and W. Stunlinger. A three dimensional image cache for virtual reality. Computer Graphics Forum, 15(3):C227- C235,1996.
• Uni95: International Telecommunications Union. Generic coding of moving pictures and associated audio information. ZTU-T Recommendation H.262, 1995.
• WKC94: Dan S. Wallach , Sharma Kunapalli , Michael F. Cohen, Accelerated MPEG compression of dynamic polygonal scenes, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.193-196, July 1994 [doi>10.1145/192161.192198]
• WLM+00: Andrew Wilson , Ming C. Lin , Boon-Lock Yeo , Minerva Yeung , Dinesh Manocha, A video-based rendering acceleration algorithm for interactive walkthroughs, Proceedings of the eighth ACM international conference on Multimedia, p.75-83, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.354431]

INDEX TERMS

Primary Classification:
  E. Data
  E.4 CODING AND INFORMATION THEORY
      Subjects: Data compaction and compression

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.5 Implementation
          Subjects: Interactive systems

General Terms:
Design, Experimentation, Performance

Keywords:
MPEG, image databases, image-based rendering, rendering systems, spatial data structures