Unstructured lumigraph rendering

ABSTRACT

We describe an image based rendering approach that generalizes many current image based rendering algorithms, including light field rendering and view-dependent texture mapping. In particular, it allows for lumigraph-style rendering from a set of input cameras in arbitrary configurations (i.e., not restricted to a plane or to any specific manifold). In the case of regular and planar input camera positions, our algorithm reduces to a typical lumigraph approach. When presented with fewer cameras and good approximate geometry, our algorithm behaves like view-dependent texture mapping. The algorithm achieves this flexibility because it is designed to meet a set of specific goals that we describe. We demonstrate this flexibility with a variety of examples.

REFERENCES

• 1: Jin-Xiang Chai , Shing-Chow Chan , Heung-Yeung Shum , Xin Tong, Plenoptic sampling, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.307-318, July 2000 [doi>10.1145/344779.344932]
• 2: Lucia Darsa , Bruno Costa Silva , Amitabh Varshney, Navigating static environments using image-space simplification and morphing, Proceedings of the 1997 symposium on Interactive 3D graphics, p.25-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253298]
• 3: Paul E. Debevec , Camillo J. Taylor , Jitendra Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.11-20, August 1996 [doi>10.1145/237170.237191]
• 4: Paul E. Debevec, Yizhou Yu, and George D. Borshukov. Efficient viewdependent image-based rendering with projective texture-mapping. Eurographics Rendering Workshop 1998.
• 5: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 6: P. Heckbert and H. Moreton. Interpolation for polygon texture mapping and shading. State of the Art in Computer Graphics: Visualization and Modeling, 1991.
• 7: Benno Heigl , Reinhard Koch , Marc Pollefeys , Joachim Denzler , Luc J. Van Gool, Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera, Mustererkennung 1999, 21. DAGM-Symposium, p.94-101, September 15-17, 1999
• 8: Youichi Horry , Ken-Ichi Anjyo , Kiyoshi Arai, Tour into the picture: using a spidery mesh interface to make animation from a single image, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.225-232, August 1997 [doi>10.1145/258734.258854]
• 9: Aaron Isaksen , Leonard McMillan , Steven J. Gortler, Dynamically reparameterized light fields, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.297-306, July 2000 [doi>10.1145/344779.344929]
• 10: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 11: Marc Levoy , Kari Pulli , Brian Curless , Szymon Rusinkiewicz , David Koller , Lucas Pereira , Matt Ginzton , Sean Anderson , James Davis , Jeremy Ginsberg , Jonathan Shade , Duane Fulk, The digital Michelangelo project: 3D scanning of large statues, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.131-144, July 2000 [doi>10.1145/344779.344849]
• 12: Frédéric Pighin , Jamie Hecker , Dani Lischinski , Richard Szeliski , David H. Salesin, Synthesizing realistic facial expressions from photographs, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.75-84, July 1998 [doi>10.1145/280814.280825]
• 13: Kari Pulli , Michael Cohen , Tom Duchamp , Hugues Hoppe , Linda G. Shapiro , Werner Stuetzle, View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data, Proceedings of the Eurographics Workshop on Rendering Techniques '97, p.23-34, June 16-18, 1997
• 14: Ramesh Raskar , Michael S. Brown , Ruigang Yang , Wei-Chao Chen , Greg Welch , Herman Towles , Brent Seales , Henry Fuchs, Multi-projector displays using camera-based registration, Proceedings of the conference on Visualization '99: celebrating ten years, p.161-168, October 1999, San Francisco, California, United States
• 15: Pedro V. Sander , Xianfeng Gu , Steven J. Gortler , Hugues Hoppe , John Snyder, Silhouette clipping, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.327-334, July 2000 [doi>10.1145/344779.344935]
• 16: Jonathan Richard Shewchuk. Triangle: Engineering a 2d quality mesh generator and delaunay triangulator. First Workshop on Applied Computational Geometry, pages 124-133, 1996.
• 17: Heung-Yeung Shum , Li-Wei He, Rendering with concentric mosaics, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.299-306, July 1999 [doi>10.1145/311535.311573]
• 18: Daniel N. Wood , Daniel I. Azuma , Ken Aldinger , Brian Curless , Tom Duchamp , David H. Salesin , Werner Stuetzle, Surface light fields for 3D photography, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.287-296, July 2000 [doi>10.1145/344779.344925]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

General Terms:
Design, Experimentation, Performance, Theory

Keywords:
image-based rendering