Dynamically reparameterized light fields

ABSTRACT

This research further develops the light field and lumigraph image-based rendering methods and extends their utility. We present alternate parameterizations that permit 1) interactive rendering of moderately sampled light fields of scenes with significant, unknown depth variation and 2) low-cost, passive autostereoscopic viewing. Using a dynamic reparameterization, these techniques can be used to interactively render photographic effects such as variable focus and depth-of-field within a light field. The dynamic parameterization is independent of scene geometry and does not require actual or approximate geometry of the scene. We explore the frequency domain and ray-space aspects of dynamic reparameterization, and present an interactive rendering technique that takes advantage of today's commodity rendering hardware.

REFERENCES

• 1: Nicholas Ayache and Charles Hansen. Rectification of images for binocular and trinocular stereovision. In ICPR88, pages 11-16, 1988.
• 2: R.C. Bolles, H.H. Baker, and D.H. Marimont. Epipolar-plane image analysis: An approach to determining structure from motion. IJCV, 1(1):7-56, 1987.
• 3: Emilio Camahort, Apostolos Lerios, and Donald Fussell. Uniformly sampled light fields. Eurographics Rendering Workshop 1998, pages 117-130, 1998.
• 4: Jin-Xiang Chai , Shing-Chow Chan , Heung-Yeung Shum , Xin Tong, Plenoptic sampling, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.307-318, July 2000 [doi>10.1145/344779.344932]
• 5: Olivier D. Faugeras, What can be seen in three dimensions with an uncalibrated stereo rig, Proceedings of the Second European Conference on Computer Vision, p.563-578, May 19-22, 1992
• 6: Fresnel Technologies. #300 Itex Lens Array, 1999. http://www.fresneltech.com.
• 7: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 8: Xianfeng Gu , Steven J. Gortler , Michael F. Cohen, Polyhedral Geometry and the Two-Plane Parameterization, Proceedings of the Eurographics Workshop on Rendering Techniques '97, p.1-12, June 16-18, 1997
• 9: Paul Haeberli , Kurt Akeley, The accumulation buffer: hardware support for high-quality rendering, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.309-318, Aug. 1990
• 10: Michael Halle. The generalized holographic stereogram. Master's thesis, Program in Media Arts and Sciences, Massachusetts Institute of Technology, 1991.
• 11: Wolfgang Heidrich , Philipp Slusallek , Hans-Peter Seidel, An image-based model for realistic lens systems in interactive computer graphics, Proceedings of the conference on Graphics interface '97, p.68-75, May 1997, Kelowna, British Columbia, Canada
• 12: Aaron Isaksen, Leonard McMilland, and Steven J. Gortler. Dynamically reparameterized light fields. Technical Report LCS-TR-778, Massachusetts Institute of Technology, May 1999.
• 13: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 14: Microsoft Corporation. Microsoft DirectX 7.0, 1999. http://www.microsoft.com/directx.
• 15: Don P. Mitchell , Arun N. Netravali, Reconstruction filters in computer-graphics, ACM SIGGRAPH Computer Graphics, v.22 n.4, p.221-228, Aug. 1988
• 16: Takanori Okoshi. Three-Dimensional Imaging Techniques. Academic Press, Inc., New York, 1976.
• 17: Paul Haeberli. A multifocus method for controlling depth of field. Technical report, SGI, October 1994. http://www.sgi.com/grafica/depth/index.html.
• 18: A. P. Pentland, A new sense for depth of field, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.9 n.4, p.523-531, July 1987 [doi>10.1109/TPAMI.1987.4767940]
• 19: Matthew J. P. Regan , Gavin S. P. Miller , Steven M. Rubin , Chris Kogelnik, A real-time low-latency hardware light-field renderer, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.287-290, July 1999 [doi>10.1145/311535.311569]
• 20: Hartmut Schirmacher, Wolfgang Heidrich, and Hans-Peter Seidel. Adaptive acquisition of lumigraphs from synthetic scenes. Computer Graphics Forum, 18(3): 151-160, September 1999. ISSN 1067-7055.
• 21: Heung-Yeung Shum , Li-Wei He, Rendering with concentric mosaics, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.299-306, July 1999 [doi>10.1145/311535.311573]
• 22: Peter-Pike Sloan , Michael F. Cohen , Steven J. Gortler, Time critical lumigraph rendering, Proceedings of the 1997 symposium on Interactive 3D graphics, p.17-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253296]
• 23: Warren J. Smith. Practical Optical System Layout. McGraw-Hill, 1997.
• 24: R.F. Stevens and N. Davies. Lens arrays and photography. Journal of Photographic Science, 39(5): 199-208, 1991.
• 25: Peter Sturm, Critical Motion Sequences for Monocular Self-Calibration and Uncalibrated Euclidean Reconstruction, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1100, June 17-19, 1997
• 26: R.Y. Tsai. An efficient and accurate camera calibration technique for 3-d machine vision. In CVPR, pages 364-374, 1986.
• 27: L. Yang, M. McCormick, and N. Davies. Discussion of the optics of a new 3d imaging system. Applied Optics, 27(21):4529-4534, 1988.
• 28: Z.Y. Zhang. Flexible camera calibration by viewing a plane from unknown orientations. In ICCV, pages 666-673, 1999.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Viewing algorithms

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Graphics data structures and data types
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Raytracing

General Terms:
Design, Measurement, Performance, Theory

Keywords:
autostereoscopic displays, depth of field, frequency domain analysis, image-based rendering, light field, lumigraph, multitexturing, ray space analysis, synthetic aperture