Feature-based light field morphing

ABSTRACT

We present a feature-based technique for morphing 3D objects represented by light fields. Our technique enables morphing of image-based objects whose geometry and surface properties are too difficult to model with traditional vision and graphics techniques. Light field morphing is not based on 3D reconstruction; instead it relies on ray correspondence, i.e., the correspondence between rays of the source and target light fields. We address two main issues in light field morphing: feature specification and visibility changes. For feature specification, we develop an intuitive and easy-to-use user interface (UI). The key to this UI is feature polygons, which are intuitively specified as 3D polygons and are used as a control mechanism for ray correspondence in the abstract 4D ray space. For handling visibility changes due to object shape changes, we introduce ray-space warping. Ray-space warping can fill arbitrarily large holes caused by object shape changes; these holes are usually too large to be properly handled by traditional image warping. Our method can deal with non-Lambertian surfaces, including specular surfaces (with dense light fields). We demonstrate that light field morphing is an effective and easy-to-use technqiue that can generate convincing 3D morphing effects.

REFERENCES

• 1: Thaddeus Beier , Shawn Neely, Feature-based image metamorphosis, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.35-42, July 1992
• 2: Bryan P. Bergeron. Morphing as a means of generating variability in visual medical teaching materials. Computers in Biology and Medicine, 24:11-18, January 1994.
• 3: Chris Buehler , Michael Bosse , Leonard McMillan , Steven Gortler , Michael Cohen, Unstructured lumigraph rendering, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.425-432, August 2001 [doi>10.1145/383259.383309]
• 4: Shenchang Eric Chen , Lance Williams, View interpolation for image synthesis, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.279-288, September 1993 [doi>10.1145/166117.166153]
• 5: Daniel Cohen-Or , Amira Solomovic , David Levin, Three-dimensional distance field metamorphosis, ACM Transactions on Graphics (TOG), v.17 n.2, p.116-141, April 1998 [doi>10.1145/274363.274366]
• 6: Douglas DeCarlo , Jean Gallier, Topological evolution of surfaces, Proceedings of the conference on Graphics interface '96, p.194-203, May 1996, Toronto, Ontario, Canada
• 7: Julie Dorsey , Pat Hanrahan, Modeling and rendering of metallic patinas, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.387-396, August 1996 [doi>10.1145/237170.237278]
• 8: Alexei A. Efros , William T. Freeman, Image quilting for texture synthesis and transfer, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.341-346, August 2001 [doi>10.1145/383259.383296]
• 9: Oliver Faugeras. 3D Computer Vision. The MIT Press, Cambridge, MA, 1993.
• 10: Jonas Gomes , Lucia Darsa , Bruno Costa , Luiz Velho, Warping and morphing of graphical objects, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 11: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 12: Arthur Gregory, Andrei State, Ming C. Lin, Dinesh Manocha, and Mark A. Livingston. Interactive surface decomposition for polyhedral morphing. The Visual Computer, 15(9):453-470, 1999.
• 13: John F. Hughes, Scheduled Fourier volume morphing, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.43-46, July 1992
• 14: James R. Kent , Wayne E. Carlson , Richard E. Parent, Shape transformation for polyhedral objects, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.47-54, July 1992
• 15: Francis Lazarus and Anne Verroust. Three-dimensional metamorphosis: a survey. The Visual Computer, 14(8-9):373-389, 1998.
• 16: Aaron W. F. Lee , David Dobkin , Wim Sweldens , Peter Schröder, Multiresolution mesh morphing, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.343-350, July 1999 [doi>10.1145/311535.311586]
• 17: Apostolos Lerios , Chase D. Garfinkle , Marc Levoy, Feature-based volume metamorphosis, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.449-456, September 1995 [doi>10.1145/218380.218502]
• 18: Marc Levoy. Expanding the horizons of image-based modeling and rendering. In SIGGRAPH 97 Panel:Image-Based Rendering:Really New or Deja Vu, 1997.
• 19: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 20: Wojciech Matusik , Chris Buehler , Ramesh Raskar , Steven J. Gortler , Leonard McMillan, Image-based visual hulls, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.369-374, July 2000 [doi>10.1145/344779.344951]
• 21: Steven M. Seitz , Charles R. Dyer, View morphing, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.21-30, August 1996 [doi>10.1145/237170.237196]
• 22: Steven M. Seitz , Kiriakos N. Kutulakos, Plenoptic Image Editing, Proceedings of the Sixth International Conference on Computer Vision, p.17, January 04-07, 1998
• 23: Jonathan Shade , Steven Gortler , Li-wei He , Richard Szeliski, Layered depth images, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.231-242, July 1998 [doi>10.1145/280814.280882]
• 24: Heung-Yeung Shum , Li-Wei He, Rendering with concentric mosaics, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.299-306, July 1999 [doi>10.1145/311535.311573]
• 25: László Szirmay-Kalos and Werner Purgathofer. Global ray-bundle tracing with hardware acceleration. Eurographics Rendering Workshop 1998, pages 247-258, June 1998.
• 26: George Wolberg. Image morphing: a survey. The Visual Computer, 14(8-9):360-372, 1998.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
        I.4.10 Image Representation
            Subjects: Morphological

General Terms:
Algorithms

Keywords:
3D morphing, feature polygons, global visibility map, light field, ray correspondence, ray-space warping