Interactive deformation of light fields

ABSTRACT

We present a software pipeline that enables an animator to deform light fields. The pipeline can be used to deform complex objects, such as furry toys, while maintaining photo-realistic quality. Our pipeline consists of three stages. First, we split the light field into sub-light fields. To facilitate splitting of complex objects, we employ a novel technique based on projected light patterns. Second, we deform each sub-light field. To do this, we provide the animator with controls similar to volumetric free-form deformation. Third, we recombine and render each sub-light field. Our rendering technique properly handles visibility changes due to occlusion among sub-light fields. To ensure consistent illumination of objects after they have been deformed, our light fields are captured with the light source fixed to the camera, rather than being fixed to the object. We demonstrate our deformation pipeline using synthetic and photographically acquired light fields. Potential applications include animation, interior design, and interactive gaming.

REFERENCES

• 1: Alan H. Barr, Global and local deformations of solid primitives, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.21-30, January 1984
• 2: Paul Debevec , Tim Hawkins , Chris Tchou , Haarm-Pieter Duiker , Westley Sarokin , Mark Sagar, Acquiring the reflectance field of a human face, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.145-156, July 2000 [doi>10.1145/344779.344855]
• 3: Michael Goesele , Hendrik P. A. Lensch , Jochen Lang , Christian Fuchs , Hans-Peter Seidel, DISCO: acquisition of translucent objects, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 4: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 5: Johnston, O., and Thomas, F. 1995. The Illusion of Life: Disney Animation. Disney Editions.
• 6: Kurzion, Y., and Yagel, R. 1996. Continuous and discontinuous deformation using ray deflectors. In Proc. GRAPHICON 1996.
• 7: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 8: Marc Levoy , Billy Chen , Vaibhav Vaish , Mark Horowitz , Ian McDowall , Mark Bolas, Synthetic aperture confocal imaging, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 9: Levoy, M. 2004. Stanford spherical gantry. http://graphics.stanford.edu/projects/gantry.
• 10: Wojciech Matusik , Hanspeter Pfister , Addy Ngan , Paul Beardsley , Remo Ziegler , Leonard McMillan, Image-based 3D photography using opacity hulls, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 11: Byong Mok Oh , Max Chen , Julie Dorsey , Frédo Durand, Image-based modeling and photo editing, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.433-442, August 2001 [doi>10.1145/383259.383310]
• 12: Rangaswamy, S. 1998. Interactive editing tools for image-based rendering. Master's thesis, MIT.
• 13: Thomas W. Sederberg , Scott R. Parry, Free-form deformation of solid geometric models, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.151-160, August 1986
• 14: Steven M. Seitz , Kiriakos N. Kutulakos, Plenoptic Image Editing, Proceedings of the Sixth International Conference on Computer Vision, p.17, January 04-07, 1998
• 15: Heung-Yeung Shum , Li-Wei He, Rendering with concentric mosaics, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.299-306, July 1999 [doi>10.1145/311535.311573]
• 16: Shum, H.-Y., and Kang, S. B. 2000. A review of image-based rendering techniques. In Proc. VCIP 2000.
• 17: Warren, J., Schaefer, S., Hirani, A., and Desbrun, M. Barycentric coordinates for smooth convex sets (submitted).
• 18: Tim Weyrich , Hanspeter Pfister , Markus Gross, Rendering Deformable Surface Reflectance Fields, IEEE Transactions on Visualization and Computer Graphics, v.11 n.1, p.48-58, January 2005 [doi>10.1109/TVCG.2005.14]
• 19: Zhunping Zhang , Lifeng Wang , Baining Guo , Heung-Yeung Shum, Feature-based light field morphing, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002

INDEX TERMS

Keywords:
3D photography, deformation, image-based rendering, light fields