Scanning physical interaction behavior of 3D objects

ABSTRACT

We describe a system for constructing computer models of several aspects of physical interaction behavior, by scanning the response of real objects. The behaviors we can successfully scan and model include deformation response, contact textures for interaction with force-feedback, and contact sounds. The system we describe uses a highly automated robotic facility that can scan behavior models of whole objects. We provide a comprehensive view of the modeling process, including selection of model structure, measurement, estimation, and rendering at interactive rates. The results are demonstrated with two examples: a soft stuffed toy which has significant deformation behavior, and a hard clay pot which has significant contact textures and sounds. The results described here make it possible to quickly construct physical interaction models of objects for applications in games, animation, and e-commerce.

REFERENCES

• 1: Michael J. Black , P. Anandan, The robust estimation of multiple motions: parametric and piecewise-smooth flow fields, Computer Vision and Image Understanding, v.63 n.1, p.75-104, Jan. 1996 [doi>10.1006/cviu.1996.0006]
• 2: Jean-Yves Bouguet , Pietro Perona, 3D Photography on Your Desk, Proceedings of the Sixth International Conference on Computer Vision, p.43, January 04-07, 1998
• 3: J.C. Brown and M.S. Puckette. A High Resolution Fundamental Frequency Determination Based on Phase Changes of the Fourier Transform. J. Acoust. Soc. Am., 94(2):662-667, 1993.
• 4: Michael Cohen , Marc Levoy , Jitendra Malik , Leonard McMillan , Eric Chen, Image-based rendering (panel): really new or déjà vu?, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.468-470, August 1997 [doi>10.1145/258734.258911]
• 5: P.R. Cook. Integration of Physical Modeling for Synthesis and Animation. In Proceedings of the International Computer Music Conference, pages 525-528, Banff, 1995.
• 6: P.R. Cook and D. Trueman. NBody: Interactive Multidirectional Musical Instrument Body Radiation Simulations, and a Database of Measured Impulse Responses. In Proceedings of the International Computer Music Conference, San Francisco, 1998.
• 7: S. Cotin, H. Delingette, J-M Clement, V. Tassetti, J. Marescaux, and N. Ayache. Geometric and Physical Representations for a Simulator of Hepatic Surgery. In Proceedings of Medicine Meets Virtual Real ity IV, pages 139-151. IOS Press, 1996.
• 8: Brian Curless , Marc Levoy, A volumetric method for building complex models from range images, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.303-312, August 1996 [doi>10.1145/237170.237269]
• 9: Kristin J. Dana , Bram van Ginneken , Shree K. Nayar , Jan J. Koenderink, Reflectance and texture of real-world surfaces, ACM Transactions on Graphics (TOG), v.18 n.1, p.1-34, Jan. 1999 [doi>10.1145/300776.300778]
• 10: Paul Debevec , Tim Hawkins , Chris Tchou , Haarm-Pieter Duiker , Westley Sarokin , Mark Sagar, Acquiring the reflectance field of a human face, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.145-156, July 2000 [doi>10.1145/344779.344855]
• 11: Paul E. Debevec , Camillo J. Taylor , Jitendra Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.11-20, August 1996 [doi>10.1145/237170.237191]
• 12: T.A. Funkhouser, I. Carlbom, G. Pingali G. Elko, M. Sondhi, and J. West. Interactive Acoustic Modeling of Complex Environments. J. Acoust. Soc. Am., 105(2), 1999.
• 13: Michael Garland , Paul S. Heckbert, Surface simplification using quadric error metrics, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.209-216, August 1997 [doi>10.1145/258734.258849]
• 14: William W. Gaver, Synthesizing auditory icons, Proceedings of the SIGCHI conference on Human factors in computing systems, p.228-235, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169184]
• 15: Donald P. Greenberg , Kenneth E. Torrance , Peter Shirley , James Arvo , Eric Lafortune , James A. Ferwerda , Bruce Walter , Ben Trumbore , Sumanta Pattanaik , Sing-Choong Foo, A framework for realistic image synthesis, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.477-494, August 1997 [doi>10.1145/258734.258914]
• 16: Igor Guskov , Kiril Vidimče , Wim Sweldens , Peter Schröder, Normal meshes, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.95-102, July 2000 [doi>10.1145/344779.344831]
• 17: Hugues Hoppe , Tony DeRose , Tom Duchamp , Mark Halstead , Hubert Jin , John McDonald , Jean Schweitzer , Werner Stuetzle, Piecewise smooth surface reconstruction, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.295-302, July 1994 [doi>10.1145/192161.192233]
• 18: Doug L. James , Dinesh K. Pai, ArtDefo: accurate real time deformable objects, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.65-72, July 1999 [doi>10.1145/311535.311542]
• 19: D.L. James and D.K. Pai. A Unified Treatment of Elastostatic Contact Simulation for Real Time Haptics. Haptics-e, The Electronic Journal of Haptics Research (www.haptics-e.org), 2001. (To appear).
• 20: J. Lang and D. K. Pai. Estimation of Elastic Constants from 3D Range-Flow. In Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, 2001.
• 21: Aaron Lee , Henry Moreton , Hugues Hoppe, Displaced subdivision surfaces, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.85-94, July 2000 [doi>10.1145/344779.344829]
• 22: Aaron W. F. Lee , Wim Sweldens , Peter Schröder , Lawrence Cowsar , David Dobkin, MAPS: multiresolution adaptive parameterization of surfaces, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.95-104, July 1998 [doi>10.1145/280814.280828]
• 23: Marc Levoy , Kari Pulli , Brian Curless , Szymon Rusinkiewicz , David Koller , Lucas Pereira , Matt Ginzton , Sean Anderson , James Davis , Jeremy Ginsberg , Jonathan Shade , Duane Fulk, The digital Michelangelo project: 3D scanning of large statues, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.131-144, July 2000 [doi>10.1145/344779.344849]
• 24: Dinesh K. Pai , Jochen Lang , John E. Lloyd , Joshua L. Richmond, Reality-Based Modeling with ACME: A Progress Report, Experimental Robotics VII, p.121-130, December 11-13, 2000
• 25: Dinesh K. Pai , Jochen Lang , John E. Lloyd , Robert J. Woodham, ACME, A Telerobotic Active Measurement Facility, The Sixth International Symposium on Experimental Robotics VI, p.391-400, March 26-28, 1999
• 26: Zoran Popović , Andrew Witkin, Physically based motion transformation, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.11-20, July 1999 [doi>10.1145/311535.311536]
• 27: C. Rocchini, P. Cignoni, C.Montani, and P. Scopigno. Multiple Textures Stitching and Blending on 3D Objects. In 10th Eurographics Workshop on Rendering, pages 173-180, Granada, Spain, 1999.
• 28: Gerhard Roth , Eko Wibowoo, An efficient volumetric method for building closed triangular meshes from 3-D image and point data, Proceedings of the conference on Graphics interface '97, p.173-180, May 1997, Kelowna, British Columbia, Canada
• 29: P.J. Rousseeuw. Least Median of Squares Regression. Journal of the American Statistical Association, 79(388):871-880, 1984.
• 30: P.J. Rousseeuw and K. Van Driessen. Computing LTS Regression for Large Data Sets. Technical report, University of Antwerp, 1999.
• 31: H. Rushmeier, F. Bernardini, J. Mittleman, and G. Taubin. Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Piet~ a. Eurographics Rendering Workshop 1998, pages 81-92, 1998.
• 32: Diego C. Ruspini , Krasimir Kolarov , Oussama Khatib, The haptic display of complex graphical environments, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.345-352, August 1997 [doi>10.1145/258734.258878]
• 33: Yoichi Sato , Mark D. Wheeler , Katsushi Ikeuchi, Object shape and reflectance modeling from observation, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.379-387, August 1997 [doi>10.1145/258734.258885]
• 34: H. Spies, B. Jahne, and J.L. Barron. Dense Range Flow from Depth and Intensity Data. In International Conference on Pattern Recognition, pages 131-134, 2000.
• 35: Ken Steiglitz, A digital signal processing primer, with applications to digital audio and computer music, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 1997
• 36: K. Steiglitz and L.E. McBride. A Technique for the Identification of Linear System. IEEE Trans. Automatic Control, AC-10:461-464, 1965.
• 37: Demetri Terzopoulos , John Platt , Alan Barr , Kurt Fleischer, Elastically deformable models, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.205-214, August 1987
• 38: T.R. Thomas. Rough Surfaces. Imperial College Press, London, second edition, 1999.
• 39: Kees van den Doel , Paul G. Kry , Dinesh K. Pai, FoleyAutomatic: physically-based sound effects for interactive simulation and animation, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.537-544, August 2001 [doi>10.1145/383259.383322]
• 40: K. van den Doel and D.K. Pai. The Sounds of Physical Shapes. Presence, 7(4):382-395, 1998.
• 41: Sundar Vedula , Simon Baker , Robert Collins , Takeo Kanade , Peter Rander, Three-Dimensional Scene Flow, Proceedings of the International Conference on Computer Vision-Volume 2, p.722, September 20-25, 1999
• 42: M. Yamamoto , P. Boulanger , J. A. Beraldin , M. Rioux, Direct Estimation of Range Flow on Deformable Shape From a Video Rate Range Camera, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.15 n.1, p.82-89, January 1993 [doi>10.1109/34.184776]
• 43: Y. Zhang and C. Kambhamettu. Integrated 3D Scene Flow and Structure Recovery from Multiview Image Sequences. In Computer Vision and Pattern Recognition, volume 2, pages 674-681, 2000.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques

General Terms:
Design, Performance, Theory

Keywords:
behavioral animation, deformations, haptics, multimedia, physically based modeling, robotics, sound visualization