Capture and modeling of non-linear heterogeneous soft tissue

ABSTRACT

This paper introduces a data-driven representation and modeling technique for simulating non-linear heterogeneous soft tissue. It simplifies the construction of convincing deformable models by avoiding complex selection and tuning of physical material parameters, yet retaining the richness of non-linear heterogeneous behavior. We acquire a set of example deformations of a real object, and represent each of them as a spatially varying stress-strain relationship in a finite-element model. We then model the material by non-linear interpolation of these stress-strain relationships in strain-space. Our method relies on a simple-to-build capture system and an efficient run-time simulation algorithm based on incremental loading, making it suitable for interactive computer graphics applications. We present the results of our approach for several non-linear materials and biological soft tissue, with accurate agreement of our model to the measured data.

REFERENCES

• 1: Brett Allen , Brian Curless , Zoran Popović, Articulated body deformation from range scan data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 2: Bathe, K.-J. 1995. Finite Element Procedures. Prentice-Hall.
• 3: Becker, M., and Teschner, M. 2007. Robust and efficient estimation of elasticity parameters using the linear finite element method. In SimVis, 15--28.
• 4: Bergeron, P., and Lachapelle, P., 1985. Controlling facial expression and body movements in the computer generated short "Tony de Peltrie". Siggraph Course Notes.
• 5: Bickel, B., Lang, M., Botsch, M., Otaduy, M. A., and Gross, M. 2008. Pose-space animation and transfer of facial details. In Proc. of the ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 57--66.
• 6: Blanz, V., Basso, C., Poggio, T., and Vetter, T. 2003. Re-animating faces in images and video. Computer Graphics Forum 22, 3 (Sept.), 641--650.
• 7: Mario Botsch , Olga Sorkine, On Linear Variational Surface Deformation Methods, IEEE Transactions on Visualization and Computer Graphics, v.14 n.1, p.213-230, January 2008 [doi>10.1109/TVCG.2007.1054]
• 8: Chris Buehler , Michael Bosse , Leonard McMillan , Steven Gortler , Michael Cohen, Unstructured lumigraph rendering, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.425-432, August 2001 [doi>10.1145/383259.383309]
• 9: Burion, S., Conti, F., Petrovskaya, A., Baur, C., and Khatib, O. 2008. Identifying physical properties of deformable objects by using particle filters. In Proc. of the International Conference on Robotics and Automation, 1112--1117.
• 10: Steve Capell , Matthew Burkhart , Brian Curless , Tom Duchamp , Zoran Popović, Physically based rigging for deformable characters, Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 29-31, 2005, Los Angeles, California [doi>10.1145/1073368.1073412]
• 11: J. C. Carr , R. K. Beatson , J. B. Cherrie , T. J. Mitchell , W. R. Fright , B. C. McCallum , T. R. Evans, Reconstruction and representation of 3D objects with radial basis functions, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.67-76, August 2001 [doi>10.1145/383259.383266]
• 12: Paul C. DiLorenzo , Victor B. Zordan , Benjamin L. Sanders, Laughing out loud: control for modeling anatomically inspired laughter using audio, ACM SIGGRAPH Asia 2008 papers, December 10-13, 2008, Singapore
• 13: Nico Galoppo , Miguel A. Otaduy , William Moss , Jason Sewall , Sean Curtis , Ming C. Lin, Controlling deformable material with dynamic morph targets, Proceedings of the 2009 symposium on Interactive 3D graphics and games, February 27-March 01, 2009, Boston, Massachusetts [doi>10.1145/1507149.1507156]
• 14: Hart, E. W. 1967. Theory of the tensile test. Acta Metallurgica 15, 351--355.
• 15: Hughes, T. J. R. 2000. The Finite Element Method. Linear Static and Dynamic Finite Element Analysis. Dover Publications.
• 16: Doug L. James , Dinesh K. Pai, ArtDefo: accurate real time deformable objects, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.65-72, July 1999 [doi>10.1145/311535.311542]
• 17: Kajberg, J., and Lindkvist, G. 2004. Characterisation of materials subjected to large strains by inverse modelling based on in-plane displacement fields. International Journal of Solids and Structures 41, 13, 3439--3459.
• 18: Kauer, M., Vuskovic, V., Dual, J., Szekely, G., and Bajka, M. 2002. Inverse finite element characterization of soft tissues. Medical Image Analysis 6, 3, 257--287.
• 19: Kaufmann, P., Martin, S., Botsch, M., and Gross, M. 2008. Flexible simulation of deformable models using discontinuous galerkin fem. Proceedings of the ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 105--115.
• 20: Tae-Yong Kim , Eugene Vendrovsky, DrivenShape: a data-driven approach for shape deformation, ACM SIGGRAPH 2008 talks, August 11-15, 2008, Los Angeles, California [doi>10.1145/1401032.1401121]
• 21: Rolf M. Koch , Markus H. Gross , Friedrich R. Carls , Daniel F. von Büren , George Fankhauser , Yoav I. H. Parish, Simulating facial surgery using finite element models, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.421-428, August 1996 [doi>10.1145/237170.237281]
• 22: Paul G. Kry , Dinesh K. Pai, Interaction capture and synthesis, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 23: Lang, J., Pai, D. K., and Woodham, R. J. 2002. Acquisition of elastic models for interactive simulation. International Journal of Robotics Research 21, 8, 713--733.
• 24: Sung-Hee Lee , Demetri Terzopoulos, Heads up!: biomechanical modeling and neuromuscular control of the neck, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 25: Levenberg, K. 1944. A method for the solution of certain non-linear problems in least squares. The Quarterly of Applied Mathematics, 2, 164--168.
• 26: J. P. Lewis , Matt Cordner , Nickson Fong, Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.165-172, July 2000 [doi>10.1145/344779.344862]
• 27: Wan-Chun Ma , Andrew Jones , Jen-Yuan Chiang , Tim Hawkins , Sune Frederiksen , Pieter Peers , Marko Vukovic , Ming Ouhyoung , Paul Debevec, Facial performance synthesis using deformation-driven polynomial displacement maps, ACM SIGGRAPH Asia 2008 papers, December 10-13, 2008, Singapore
• 28: Magnenat-Thalmann, N., Kalra, P., Lévêque, J. L., Bazin, R., Batisse, D., and Queleux, B. 2002. A computational skin model: fold and wrinkle formation. IEEE Trans. on Information Technology in Biomedicine 6, 4, 317--323.
• 29: Wojciech Matusik , Hanspeter Pfister , Matt Brand , Leonard McMillan, A data-driven reflectance model, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 30: Matthias Müller , Markus Gross, Interactive virtual materials, Proceedings of Graphics Interface 2004, p.239-246, May 17-19, 2004, London, Ontario, Canada
• 31: Nava, A., Mazza, E., Kleinermann, F., Avis, N. J., and McClure, J. 2003. Determination of the mechanical properties of soft human tissues through aspiration experiments. In Proc. of MICCAI, 222--229.
• 32: Nealen, A., Mller, M., Keiser, R., Boxerman, E., and Carlson, M. 2006. Physically based deformable models in computer graphics. Computer Graphics Forum 25, 4 (Dec.), 809--836.
• 33: Ogden, R. W. 1997. Non-Linear Elastic Deformations. Courier Dover Publications.
• 34: Mark P. Ottensmeyer , John Kenneth Salisbury, Jr., In Vivo Data Acquisition Instrument for Solid Organ Mechanical Property Measurement, Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention, p.975-982, October 14-17, 2001
• 35: Dinesh K. Pai , Kees van den Doel , Doug L. James , Jochen Lang , John E. Lloyd , Joshua L. Richmond , Som H. Yau, Scanning physical interaction behavior of 3D objects, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.87-96, August 2001 [doi>10.1145/383259.383268]
• 36: Sang Il Park , Jessica K. Hodgins, Capturing and animating skin deformation in human motion, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 37: Sang Il Park , Jessica K. Hodgins, Data-driven modeling of skin and muscle deformation, ACM SIGGRAPH 2008 papers, August 11-15, 2008, Los Angeles, California
• 38: Schnur, D. S., and Zabaras, N. 1992. An inverse method for determining elastic material properties and a material interface. International Journal for Numerical Methods in Engineering 33, 10, 2039--2057.
• 39: Schoner, J. L., Lang, J., and Seidel, H.-P. 2004. Measurement-based interactive simulation of viscoelastic solids. Computer Graphics Forum (Proc. Eurographics) 23, 3, 547--556.
• 40: Eftychios Sifakis , Igor Neverov , Ronald Fedkiw, Automatic determination of facial muscle activations from sparse motion capture marker data, ACM SIGGRAPH 2005 Papers, July 31-August 04, 2005, Los Angeles, California
• 41: Peter-Pike J. Sloan , Charles F. Rose, III , Michael F. Cohen, Shape by example, Proceedings of the 2001 symposium on Interactive 3D graphics, p.135-143, March 2001 [doi>10.1145/364338.364382]
• 42: Shinjiro Sueda , Andrew Kaufman , Dinesh K. Pai, Musculotendon simulation for hand animation, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008
• 43: Robert W. Sumner , Matthias Zwicker , Craig Gotsman , Jovan Popović, Mesh-based inverse kinematics, ACM SIGGRAPH 2005 Papers, July 31-August 04, 2005, Los Angeles, California
• 44: Joseph Teran , Eftychios Sifakis , Silvia S. Blemker , Victor Ng-Thow-Hing , Cynthia Lau , Ronald Fedkiw, Creating and Simulating Skeletal Muscle from the Visible Human Data Set, IEEE Transactions on Visualization and Computer Graphics, v.11 n.3, p.317-328, May 2005 [doi>10.1109/TVCG.2005.42]
• 45: Demetri Terzopoulos , John Platt , Alan Barr , Kurt Fleischer, Elastically deformable models, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.205-214, August 1987
• 46: D. Terzopoulos , K. Waters, Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.15 n.6, p.569-579, June 1993 [doi>10.1109/34.216726]
• 47: Toledo, S., Chen, D., and Rotkin, V. 2003. Taucs: A library for sparse linear solvers.
• 48: Zhang, H. 2004. Discrete combinatorial laplacian operators for digital geometry processing. In Proc. of SIAM Conference on Geometric Design and Computing, Nashboro Press, 575--592.
• 49: Victor Brian Zordan , Bhrigu Celly , Bill Chiu , Paul C. DiLorenzo, Breathe easy: model and control of simulated respiration for animation, Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 27-29, 2004, Grenoble, France [doi>10.1145/1028523.1028528]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Physically based modeling

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Keywords:
data-driven graphics, deformations, model acquisition, physically based animation and modeling