Modeling deformable human hands from medical images

ABSTRACT

This paper presents a new method for constructing an example-based deformable human hand model from medical images. Realistic animation of human hands requires good estimates of the joint structure and properly weighted skeleton-driven surface deformation. For this purpose, we propose a method based on medical images of hands in several poses. Our method consists of the following 3 steps: First, using the measured bone shapes, we estimate the link structure (joint rotation centers) and the joint angles of each scan. Second, we construct a mutually consistent polygonal mesh of all the scans. For this purpose, a polygonal mesh of one pose, the base mesh, is deformed using skeletal subspace deformation, and then fitted interactively to the measured meshes from the other scans. Finally, the hand is deformed using a weighted pose space deformation. We demonstrate results of deformable hand models consisting of 100,000 triangle meshes derived from CT scans.

REFERENCES

• 1: Brett Allen , Brian Curless , Zoran Popović, Articulated body deformation from range scan data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 2: Brett Allen , Brian Curless , Zoran Popović, The space of human body shapes: reconstruction and parameterization from range scans, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 3: Irene Albrecht , Jörg Haber , Hans-Peter Seidel, Construction and animation of anatomically based human hand models, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 4: Paul J. Besl , Neil D. McKay, A Method for Registration of 3-D Shapes, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.14 n.2, p.239-256, February 1992 [doi>10.1109/34.121791]
• 5: J.-P. Gourret , N. M. Thalmann , D. Thalmann, Simulation of object and human skin formations in a grasping task, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.21-30, July 1989
• 6: Hugues Hoppe , Tony DeRose , Tom Duchamp , John McDonald , Werner Stuetzle, Surface reconstruction from unorganized points, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.71-78, July 1992
• 7: Paul G. Kry , Doug L. James , Dinesh K. Pai, EigenSkin: real time large deformation character skinning in hardware, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545286]
• 8: William E. Lorensen , Harvey E. Cline, Marching cubes: A high resolution 3D surface construction algorithm, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.163-169, August 1987
• 9: J. P. Lewis , Matt Cordner , Nickson Fong, Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.165-172, July 2000 [doi>10.1145/344779.344862]
• 10: {LGLM99} Larsen E., Gottschalk S., Lin M. C., Manocha D.: Fast Proximity Queries with Swept Sphere Volumes. Tech. Rep. TR99-018, Department of Computer Science, University of N. Carolina, Chapel Hill, 1999.
• 11: Alex Mohr , Michael Gleicher, Building efficient, accurate character skins from examples, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 12: N. Magnenat-Thalmann , R. Laperrière , D. Thalmann, Joint-dependent local deformations for hand animation and object grasping, Proceedings on Graphics interface '88, p.26-33, December 1989, Edmonton, Alberta, Canada
• 13: Gregory M. Nielson, Scattered Data Modeling, IEEE Computer Graphics and Applications, v.13 n.1, p.60-70, January 1993 [doi>10.1109/38.180119]
• 14: {OBBH00} O'Brien J., Bodenheimer R., Brostow G., Hodgins J.: Automatic joint parameter estimation from magnetic motion capture data. In Graphics Interface (2000), pp. 53--60.
• 15: William H. Press , Saul A. Teukolsky , William T. Vetterling , Brian P. Flannery, Numerical recipes in C (2nd ed.): the art of scientific computing, Cambridge University Press, New York, NY, 1992
• 16: Frédéric Pighin , Richard Szeliski , David H. Salesin, Modeling and Animating Realistic Faces from Images, International Journal of Computer Vision, v.50 n.2, p.143-169, November 2002 [doi>10.1023/A:1020393915769]
• 17: Peter-Pike J. Sloan , Charles F. Rose, III , Michael F. Cohen, Shape by example, Proceedings of the 2001 symposium on Interactive 3D graphics, p.135-143, March 2001 [doi>10.1145/364338.364382]
• 18: Xiaohuan Corina Wang , Cary Phillips, Multi-weight enveloping: least-squares approximation techniques for skin animation, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545283]
• 19: {YCC99} Yasumuro Y., Chen Q., Chihara K.: Three-dimensional modeling of the human hand with motion constraints. Image and Vision Computing 17, 2 (1999), 149--156.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism