Capture of hair geometry from multiple images

ABSTRACT

Hair is a major feature of digital characters. Unfortunately, it has a complex geometry which challenges standard modeling tools. Some dedicated techniques exist, but creating a realistic hairstyle still takes hours. Complementary to user-driven methods, we here propose an image-based approach to capture the geometry of hair.The novelty of this work is that we draw information from the scattering properties of the hair that are normally considered a hindrance. To do so, we analyze image sequences from a fixed camera with a moving light source. We first introduce a novel method to compute the image orientation of the hairs from their anisotropic behavior. This method is proven to subsume and extend existing work while improving accuracy. This image orientation is then raised into a 3D orientation by analyzing the light reflected by the hair fibers. This part relies on minimal assumptions that have been proven correct in previous work.Finally, we show how to use several such image sequences to reconstruct the complete hair geometry of a real person. Results are shown to illustrate the fidelity of the captured geometry to the original hair. This technique paves the way for a new approach to digital hair generation.

REFERENCES

• 1: Ken-ichi Anjyo , Yoshiaki Usami , Tsuneya Kurihara, A simple method for extracting the natural beauty of hair, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.111-120, July 1992
• 2: BAKER, S., AND NAYAR, S. 1999. Global measures of coherence for edge detector evaluation. In Conference on Computer Vision and Pattern Recognition, vol. 2.
• 3: BERTAILS, F., KIM, T.-Y., CANI, M.-P., AND NEUMANN, U. 2003. Adaptive wisp tree. In Proc. of Symposium on Computer Animation.
• 4: Michael J. Brooks , Berthold K. P. Horn, Shape and source from shading, Shape from shading, MIT Press, Cambridge, MA, 1989
• 5: CANNY, J. 1983. Finding Edges and Lines in Images. Master's thesis, MIT.
• 6: DALDEGAN, A., MAGNENAT-THALMANN, N., KURIHARA, T., AND THALMANN, D. 1993. An integrated system for modeling, animating and rendering hair. Computer Graphics Forum 12, 3, 211--221.
• 7: DERICHE, R. 1987. Using Canny's criteria to derive a recursively implemented optimal edge detector. The International Journal of Computer Vision 1 (May).
• 8: DONOHO, D., AND HUO, X. 2000. Beamlet pyramids. In Proc. of SPIE conference.
• 9: Frédo Durand , Julie Dorsey, Fast bilateral filtering for the display of high-dynamic-range images, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 10: ELAD, M. 2002. On the bilateral filter and ways to improve it. IEEE Trans. on Image Processing 11, 10 (October), 1141--1151.
• 11: Hans G. Feichtinger , Thomas Strohmer, Advances in Gabor Analysis, Birkhauser Boston, 2002
• 12: Michael Felsberg , Gerald Sommer, A New Extension of Linear Signal Processing for Estimating Local Properties and Detecting Features, Mustererkennung 2000, 22. DAGM-Symposium, p.195-202, September 13-15, 2000
• 13: FORBES, L. A., AND DRAPER, B. A. 2000. Inconsistencies in edge detector evaluation. In Conference on Computer Vision and Pattern Recognition.
• 14: William T. Freeman , Edward H. Adelson, The Design and Use of Steerable Filters, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.9, p.891-906, September 1991 [doi>10.1109/34.93808]
• 15: GRABLI, S., SILLION, F., MARSCHNER, S. R., AND LENGYEL, J. E. 2002. Image-based hair capture by inverse lighting. In Proc. Graphics Interface, 51--58.
• 16: GFosta H. Granlund , Hans Knutsson, Signal Processing for Computer Vision, Kluwer Academic Publishers, Norwell, MA, 1995
• 17: HADAP, S., AND MAGNENAT-THALMANN, N. 2000. Interactive hair styler based on fluid flow. In Proc. of Workshop on Computer Animation and Simulation, Eurographics.
• 18: HERTZMANN, A., AND SEITZ, S. 2003. Shape and materials by example: A photometric stereo approach. In Proc. of Conference on Computer Vision and Pattern Recognition, 576--584.
• 19: Hiroshi Ishikawa , Davi Geiger, Global optimization using embedded graphs, 2000
• 20: J. T. Kajiya , T. L. Kay, Rendering fur with three dimensional textures, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.271-280, July 1989
• 21: Tae-Yong Kim , Ulrich Neumann, Opacity Shadow Maps, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.177-182, June 25-27, 2001
• 22: Tae-Yong Kim , Ulrich Neumann, Interactive multiresolution hair modeling and editing, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 23: A. Laurentini, The Visual Hull Concept for Silhouette-Based Image Understanding, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.16 n.2, p.150-162, February 1994 [doi>10.1109/34.273735]
• 24: LU, R., KOENDERINK, J. J., AND KAPPERS, A. M. 1999. Specularities on surfaces with tangential hairs or grooves. In Proc. of the International Conference on Computer Vision, IEEE, 839--846.
• 25: Stephen R. Marschner , Henrik Wann Jensen , Mike Cammarano , Steve Worley , Pat Hanrahan, Light scattering from human hair fibers, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 26: Wojciech Matusik , Hanspeter Pfister , Remo Ziegler , Addy Ngan , Leonard McMillan, Acquisition and rendering of transparent and refractive objects, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 27: P. Meer , B. Georgescu, Edge Detection with Embedded Confidence, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.12, p.1351-1365, December 2001 [doi>10.1109/34.977560]
• 28: NAKAJIMA, M., MING, K. W., AND TAKASHI, H. 1998. Generation of 3D hair model from multiple pictures. In IEEE Computer Graphics & Applications (12) 1998, 183--169.
• 29: Eric Plante , Marie-Paule Cani , Pierre Poulin, A layered wisp model for simulating interactions inside long hair, Proceedings of the Eurographic workshop on Computer animation and simulation, p.139-148, September 02-03, 2001, Manchester, UK
• 30: RUSHMEIER, H. E. 2001. 3D capture for computer graphics. In Third International Conference on 3D Digital Imaging and Modeling.
• 31: SHEN, J., AND CASTAN, S. 1986. An optimal linear operator for edge detection. In Proc. of Conference on Computer Vision and Pattern Recognition, IEEE.
• 32: C. Tomasi , R. Manduchi, Bilateral Filtering for Gray and Color Images, Proceedings of the Sixth International Conference on Computer Vision, p.839, January 04-07, 1998
• 33: David Tschumperlé , Rachid Deriche, Orthonormal Vector Sets Regularization with PDE's and Applications, International Journal of Computer Vision, v.50 n.3, p.237-252, December 2002 [doi>10.1023/A:1020870207168]
• 34: WATSON, G. S. 1983. Statistics on spheres. John Wiley and Sons.
• 35: Ruigang Yang , Marc Pollefeys , Greg Welch, Dealing with Textureless Regions and Specular Highlights-A Progressive Space Carving Scheme Using a Novel Photo-consistency Measure, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.576, October 13-16, 2003
• 36: Yitzhak Yitzhaky , Eli Peli, A Method for Objective Edge Detection Evaluation and Detector Parameter Selection, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.25 n.8, p.1027-1033, August 2003 [doi>10.1109/TPAMI.2003.1217608]
• 37: ZIOU, D., AND TABBONE, S. 1998. Edge detection techniques - an overview. International Journal of Pattern Recognition and Image Analysis 8, 537--559.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Shape
  I.5 PATTERN RECOGNITION
      I.5.2 Design Methodology
          Subjects: Feature evaluation and selection

Keywords:
2D Orientation Detection, Hair Capture, Hair Modeling, Reflectance Analysis, Shape from Shading, Signal Processing