Texture synthesis on surfaces

ABSTRACT

Many natural and man-made surface patterns are created by interactions between texture elements and surface geometry. We believe that the best way to create such patterns is to synthesize a texture directly on the surface of the model. Given a texture sample in the form of an image, we create a similar texture over an irregular mesh hierarchy that has been placed on a given surface.

Our method draws upon texture synthesis methods that use image pyramids, and we use a mesh hierarchy to serve in place of such pyramids. First, we create a hierarchy of points from low to high density over a given surface, and we connect these points to form a hierarchy of meshes. Next, the user specifies a vector field over the surface that indicates the orientation of the texture. The mesh vertices on the surface are then sorted in such a way that visiting the points in order will follow the vector field and will sweep across the surface from one end to the other. Each point is then visited in turn to determine its color. The color of a particular point is found by examining the color of neighboring points and finding the best match to a similar pixel neighborhood in the given texture sample. The color assignment is done in a coarse-to-fine manner using the mesh hierarchy. A texture created this way fits the surface naturally and seamlessly.

REFERENCES

• 1: Burt, Peter J. and Edward H. Adelson, "The Laplacian Pyramid as a Compact Image Code," IEEE Transactions on Communications,Vol. COM-31, No. 4, April 1983, pp. 532-540.
• 2: Jeremy S. De Bonet, Multiresolution sampling procedure for analysis and synthesis of texture images, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.361-368, August 1997 [doi>10.1145/258734.258882]
• 3: Mathieu Desbrun , Mark Meyer , Peter Schröder , Alan H. Barr, Implicit fairing of irregular meshes using diffusion and curvature flow, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.317-324, July 1999 [doi>10.1145/311535.311576]
• 4: Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999
• 5: Kurt W. Fleischer , David H. Laidlaw , Bena L. Currin , Alan H. Barr, Cellular texture generation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.239-248, September 1995 [doi>10.1145/218380.218447]
• 6: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 7: Igor Guskov , Wim Sweldens , Peter Schröder, Multiresolution signal processing for meshes, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.325-334, July 1999 [doi>10.1145/311535.311577]
• 8: David J. Heeger , James R. Bergen, Pyramid-based texture analysis/synthesis, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.229-238, September 1995 [doi>10.1145/218380.218446]
• 9: Aaron Hertzmann , Denis Zorin, Illustrating smooth surfaces, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.517-526, July 2000 [doi>10.1145/344779.345074]
• 10: Kundu, Pijushi K., Fluid Mechanics, Academic Press, San Diego, 1990.
• 11: Aaron W. F. Lee , David Dobkin , Wim Sweldens , Peter Schröder, Multiresolution mesh morphing, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.343-350, July 1999 [doi>10.1145/311535.311586]
• 12: Bruno Lévy , Jean-Laurent Mallet, Non-distorted texture mapping for sheared triangulated meshes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.343-352, July 1998 [doi>10.1145/280814.280930]
• 13: Jérôme Maillot , Hussein Yahia , Anne Verroust, Interactive texture mapping, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.27-34, September 1993 [doi>10.1145/166117.166120]
• 14: Fabrice Neyret , Marie-Paule Cani, Pattern-based texturing revisited, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.235-242, July 1999 [doi>10.1145/311535.311561]
• 15: Darwyn R. Peachey, Solid texturing of complex surfaces, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.279-286, Jul. 1985
• 16: Hans Køhling Pedersen, Decorating implicit surfaces, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.291-300, September 1995 [doi>10.1145/218380.218458]
• 17: Ken Perlin, An image synthesizer, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.287-296, Jul. 1985
• 18: Dan Piponi , George Borshukov, Seamless texture mapping of subdivision surfaces by model pelting and texture blending, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.471-478, July 2000 [doi>10.1145/344779.344990]
• 19: Emil Praun , Adam Finkelstein , Hugues Hoppe, Lapped textures, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.465-470, July 2000 [doi>10.1145/344779.344987]
• 20: Simoncelli, Eero and Javier Portilla, "Texture Characterization via Joint Statistics of Wavelet Coefficient Magnitudes," Fifth International Conference on Image Processing, Vol. 1, Oct. 1998, pp. 62-66.
• 21: Soucy, Marc, Guy Godin and Marc Rioux, "A Texture-Mapping Approach for the Compression of Colored 3D triangulations," The Visual Computer, Vol. 12, No. 10, 1996, pp. 503-514.
• 22: Gabriel Taubin, A signal processing approach to fair surface design, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.351-358, September 1995 [doi>10.1145/218380.218473]
• 23: Greg Turk, Generating textures on arbitrary surfaces using reaction-diffusion, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.289-298, July 1991
• 24: Walter, Marcelo and Alain Fournier, "Clonal Mosaic Model for the Synthesis of Mammalian Coat Patterns," Proceedings of Graphics Interface, Vancouver, BC, Canada, June 1998, pp. 82-91.
• 25: Li-Yi Wei , Marc Levoy, Fast texture synthesis using tree-structured vector quantization, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.479-488, July 2000 [doi>10.1145/344779.345009]
• 26: Li-Yi Wei , Marc Levoy, Texture synthesis over arbitrary manifold surfaces, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.355-360, August 2001 [doi>10.1145/383259.383298]
• 27: Andrew Witkin , Michael Kass, Reaction-diffusion textures, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.299-308, July 1991
• 28: Andrew P. Witkin , Paul S. Heckbert, Using particles to sample and control implicit surfaces, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.269-277, July 1994 [doi>10.1145/192161.192227]
• 29: Steven Worley, A cellular texture basis function, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.291-294, August 1996 [doi>10.1145/237170.237267]
• 30: Ying, Lexing, Aaron Hertzmann, Henning Biermann, Denis Zorin, "Texture and Shape Synthesis on Surfaces," submitted for review.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

General Terms:
Algorithms, Design, Theory

Keywords:
texture mapping, texture synthesis