Multiscale texture synthesis

ABSTRACT

Example-based texture synthesis algorithms have gained widespread popularity for their ability to take a single input image and create a perceptually similar non-periodic texture. However, previous methods rely on single input exemplars that can capture only a limited band of spatial scales. For example, synthesizing a continent-like appearance at a variety of zoom levels would require an impractically high input resolution. In this paper, we develop a multiscale texture synthesis algorithm. We propose a novel example-based representation, which we call an exemplar graph, that simply requires a few low-resolution input exemplars at different scales. Moreover, by allowing loops in the graph, we can create infinite zooms and infinitely detailed textures that are impossible with current example-based methods. We also introduce a technique that ameliorates inconsistencies in the user's input, and show that the application of this method yields improved interscale coherence and higher visual quality. We demonstrate optimizations for both CPU and GPU implementations of our method, and use them to produce animations with zooming and panning at multiple scales, as well as static gigapixel-sized images with features spanning many spatial scales.

REFERENCES

• 1: Michael Ashikhmin, Synthesizing natural textures, Proceedings of the 2001 symposium on Interactive 3D graphics, p.217-226, March 2001 [doi>10.1145/364338.364405]
• 2: Ziv Bar-Joseph , Ran El-Yaniv , Dani Lischinski , Michael Werman, Texture Mixing and Texture Movie Synthesis Using Statistical Learning, IEEE Transactions on Visualization and Computer Graphics, v.7 n.2, p.120-135, April 2001 [doi>10.1109/2945.928165]
• 3: Jeremy S. De Bonet, Multiresolution sampling procedure for analysis and synthesis of texture images, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.361-368, August 1997 [doi>10.1145/258734.258882]
• 4: David S. Ebert , F. Kenton Musgrave , Darwyn Peachey , Ken Perlin , Steven Worley, Texturing and Modeling: A Procedural Approach, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2002
• 5: Alexei A. Efros , William T. Freeman, Image quilting for texture synthesis and transfer, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.341-346, August 2001 [doi>10.1145/383259.383296]
• 6: Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999
• 7: Freeman, W. T., Jones, T. R., and Pasztor, E. C. 2001. Examplebased super-resolution. Tech. Rep. TR-2001-30, MERL.
• 8: Charles Han , Bo Sun , Ravi Ramamoorthi , Eitan Grinspun, Frequency domain normal map filtering, ACM SIGGRAPH 2007 papers, August 05-09, 2007, San Diego, California
• 9: David J. Heeger , James R. Bergen, Pyramid-based texture analysis/synthesis, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.229-238, September 1995 [doi>10.1145/218380.218446]
• 10: Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 [doi>10.1145/383259.383295]
• 11: Johannes Kopf , Chi-Wing Fu , Daniel Cohen-Or , Oliver Deussen , Dani Lischinski , Tien-Tsin Wong, Solid texture synthesis from 2D exemplars, ACM SIGGRAPH 2007 papers, August 05-09, 2007, San Diego, California
• 12: Vivek Kwatra , Arno Schödl , Irfan Essa , Greg Turk , Aaron Bobick, Graphcut textures: image and video synthesis using graph cuts, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 13: Vivek Kwatra , Irfan Essa , Aaron Bobick , Nipun Kwatra, Texture optimization for example-based synthesis, ACM SIGGRAPH 2005 Papers, July 31-August 04, 2005, Los Angeles, California
• 14: Sylvain Lefebvre , Hugues Hoppe, Parallel controllable texture synthesis, ACM SIGGRAPH 2005 Papers, July 31-August 04, 2005, Los Angeles, California
• 15: Sylvain Lefebvre , Hugues Hoppe, Appearance-space texture synthesis, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 16: Liang, L., Liu, C., Xu, Y., Guo, B., and Shum, H. 2001. Real-time texture synthesis by patch-based sampling. Tech. Rep. MSR-TR-2001-40, Microsoft Research.
• 17: Wojciech Matusik , Matthias Zwicker , Frédo Durand, Texture design using a simplicial complex of morphable textures, ACM SIGGRAPH 2005 Papers, July 31-August 04, 2005, Los Angeles, California
• 18: Ken Perlin, An image synthesizer, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.287-296, Jul. 1985
• 19: Popat, K., and Picard, R. 1993. Novel cluster-based probability model for texture synthesis, classification, and compression. In SPIE VCIP, 756--768.
• 20: Javier Portilla , Eero P. Simoncelli, A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients, International Journal of Computer Vision, v.40 n.1, p.49-70, Oct. 2000 [doi>10.1023/A:1026553619983]
• 21: Emil Praun , Adam Finkelstein , Hugues Hoppe, Lapped textures, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.465-470, July 2000 [doi>10.1145/344779.344987]
• 22: Xin Tong , Jingdan Zhang , Ligang Liu , Xi Wang , Baining Guo , Heung-Yeung Shum, Synthesis of bidirectional texture functions on arbitrary surfaces, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 23: Leandro Tonietto , Marcelo Walter, Towards Local Control for Image-Based Texture Synthesis, Proceedings of the 15th Brazilian Symposium on Computer Graphics and Image Processing, p.252, October 07-10, 2002
• 24: Li-Yi Wei , Marc Levoy, Fast texture synthesis using tree-structured vector quantization, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.479-488, July 2000 [doi>10.1145/344779.345009]
• 25: Wei, L., and Levoy, M. 2002. Order-independent texture synthesis. Tech. Rep. TR-2002-01, Stanford University CS Dept.
• 26: Li-Yi Wei , Marc Levoy, Texture synthesis by fixed neighborhood searching, Stanford University, Stanford, CA, 2002
• 27: Qing Wu , Yizhou Yu, Feature matching and deformation for texture synthesis, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 28: A. Zalesny , V. Ferrari , G. Caenen , L. Van Gool, Composite Texture Synthesis, International Journal of Computer Vision, v.62 n.1-2, p.161-176, April-May 2005 [doi>10.1007/s11263-005-4640-7]
• 29: Steve Zelinka , Michael Garland, Towards real-time texture synthesis with the jump map, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 30: Jingdan Zhang , Kun Zhou , Luiz Velho , Baining Guo , Heung-Yeung Shum, Synthesis of progressively-variant textures on arbitrary surfaces, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation