|
ABSTRACT
We present a simple image-based method of generating novel visual appearance in which a new image is synthesized by stitching together small patches of existing images. We call this process image quilting. First, we use quilting as a fast and very simple texture synthesis algorithm which produces surprisingly good results for a wide range of textures. Second, we extend the algorithm to perform texture transfer — rendering an object with a texture taken from a different object. More generally, we demonstrate how an image can be re-rendered in the style of a different image. The method works directly on the images and does not require 3D information.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
 |
1
|
|
| |
2
|
J. Bergen and E. Adelson. Early vision and texture perception. Nature, 333:363- 364, 1988.
|
| |
3
|
|
| |
4
|
|
| |
5
|
|
| |
6
|
|
| |
7
|
|
| |
8
|
J. J. Gibson. The Perception of the Visual World. Houghton Mifflin, Boston, Massachusetts, 1950.
|
| |
9
|
P. Harrison. A non-hierarchical procedure for re-synthesis of complex textures. In WSCG '2001 Conference proceedings, pages 190-197, 2001. See also http://www.csse.monash.edu.au/~pfh/resynthesizer/.
|
 |
10
|
|
 |
11
|
|
| |
12
|
Bela Julesz. Visual pattern discrimination. IRE Transactions on Information Theory, 8(2):84-92, 1962.
|
| |
13
|
L. Liang, C. Liu, , Y. Xu, B. Guo, and H.-Y. Shum. Real-time texture synthesis by patch-based sampling. Technical Report MSR-TR-2001-40, Microsoft Research, March 2001.
|
| |
14
|
J. Malik and P. Perona. Preattentive texture discrimination with early vision mechanism. JOSA-A, 5(5):923-932, May 1990.
|
| |
15
|
|
| |
16
|
Kris Popat and Rosalind W. Picard. Novel cluster-based probability model for texture synthesis, classification, and compression. In Proc. SPIE Visual Comm. and Image Processing, 1993.
|
| |
17
|
|
| |
18
|
|
| |
19
|
|
| |
20
|
|
| |
21
|
Y. Xu, B. Guo, and H.-Y. Shum. Chaos mosaic: Fast and memory efficient texture synthesis. Technical Report MSR-TR-2000-32, Microsoft Research, April 2000.
|
| |
22
|
|
CITED BY 149
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Kun Zhou , Peng Du , Lifeng Wang , Yasuyuki Matsushita , Jiaoying Shi , Baining Guo , Heung-Yeung Shum, Decorating Surfaces with Bidirectional Texture Functions, IEEE Transactions on Visualization and Computer Graphics, v.11 n.5, p.519-528, September 2005
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Y.-K. Lai , S.-M. Hu , D. X. Gu , R. R. Martin, Geometric texture synthesis and transfer via geometry images, Proceedings of the 2005 ACM symposium on Solid and physical modeling, p.15-26, June 13-15, 2005, Cambridge, Massachusetts
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Yi-Chin Huang , Yi-Shin Tung , Jun-Cheng Chen , Sung-Wen Wang , Ja-Ling Wu, An adaptive edge detection based colorization algorithm and its applications, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Jinwei Gu , Chien-I Tu , Ravi Ramamoorthi , Peter Belhumeur , Wojciech Matusik , Shree Nayar, Time-varying surface appearance: acquisition, modeling and rendering, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
|
|
|
|
|
|
Jianye Lu , Athinodoros S. Georghiades , Holly Rushmeier , Julie Dorsey , Chen Xu, Synthesis of material drying history: phenomenon modeling, transferring and rendering, ACM SIGGRAPH 2006 Courses, July 30-August 03, 2006, Boston, Massachusetts
|
|
|
|
|
|
|
|
|
Adam W. Bargteil , Funshing Sin , Jonathan E. Michaels , Tolga G. Goktekin , James F. O'Brien, A texture synthesis method for liquid animations, Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, September 02-04, 2006, Vienna, Austria
|
|
|
|
|
|
|
|
|
|
|
|
Rui Lu , De Xu , Bing Li, A multi-scale gradient based method for image completion, Proceedings of the 7th WSEAS International Conference on Signal, Speech and Image Processing, p.150-153, September 15-17, 2007, Beijing, China
|
|
|
|
|
|
Kun Zhou , Xin Huang , Xi Wang , Yiying Tong , Mathieu Desbrun , Baining Guo , Heung-Yeung Shum, Mesh quilting for geometric texture synthesis, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Sebastian Enrique , Melissa Koudelka , Peter Belhumeur , Julie Dorsey , Shree Nayar , Ravi Ramamoorthi, Time-varying textures: definition, acquisition, and synthesis, ACM SIGGRAPH 2005 Sketches, July 31-August 04, 2005, Los Angeles, California
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Olivier Clément , Jocelyn Benoit , Eric Paquette, Efficient editing of aged object textures, Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa, October 29-31, 2007, Grahamstown, South Africa
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Qing Wu , Tian Xia , Chun Chen , Hsueh-Yi Sean Lin , Hongcheng Wang , Yizhou Yu, Hierarchical Tensor Approximation of Multi-Dimensional Visual Data, IEEE Transactions on Visualization and Computer Graphics, v.14 n.1, p.186-199, January 2008
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Ares Lagae , Craig S. Kaplan , Chi-Wing Fu , Victor Ostromoukhov , Oliver Deussen, Tile-based methods for interactive applications, ACM SIGGRAPH 2008 classes, August 11-15, 2008, Los Angeles, California
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Feng Xue , You-Sheng Zhang , Ju-Lang Jiang , Min Hu , Xin-Dong Wu , Rong-Gui Wang, Real-time texture synthesis using s-tile set, Journal of Computer Science and Technology, v.22 n.4, p.590-596, July 2007
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Sung Ye Kim , Ross Maciejewski , Tobias Isenberg , William M. Andrews , Wei Chen , Mario Costa Sousa , David S. Ebert, Stippling by example, Proceedings of the 7th International Symposium on Non-Photorealistic Animation and Rendering, August 01-02, 2009, New Orleans, Louisiana
|
|
|
|
|