Context-aware textures

ABSTRACT

Interesting textures form on the surfaces of objects as the result of external chemical, mechanical, and biological agents. Simulating these textures is necessary to generate models for realistic image synthesis. The textures formed are progressively variant, with the variations depending on the global and local geometric context. We present a method for capturing progressively varying textures and the relevant context parameters that control them. By relating textures and context parameters, we are able to transfer the textures to novel synthetic objects. We present examples of capturing chemical effects, such as rusting; mechanical effects, such as paint cracking; and biological effects, such as the growth of mold on a surface. We demonstrate a user interface that provides a method for specifying where an object is exposed to external agents. We show the results of complex, geometry-dependent textures evolving on synthetic objects.

REFERENCES

• 1: Kimiya Aoki , Ngo Hai Dong , Toyohisa Kaneko , Shigeru Kuriyama, Physically Based Simulation of Cracks on Drying 3D Solid, Proceedings of the 10th Pacific Conference on Computer Graphics and Applications, p.467, October 09-11, 2002
• 2: Fausto Bernardini , Ioana M. Martin , Holly Rushmeier, High-Quality Texture Reconstruction from Multiple Scans, IEEE Transactions on Visualization and Computer Graphics, v.7 n.4, p.318-332, October 2001 [doi>10.1109/2945.965346]
• 3: Bernardini, F. and Rushmeier, H. 2002. The 3D model acquisition pipeline. Comput. Graph. Forum 21, 2, 149--149.
• 4: Blais, F. 2004. Review of 20 years of range sensor development. J. Electron. Imaging 13, 1, 231--240.
• 5: Jeremy S. De Bonet, Multiresolution sampling procedure for analysis and synthesis of texture images, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.361-368, August 1997 [doi>10.1145/258734.258882]
• 6: Bosch, C., Pueyo, X., Mérillou, S., and Ghazanfarpour, D. 2004. A physically-based model for rendering realistic scratches. Comput. Graph. Forum 23, 3, 361--370.
• 7: Callieri, M., Cignoni, P., and Pingi, P. 2002. An end-to-end software suite for 3d scanning. ERCIM News 50.
• 8: Chang, Y.-X. and Shih, Z.-C. 2000. Physically-Based patination for underground objects. Comput. Graph. Forum 19, 3.
• 9: Chang, Y.-X. and Shih, Z.-C. 2003. The synthesis of rust in seawater. Visual Comput. 19, 1, 50--66.
• 10: Coifman, R., Lafon, S., Lee, A., Maggioni, M., Nadler, B., Warner, F., and Zucker, S. 2005. Geometric diffusions as a tool for harmonic analysis and structure definition of data, part i: Diffusion maps. Proceedings of the National Academy of Sciences 102, 21, 7426--7431.
• 11: Kristin J. Dana , Bram van Ginneken , Shree K. Nayar , Jan J. Koenderink, Reflectance and texture of real-world surfaces, ACM Transactions on Graphics (TOG), v.18 n.1, p.1-34, Jan. 1999 [doi>10.1145/300776.300778]
• 12: Owen Demers , Christine Urszenyi , George Maestri, Digital Texturing and Painting, New Riders Publishing, Thousand Oaks, CA, 2001
• 13: Desbenoit, B., Galin, E., and Akkouche, S. 2004. Simulating and modeling lichen growth. Comput. Graph. Forum 23, 3, 341--350.
• 14: Julie Dorsey , Alan Edelman , Henrik Wann Jensen , Justin Legakis , Hans Køhling Pedersen, Modeling and rendering of weathered stone, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.225-234, July 1999 [doi>10.1145/311535.311560]
• 15: Julie Dorsey , Pat Hanrahan, Modeling and rendering of metallic patinas, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.387-396, August 1996 [doi>10.1145/237170.237278]
• 16: Julie Dorsey , Hans Køhling Pedersen , Pat Hanrahan, Flow and changes in appearance, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.411-420, August 1996 [doi>10.1145/237170.237280]
• 17: Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999
• 18: Farouk, M., El-Rifai, I., El-Tayar, S., El-Shishiny, H., Hosny, M., El-Rayes, M., Gomes, J., Giordano, F., Rushmeier, H. E., Bernardini, F., and Magerlein, K. A. 2003. Scanning and processing 3d objects for web display. In Proceedings of the 4th International Conference on 3D Digital Imaging and Modeling (3DIM). 310--317.
• 19: Gobron, S. and Chiba, N. 2001a. Crack pattern simulation based on 3d surface cellular automata. Visual Comput. 17, 5, 287--309.
• 20: Stéphane Gobron , Norishige Chiba, Simulation of Peeling Using 3D-Surface Cellular Automata, Proceedings of the 9th Pacific Conference on Computer Graphics and Applications, p.338, October 16-18, 2001
• 21: Gabriele Gorla , Victoria Interrante , Guillermo Sapiro, Texture Synthesis for 3D Shape Representation, IEEE Transactions on Visualization and Computer Graphics, v.9 n.4, p.512-524, October 2003 [doi>10.1109/TVCG.2003.1260745]
• 22: David J. Heeger , James R. Bergen, Pyramid-based texture analysis/synthesis, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.229-238, September 1995 [doi>10.1145/218380.218446]
• 23: Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 [doi>10.1145/383259.383295]
• 24: Hirota, K., Tanoue, Y., and Kaneko, T. 1998. Generation of crack patterns with a physical model. Visual Comput. 14, 3, 126--137.
• 25: Hirota, K., Tanoue, Y., and Kaneko, T. 2000. Simulation of three-dimensional cracks. Visual Comput. 16, 7, 371--378.
• 26: Siu-chi Hsu , Tien-tsin Wong, Simulating Dust Accumulation, IEEE Computer Graphics and Applications, v.15 n.1, p.18-22, January 1995 [doi>10.1109/38.364957]
• 27: Janne Kontkanen , Samuli Laine, Ambient occlusion fields, Proceedings of the 2005 symposium on Interactive 3D graphics and games, April 03-06, 2005, Washington, District of Columbia [doi>10.1145/1053427.1053434]
• 28: Vivek Kwatra , Arno Schödl , Irfan Essa , Greg Turk , Aaron Bobick, Graphcut textures: image and video synthesis using graph cuts, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 29: Sylvain Lefebvre , Hugues Hoppe, Parallel controllable texture synthesis, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 30: Hendrik P. A. Lensch , Jan Kautz , Michael Goesele , Wolfgang Heidrich , Hans-Peter Seidel, Image-based reconstruction of spatial appearance and geometric detail, ACM Transactions on Graphics (TOG), v.22 n.2, p.234-257, April 2003 [doi>10.1145/636886.636891]
• 31: Xinguo Liu , Yizhou Yu , Heung-Yeung Shum, Synthesizing bidirectional texture functions for real-world surfaces, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.97-106, August 2001 [doi>10.1145/383259.383269]
• 32: Lu, J., Georghiades, A. S., Rushmeier, H., Dorsey, J., and Xu, C. 2005. Synthesis of material drying history: Phenomenon modeling, transferring and rendering. In Proceedings of the Eurographics Workshop on Natural Phenomena. 7--16.
• 33: Marschner, S. R., Westin, S. H., Lafortune, E. P. F., Torrance, K. E., and Greenberg, D. P. 1999. Image-Based brdf measurement including human skin. In Proceedings of the 10th Eurographics Workshop on Rendering. 139--152.
• 34: Wojciech Matusik , Hanspeter Pfister , Matt Brand , Leonard McMillan, A data-driven reflectance model, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 35: Stephane Merillou , Jean-Michel Dischler , Djamchid Ghazanfarpour, Corrosion: simulating and rendering, No description on Graphics interface 2001, p.167-174, June 07-09, 2001, Ottawa, Ontario, Canada
• 36: Mérillou, S., Dischler, J.-M., and Ghazanfarpour, D. 2001b. Surface scratches: Measuring, modeling and rendering. Visual Comput. 17, 1, 30--45.
• 37: Meyer, M., Desbrun, M., Schröder, P., and Barr, A. H. 2003. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and Mathematics III, H.-C. Hege and K. Polthier, Eds. Springer Verlag, Heidelberg, 35--57.
• 38: Gavin Miller, Efficient algorithms for local and global accessibility shading, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.319-326, July 1994 [doi>10.1145/192161.192244]
• 39: Mueller, G., Meseth, J., Sattler, M., Sarlette, R., and Klein., R. 2005. Acquisition, synthesis, and rendering of bidirectional texture functions. Comput. Graph. Forum 24, 1, 83--109.
• 40: Eric Paquette , Pierre Poulin , George Drettakis, Surface aging by impacts, No description on Graphics interface 2001, p.175-182, June 07-09, 2001, Ottawa, Ontario, Canada
• 41: Paquette, E., Poulin, P., and Drettakis, G. 2002. The simulation of paint cracking and peeling. In Graphics Interface 2002. 59--68.
• 42: Shorlin, K. A., de Bruyn, J. R., Graham, M., and Morris, S. W. 2000. Development and geometry of isotropic and directional shrinkage-crack patterns. Phys. Rev. E 61, 6 (Jun.), 6950--6957.
• 43: Cyril Soler , Marie-Paule Cani , Alexis Angelidis, Hierarchical pattern mapping, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 44: Xin Tong , Jingdan Zhang , Ligang Liu , Xi Wang , Baining Guo , Heung-Yeung Shum, Synthesis of bidirectional texture functions on arbitrary surfaces, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 45: Greg Turk, Texture synthesis on surfaces, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.347-354, August 2001 [doi>10.1145/383259.383297]
• 46: Li-Yi Wei , Marc Levoy, Fast texture synthesis using tree-structured vector quantization, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.479-488, July 2000 [doi>10.1145/344779.345009]
• 47: Li-Yi Wei , Marc Levoy, Texture synthesis over arbitrary manifold surfaces, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.355-360, August 2001 [doi>10.1145/383259.383298]
• 48: Wei, L.-Y. and Levoy, M. 2002. Order-Independent texture synthesis. Tech. Rep. TR-2002-01, Computer Science Department, Stanford University.
• 49: Tien-Tsin Wong , Wai-Yin Ng , Pheng-Ann Heng, A Geometry Dependent Texture Generation Framework for Simulating Surface Imperfections, Proceedings of the Eurographics Workshop on Rendering Techniques '97, p.139-150, June 16-18, 1997
• 50: Jingdan Zhang , Kun Zhou , Luiz Velho , Baining Guo , Heung-Yeung Shum, Synthesis of progressively-variant textures on arbitrary surfaces, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 51: Kun Zhou , Peng Du , Lifeng Wang , Yasuyuki Matsushita , Jiaoying Shi , Baining Guo , Heung-Yeung Shum, Decorating Surfaces with Bidirectional Texture Functions, IEEE Transactions on Visualization and Computer Graphics, v.11 n.5, p.519-528, September 2005 [doi>10.1109/TVCG.2005.78]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

General Terms:
Algorithms, Experimentation, Measurement

Keywords:
Aging, data capture, natural phenomenon, realistic rendering, texture synthesis, weathering