A direct texture placement and editing interface

ABSTRACT

The creation of most models used in computer animation and computer games requires the assignment of texture coordinates, texture painting, and texture editing. We present a novel approach for texture placement and editing based on direct manipulation of textures on the surface. Compared to conventional tools for surface texturing, our system combines UV-coordinate specification and texture editing into one seamless process, reducing the need for careful initial design of parameterization and providing a natural interface for working with textures directly on 3D surfaces.A combination of efficient techniques for interactive constrained parameterization and advanced input devices makes it possible to realize a set of natural interaction paradigms. The texture is regarded as a piece of stretchable material, which the user can position and deform on the surface, selecting arbitrary sets of constraints and mapping texture points to the surface; in addition, the multi-touch input makes it possible to specify natural handles for texture manipulation using point constraints associated with different fingers. Pressure can be used as a direct interface for texture combination operations. The 3D position of the object and its texture can be manipulated simultaneously using two-hand input.

REFERENCES

• 1: Maneesh Agrawala , Andrew C. Beers , Marc Levoy, 3D painting on scanned surfaces, Proceedings of the 1995 symposium on Interactive 3D graphics, p.145-ff., April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199429]
• 2: Ravin Balakrishnan , Ken Hinckley, Symmetric bimanual interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.33-40, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332404]
• 3: Ravin Balakrishnan , Gordon Kurtenbach, Exploring bimanual camera control and object manipulation in 3D graphics interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.56-62, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302991]
• 4: Thaddeus Beier , Shawn Neely, Feature-based image metamorphosis, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.35-42, July 1992
• 5: Nathan A. Carr , John C. Hart, Painting detail, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 6: David (grue) DeBry , Jonathan Gibbs , Devorah DeLeon Petty , Nate Robins, Painting and rendering textures on unparameterized models, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 7: M. Desbrun, M. Meyer, and P. Alliez. Intrinsic parameterizations of surface meshes. Computer Graphics Forum, 21(3):209--218, 2002.
• 8: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 9: Michael S. Floater, Parametrization and smooth approximation of surface triangulations, Computer Aided Geometric Design, v.14 n.3, p.231-250, April 1997 [doi>10.1016/S0167-8396(96)00031-3]
• 10: Xianfeng Gu , Steven J. Gortler , Hugues Hoppe, Geometry images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 11: Y. Guiard. Asymmetric division of labor in human skilled bimanual action: The kinetic chain as a model. The Journal of Motor Behavior, 19(4):486--517, 1987.
• 12: W. W. Hager, Updating the inverse of a matrix, SIAM Review, v.31 n.2, p.221-239, June 1989 [doi>10.1137/1031049]
• 13: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 14: Pat Hanrahan , Paul Haeberli, Direct WYSIWYG painting and texturing on 3D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.215-223, September 1990, Dallas, TX, USA
• 15: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, Passive real-world interface props for neurosurgical visualization, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.452-458, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191821]
• 16: Takeo Igarashi , Dennis Cosgrove, Adaptive unwrapping for interactive texture painting, Proceedings of the 2001 symposium on Interactive 3D graphics, p.209-216, March 2001 [doi>10.1145/364338.364404]
• 17: Takeo Igarashi , Tomer Moscovich , John F. Hughes, As-rigid-as-possible shape manipulation, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 18: Doug L. James , Dinesh K. Pai, ArtDefo: accurate real time deformable objects, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.65-72, July 1999 [doi>10.1145/311535.311542]
• 19: Miao Jin , Yalin Wang , Shing-Tung Yau , Xianfeng Gu, Optimal Global Conformal Surface Parameterization, Proceedings of the conference on Visualization '04, p.267-274, October 10-15, 2004 [doi>10.1109/VIS.2004.75]
• 20: Andrei Khodakovsky , Nathan Litke , Peter Schröder, Globally smooth parameterizations with low distortion, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 21: Vladislav Kraevoy , Alla Sheffer, Cross-parameterization and compatible remeshing of 3D models, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 22: Vladislav Kraevoy , Alla Sheffer , Craig Gotsman, Matchmaker: constructing constrained texture maps, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 23: Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, The design of a GUI paradigm based on tablets, two-hands, and transparency, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-42, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258574]
• 24: Haeyoung Lee , Yiying Tong , Mathieu Desbrun, Geodesics-Based One-to-One Parameterization of 3D Triangle Meshes, IEEE MultiMedia, v.12 n.1, p.27-33, January 2005 [doi>10.1109/MMUL.2005.5]
• 25: Bruno Lévy, Constrained texture mapping for polygonal meshes, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.417-424, August 2001 [doi>10.1145/383259.383308]
• 26: Bruno Lévy , Sylvain Petitjean , Nicolas Ray , Jérome Maillot, Least squares conformal maps for automatic texture atlas generation, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 27: Ignacio Llamas , Byungmoon Kim , Joshua Gargus , Jarek Rossignac , Chris D. Shaw, Twister: a space-warp operator for the two-handed editing of 3D shapes, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 28: Jérôme Maillot , Hussein Yahia , Anne Verroust, Interactive texture mapping, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.27-34, September 1993 [doi>10.1145/166117.166120]
• 29: M. Meyer, M Desbrun, P. Schröder, and A. H. Barr. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and Mathematics III, pages 35--57. Springer-Verlag, Heidelberg, 2003.
• 30: Dan Piponi , George Borshukov, Seamless texture mapping of subdivision surfaces by model pelting and texture blending, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.471-478, July 2000 [doi>10.1145/344779.344990]
• 31: Emil Praun , Adam Finkelstein , Hugues Hoppe, Lapped textures, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.465-470, July 2000 [doi>10.1145/344779.344987]
• 32: Emil Praun , Wim Sweldens , Peter Schröder, Consistent mesh parameterizations, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.179-184, August 2001 [doi>10.1145/383259.383277]
• 33: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 34: Pedro V. Sander , John Snyder , Steven J. Gortler , Hugues Hoppe, Texture mapping progressive meshes, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.409-416, August 2001 [doi>10.1145/383259.383307]
• 35: P. V. Sander , Z. J. Wood , S. J. Gortler , J. Snyder , H. Hoppe, Multi-chart geometry images, Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, June 23-25, 2003, Aachen, Germany
• 36: John Schreiner , Arul Asirvatham , Emil Praun , Hugues Hoppe, Inter-surface mapping, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 37: Alla Sheffer, Skinning 3D meshes, Graphical Models, v.65 n.5, p.274-285, September 2003 [doi>10.1016/S1524-0703(03)00049-3]
• 38: A. Sheffer and A. S. E. de Sturler. Parameterization of faceted surfaces for meshing using angle-based flattening. Engineering with Computers, 17(3):326--337, 2001.
• 39: Alla Sheffer , Bruno Lévy , Maxim Mogilnitsky , Alexander Bogomyakov, ABF++: fast and robust angle based flattening, ACM Transactions on Graphics (TOG), v.24 n.2, p.311-330, April 2005 [doi>10.1145/1061347.1061354]
• 40: Andrew D. Wilson, TouchLight: an imaging touch screen and display for gesture-based interaction, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027946]
• 41: Mike Wu , Ravin Balakrishnan, Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.193-202, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964718]
• 42: H. Yamauchi, H. P. A. Lensch, J. Haber, and H. P. Seidel. Textures revisited. Visual Computer, 21(4):217--241, 2005.
• 43: A Fast and Simple Stretch-Minimizing Mesh Parameterization, Proceedings of the Shape Modeling International 2004 (SMI'04), p.200-208, June 07-09, 2004 [doi>10.1109/SMI.2004.2]
• 44: S. Yoshizawa, A. Belyaev, and H. P. Seidel. A moving mesh approach to stretch-minimizing mesh parameterization. International Journal of Shape Modeling, 11(1):25--42, 2005.
• 45: R. Zayer, C. Rossl, and H.-P. Seidel. Setting the boundary free: A composite approach to surface parameterization. In Symposium on Geometry Processing, pages 91--100, 2005.
• 46: Robert C. Zeleznik , Andrew S. Forsberg , Paul S. Strauss, Two pointer input for 3D interaction, Proceedings of the 1997 symposium on Interactive 3D graphics, p.115-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253316]
• 47: Eugene Zhang , Konstantin Mischaikow , Greg Turk, Feature-based surface parameterization and texture mapping, ACM Transactions on Graphics (TOG), v.24 n.1, p.1-27, January 2005 [doi>10.1145/1037957.1037958]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Algorithms, Design, Human Factors

Keywords:
multi-touch interface, surface parameterization, texturing