FlexiStickers: photogrammetric texture mapping using casual images

ABSTRACT

Texturing 3D models using casual images has gained importance in the last decade, with the advent of huge databases of images. We present a novel approach for performing this task, which manages to account for the 3D geometry of the photographed object. Our method overcomes the limitation of both the constrained-parameterization approach, which does not account for the photography effects, and the photogrammetric approach, which cannot handle arbitrary images. The key idea of our algorithm is to formulate the mapping estimation as a Moving-Least-Squares problem for recovering local camera parameters at each vertex. The algorithm is realized in a FlexiStickers application, which enables fast interactive texture mapping using a small number of constraints.

REFERENCES

• 1: Fausto Bernardini , Ioana M. Martin , Holly Rushmeier, High-Quality Texture Reconstruction from Multiple Scans, IEEE Transactions on Visualization and Computer Graphics, v.7 n.4, p.318-332, October 2001 [doi>10.1109/2945.965346]
• 2: Christoph Bregler , Jitendra Malik , Katherine Pullen, Twist Based Acquisition and Tracking of Animal and Human Kinematics, International Journal of Computer Vision, v.56 n.3, p.179-194, February-March 2004 [doi>10.1023/B:VISI.0000011203.00237.9b]
• 3: Bodo Rosenhahn , Thomas Brox , Joachim Weickert, Three-Dimensional Shape Knowledge for Joint Image Segmentation and Pose Tracking, International Journal of Computer Vision, v.73 n.3, p.243-262, July 2007 [doi>10.1007/s11263-006-9965-3]
• 4: Carlo Colombo , Alberto Del Bimbo , Federico Pernici, Metric 3D Reconstruction and Texture Acquisition of Surfaces of Revolution from a Single Uncalibrated View, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.27 n.1, p.99-114, January 2005 [doi>10.1109/TPAMI.2005.14]
• 5: Paul E. Debevec , Camillo J. Taylor , Jitendra Malik, Modeling and Rendering Architecture from Photographs:, University of California at Berkeley, Berkeley, CA, 1996
• 6: Desbrun, M., Meyer, M., and Alliez, P. 2002. Intrinsic parameterizations of surface meshes. Computer Graphics Forum 21, 3, 209--218.
• 7: Yotam I. Gingold , Philip L. Davidson , Jefferson Y. Han , Denis Zorin, A direct texture placement and editing interface, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166259]
• 8: Richard Hartley , Andrew Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, New York, NY, 2003
• 9: Kai Hormann , Bruno Lévy , Alla Sheffer, Mesh parameterization: theory and practice

  Video files associated with this course are available from the citation page

  , ACM SIGGRAPH 2007 courses, August 05-09, 2007, San Diego, California [doi>10.1145/1281500.1281510]
• 10: Vladislav Kraevoy , Alla Sheffer , Craig Gotsman, Matchmaker: constructing constrained texture maps, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 11: Tong-Yee Lee , Shao-Wei Yen , I-Cheng Yeh, Texture Mapping with Hard Constraints Using Warping Scheme, IEEE Transactions on Visualization and Computer Graphics, v.14 n.2, p.382-395, March 2008 [doi>10.1109/TVCG.2007.70432]
• 12: Hendrik P. A. Lensch , Wolfgang Heidrich , Hans-Peter Seidel, Automated Texture Registration and Stitching for Real World Models, Proceedings of the 8th Pacific Conference on Computer Graphics and Applications, p.317, October 03-05, 2000
• 13: Bruno Lévy , Sylvain Petitjean , Nicolas Ray , Jérome Maillot, Least squares conformal maps for automatic texture atlas generation, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 14: Bruno Lévy, Constrained texture mapping for polygonal meshes, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.417-424, August 2001 [doi>10.1145/383259.383308]
• 15: Richard M. Murray , S. Shankar Sastry , Li Zexiang, A Mathematical Introduction to Robotic Manipulation, CRC Press, Inc., Boca Raton, FL, 1994
• 16: Scott Schaefer , Travis McPhail , Joe Warren, Image deformation using moving least squares, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 17: Ryan Schmidt , Cindy Grimm , Brian Wyvill, Interactive decal compositing with discrete exponential maps, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 18: Sudipta N. Sinha , Drew Steedly , Richard Szeliski , Maneesh Agrawala , Marc Pollefeys, Interactive 3D architectural modeling from unordered photo collections, ACM Transactions on Graphics (TOG), v.27 n.5, December 2008
• 19: Yu-Wing Tai , Michael S. Brown , Chi-Keung Tang , Heung-Yeung Shum, Texture amendment: reducing texture distortion in constrained parameterization, ACM Transactions on Graphics (TOG), v.27 n.5, December 2008
• 20: Frederick M. Weinhaus , Venkat Devarajan, Texture mapping 3D models of real-world scenes, ACM Computing Surveys (CSUR), v.29 n.4, p.325-365, Dec. 1997 [doi>10.1145/267580.267583]
• 21: Weinhaus, F., and Devich, R. 1999. Photogrammetric texture mapping onto planar polygons. Graphical Models and Image Processing 61, 2, 63--83.
• 22: Jianxiong Xiao , Tian Fang , Ping Tan , Peng Zhao , Eyal Ofek , Long Quan, Image-based façade modeling, ACM Transactions on Graphics (TOG), v.27 n.5, December 2008
• 23: Eugene Zhang , Konstantin Mischaikow , Greg Turk, Feature-based surface parameterization and texture mapping, ACM Transactions on Graphics (TOG), v.24 n.1, p.1-27, January 2005 [doi>10.1145/1037957.1037958]
• 24: Kun Zhou , Xi Wang , Yiying Tong , Mathieu Desbrun , Baining Guo , Heung-Yeung Shum, TextureMontage, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems
          Subjects: Geometrical problems and computations

  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
        G.1.10 Applications
      G.1.6 Optimization

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

General Terms:
Algorithms, Design, Theory