Image-based texture replacement using multiview images

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Image-based texture replacement using multiview images

Full text

Pdf (39.48 MB)

Source

Virtual Reality Software and Technology archive
Proceedings of the 2008 ACM symposium on Virtual reality software and technology table of contents

Bordeaux, France

SESSION: Video acquisition table of contents

Pages 185-192

Year of Publication: 2008

ISBN:978-1-59593-951-7

Authors

Doron Tal	Technion -- Israel Inst. of Technology
Ilan Shimshoni	University of Haifa
Ayellet Tal	Technion -- Israel Inst. of Technology

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction
SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 16, Downloads (12 Months): 93, Citation Count: 0

Additional Information:

abstract references index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1450579.1450619 What is a DOI?

ABSTRACT

Augmented reality is concerned with combining real-world data, such as images, with artifcial data. Texture replacement is one such task. It is the process of painting a new texture over an existing textured image patch, such that depth cues are maintained. This paper proposes a general and automatic approach for performing texture replacement, which is based on multiview stereo techniques that produce depth information at every pixel. The use of several images allows us to address the inherent limitation of previous studies, which are constrained to specifc texture classes, such as textureless or near-regular textures. To be able to handle general textures, a modifed dense correspondence estimation algorithm is designed and presented.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Azuma, R. 1997. A survey of augmented reality. Presence: Tele-operators and Virtual Environments 6, 4, 355--385.
	2	Berger, M.-O., Wrobel-Dautcourt, B., Petitjean, S., and Simon, G. 1999. Mixing synthetic and video images of an outdoor urban environment. Machine Vision Applications 11, 3, 145--159.
	3	Cox, M. A. A., and Cox, T. 1994. Multidimensional Scaling. Chapman and Hall.
	4	Paul Debevec, Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.189-198, July 1998 [doi>10.1145/280814.280864]
	5	Hui Fang , John C. Hart, Textureshop: texture synthesis as a photograph editing tool, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
	6	Martin A. Fischler , Robert C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, Communications of the ACM, v.24 n.6, p.381-395, June 1981 [doi>10.1145/358669.358692]
	7	Garland, M. Qslim software package. Website. http://graphics.cs.uiuc.edu/~garland/software/qslim.html.
	8	Michael Garland , Paul S. Heckbert, Surface simplification using quadric error metrics, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.209-216, August 1997 [doi>10.1145/258734.258849]
	9	Goshen, L., and Shimshoni, I. 2006. Balanced exploration and exploitation model search for efficient epipolar geometry estimation. In European Conference on Computer Vision, II: 151--164.
	10	Richard Hartley , Andrew Zisserman, Multiple view geometry in computer visiond, Cambridge University Press, New York, NY, 2001
	11	Sara Keren , Ilan Shimshoni , Ayellet Tal, Placing Three-Dimensional Models in an Uncalibrated Single Image of an Architectural Scene, Presence: Teleoperators and Virtual Environments, v.13 n.6, p.692-707, December 2004 [doi>10.1162/1054746043280583]
	12	Kimmel, R., and Sethian, J. 1998. Computing Geodesic Paths on Manifolds. Proceedings of the National Academy of Sciences of the United States of America 95, 15, 8431--8435.
	13	Kruskal, J. B., and Wish, M. 1978. Multidimensional Scaling. Sage.
	14	Yanxi Liu , Wen-Chieh Lin , James Hays, Near-regular texture analysis and manipulation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
	15	Lourakis, M., and Argyros, A. 2004. The design and implementation of a generic sparse bundle adjustment software package based on the Levenberg-Marquardt algorithm. Tech. Rep. 340, Institute of Computer Science - FORTH, Heraklion, Crete, Greece, Aug.
	16	Lowe, D. G. Demo software: Sift keypoint detector. Website. http://www.cs.ubc.ca/~lowe/keypoints/.
	17	David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
	18	Joseph S. B. Mitchell , David M. Mount , Christos H. Papadimitriou, The discrete geodesic problem, SIAM Journal on Computing, v.16 n.4, p.647-668, Aug. 1987 [doi>10.1137/0216045]
	19	Daniel Scharstein , Richard Szeliski, A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms, International Journal of Computer Vision, v.47 n.1-3, p.7-42, April-June 2002 [doi>10.1023/A:1014573219977]
	20	Scholz, V., and Magnor, M. 2006. Texture replacement of garments in monocular video sequences. In Eurographics Symposium on Rendering, 305--312.
	21	Steven M. Seitz , Brian Curless , James Diebel , Daniel Scharstein , Richard Szeliski, A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.519-528, June 17-22, 2006 [doi>10.1109/CVPR.2006.19]
	22	Olga Sorkine , Daniel Cohen-Or , Rony Goldenthal , Dani Lischinski, Bounded-distortion piecewise mesh parameterization, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
	23	Strecha, C., Fransens, R., and Van Gool, L. J. 2004. Wide-baseline stereo from multiple views: A probabilistic account. In Proc. IEEE Conf. Comp. Vision Patt. Recog., I: 552--559.
	24	Strobl, K., Sepp, W., Fuchs, S., Paredes, C., and Arbter, K. Camera calibration toolbox for Matlab. http://www.vision.caltech.edu/bouguetj/calib_doc/.
	25	Vitaly Surazhsky , Tatiana Surazhsky , Danil Kirsanov , Steven J. Gortler , Hugues Hoppe, Fast exact and approximate geodesics on meshes, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
	26	P. H. S. Torr , A. Zisserman, MLESAC: a new robust estimator with application to estimating image geometry, Computer Vision and Image Understanding, v.78 n.1, p.138-156, April 2000 [doi>10.1006/cviu.1999.0832]
	27	Bill Triggs , Philip F. McLauchlan , Richard I. Hartley , Andrew W. Fitzgibbon, Bundle Adjustment - A Modern Synthesis, Proceedings of the International Workshop on Vision Algorithms: Theory and Practice, p.298-372, September 21-22, 1999
	28	Tsin, Y. H., Liu, Y., and Ramesh, V. 2001. Texture replacement in real images. In Proc. IEEE Conf. Comp. Vision Patt. Recog., II:539--544.
	29	Steve Zelinka , Michael Garland, Jump map-based interactive texture synthesis, ACM Transactions on Graphics (TOG), v.23 n.4, p.930-962, October 2004 [doi>10.1145/1027411.1027413]
	30	Steve Zelinka , Hui Fang , Michael Garland , John C. Hart, Interactive material replacement in photographs, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia
	31	G. Zigelman , R. Kimmel , N. Kiryati, Texture Mapping Using Surface Flattening via Multidimensional Scaling, IEEE Transactions on Visualization and Computer Graphics, v.8 n.2, p.198-207, April 2002 [doi>10.1109/2945.998671]