Interactive 3D modeling using only one image

ABSTRACT

For virtual reality systems, modeling of 3D objects and scenes is important and challenging. In this paper, we present an image-based interactive 3D modeling framework consisting of three major modules: photogrammetric modeling, human interaction, and texture mapping. These three modules are not sequentially used and they are mixed in the whole modeling process. The major idea is to explore the use of images in interactive modeling systems to achieve the automation. In particular, the use of only one image is addressed. On one side, unlike the common fully interactive modeling framework, the users are not required to specify some low level details interactively which can be derived automatically from the image. On the other side, it still requires human interactions to do some high level tasks that the algorithms are difficult to perform automatically. We have implemented the framework and experimental results are good.

REFERENCES

• 1: Nina Amenta , Marshall Bern , Manolis Kamvysselis, A new Voronoi-based surface reconstruction algorithm, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.415-421, July 1998 [doi>10.1145/280814.280947]
• 2: D. Beymer , T. Poggio, Face recognition from one example view, Proceedings of the Fifth International Conference on Computer Vision, p.500, June 20-23, 1995
• 3: S. Birchfield. KUI': An Implementation of the Kanade-Lucas-Tomasi Feature Tracker. http:// vision.stanford, edu/ birch/klt/, Stanford University, 2000.
• 4: Jean-Daniel Boissonnat , Mariette Yvinec, Algorithmic geometry, Cambridge University Press, New York, NY, 1998
• 5: Thomas T. Cormen , Charles E. Leiserson , Ronald L. Rivest, Introduction to algorithms, MIT Press, Cambridge, MA, 1990
• 6: Brian Curless , Marc Levoy, A volumetric method for building complex models from range images, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.303-312, August 1996 [doi>10.1145/237170.237269]
• 7: Cyberware Laboratory, 4020/RGB 3D Scanner with Color Digitizer. Cyberware Laboratory, Inc, Monterey, California, (1990).
• 8: Paul E. Debevec , Camillo J. Taylor , Jitendra Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.11-20, August 1996 [doi>10.1145/237170.237191]
• 9: Olivier D. Faugeras, What can be seen in three dimensions with an uncalibrated stereo rig, Proceedings of the Second European Conference on Computer Vision, p.563-578, May 19-22, 1992
• 10: James D. Foley , Andries van Dam , Steven K. Feiner , John F. Hughes, Computer graphics (2nd ed. in C): principles and practice, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 11: Rafael C. Gonzalez , Richard E. Woods, Digital Image Processing, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 12: M. Gotla and Z. Huang. A Minimalist Approach to Facial Reconstruction. In the proceedings of MMM'99 377-388 (1999).
• 13: B. K. P. Horn. Image Intensity Understanding. Artificial Intelligence, 8:201-231 (1977).
• 14: Youichi Horry , Ken-Ichi Anjyo , Kiyoshi Arai, Tour into the picture: using a spidery mesh interface to make animation from a single image, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.225-232, August 1997 [doi>10.1145/258734.258854]
• 15: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 16: Ramesh Jain , Rangachar Kasturi , Brian G. Schunck, Machine vision, McGraw-Hill, Inc., New York, NY, 1995
• 17: W. S. Lee, P. Kalra, and N. M. Thahnann. Model Based Face Reconstruction For Animation. In the proceedings of MMM'9Z 323-338 (1997).
• 18: Wee Kheng Leow , Zhiyong Huang , Yong Zhang , Rudy Setiono, Rapid 3D Model Acquisition from Images of Small Objects, Proceedings of the Geometric Modeling and Processing 2000, p.33, April 10-12, 2000
• 19: Frédéric Pighin , Jamie Hecker , Dani Lischinski , Richard Szeliski , David H. Salesin, Synthesizing realistic facial expressions from photographs, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.75-84, July 1998 [doi>10.1145/280814.280825]
• 20: Marc Pollefeys , Reinhard Koch , Luc Van Gool, Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Internal Camera Parameters, Proceedings of the Sixth International Conference on Computer Vision, p.90, January 04-07, 1998
• 21: Qhull. Home pages for Qhull. http:// www.geom, umn. ed@ software/qhull/, Geometric Center, The University of Minnesota.
• 22: Tatsumi Sakaguchi , Jun Ohya, Modeling and animation of botanical trees for interactive virtual environments, Proceedings of the ACM symposium on Virtual reality software and technology, p.139-146, December 20-22, 1999, London, United Kingdom [doi>10.1145/323663.323685]
• 23: J. Shen and D. Thalmann. Interactive Shape Design Using Metaballs and Splines. Implicit Su@zces'95, 187-196 (1995).
• 24: R. Szeliski and S. B. Kang. Recovering 3D Shape and Motion from Image Streams using Non-linear Least Squares. Journal of Visual Communication and Image Representation, 5(1), 10-28 (1994).
• 25: N. M. Thatmann and D. Thalmann. The Direction of Synthetic Actors in the Film Rendez-vous a Montreal. IEEE Computer Graphics & Applications, 7(12), 9-19 (1987).
• 26: Carlo Tomasi , Takeo Kanade, Shape and motion from image streams under orthography: a factorization method, International Journal of Computer Vision, v.9 n.2, p.137-154, Nov. 1992 [doi>10.1007/BF00129684]
• 27: Alasdair Turner , Dave Chapman , Alan Penn, Sketching a virtual environment: modeling using line-drawing interpretation, Proceedings of the ACM symposium on Virtual reality software and technology, p.155-161, December 20-22, 1999, London, United Kingdom [doi>10.1145/323663.323687]
• 28: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Keywords:
2-D image, Modeling of 3-D shape, human computer interaction, texture mapping