Sketching a virtual environment: modeling using line-drawing interpretation

ABSTRACT

Here we demonstrate the direct input to computer of a handdrawn perspective sketch to create a virtual environment. We either start with a photograph of a real environment or an existing VRML model, and then use a mouse or pen pad to sketch line drawings onto the scene. Visual clues and constraints from the existing background and line drawing, as well as heuristics for form recognition are used to build a 3D optimization problem. We use a multiple objective genetic algorithm to find a viable solution to the problem, and VRML output is generated, either for re-entry to the system or use in another system. Our software is currently available compiled for either a PC running Windows 98/NT or an SGI machine running IRIX 6.x.

REFERENCES

• 1: Clowes, M. B., On seeing things. Artificial Intelligence, 21(4):435-462, 1983.
• 2: Jonathan M. Cohen , Lee Markosian , Robert C. Zeleznik , John F. Hughes , Ronen Barzel, An interface for sketching 3D curves, Proceedings of the 1999 symposium on Interactive 3D graphics, p.17-21, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300655]
• 3: Michael F. Deering, The HoloSketch VR sketching system, Communications of the ACM, v.39 n.5, p.54-61, May 1996 [doi>10.1145/229459.229466]
• 4: David E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 5: Guzman, A., Decomposition of a visual scene into threedimensional bodies. In Proceedings of AFIPS Fall Joint Conference, 291-304, 1968.
• 6: Huffman, D. A., Impossible objects as nonsense sentences. In Meltzer, B., Michie, D., editors, Machine Intelligence, volume 6, Edinburgh University Press, 1971.
• 7: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 8: Koenderink, J., Van Doom, A., Christou, C. and Lappin, J., Psychophysics of pictorial relie~ European Journal of Morphology, 35(1):36-x, 1997.
• 9: Yvan G. Leclerc , Martin A. Fischler, An optimization-based approach to the interpretation of single line drawings as 3D wire frames, International Journal of Computer Vision, v.9 n.2, p.113-136, Nov. 1992 [doi>10.1007/BF00129683]
• 10: Lipson, H. and Shpitalni, M. Optimization-based reconstruction of a 3D object from a single freehand line drawing. Computer-Aided Design, 28(8):651-663, 1996.
• 11: Thomas Marill, Emulating the human interpretation of line-drawings as three-dimensional objects, International Journal of Computer Vision, v.6 n.2, p.147-161, June 1991 [doi>10.1007/BF00128154]
• 12: David Slater , Glenn Healey, 3D Shape Reconstruction by Using Vanishing Points, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.18 n.2, p.211-217, February 1996 [doi>10.1109/34.481545]
• 13: Regenbrecht, H., and Donath, D., Architectural education and virtual reality aided design. In Bertol, D., Designing Digital Space, Wiley and Sons, 1996.
• 14: Wang, W., and Grinstein, G.. A survey of 3D solid reconstruction from 2D projection line drawings. Computer Graphics Forum, 12(2):137-158, June 1993.
• 15: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search
          Subjects: Heuristic methods
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Algorithms, Design, Measurement, Performance, Theory

Keywords:
3D modeling, line-drawing interpretation