Sketching reality: Realistic interpretation of architectural designs

ABSTRACT

In this article, we introduce sketching reality, the process of converting a freehand sketch into a realistic-looking model. We apply this concept to architectural designs. As the sketch is being drawn, our system periodically interprets its 2.5D-geometry by identifying new junctions, edges, and faces, and then analyzing the extracted topology. The user can add detailed geometry and textures through sketches as well. This is possible through the use of databases that match partial sketches to models of detailed geometry and textures. The final product is a realistic texture-mapped 2.5D-model of the building. We show a variety of buildings that have been created using this system.

REFERENCES

• 1: Alvarado, C. and Davis, R. 2005. Dynamically constructed Bayes nets for multi-domain sketch understanding. In Proceedings of the International Joint Conference on Artificial Intelligence. San Francisco, CA. 1407--1412.
• 2: Barrow, H. G., Tenenbaum, J., Bolles, R., and Wolf, H. 1977. Parametric correspondence and chamfer matching: Two new techniques for image matching. In Proceedings of the International Joint Conference on Artificial Intelligence. 659--663.
• 3: Thomas Funkhouser , Patrick Min , Michael Kazhdan , Joyce Chen , Alex Halderman , David Dobkin , David Jacobs, A search engine for 3D models, ACM Transactions on Graphics (TOG), v.22 n.1, p.83-105, January 2003 [doi>10.1145/588272.588279]
• 4: Gennari, L., Kara, L. B., Stahovich, T. F., and Shimada, K. 2005. Combining geometry and domain knowledge to interpret hand-drawn diagrams. Comput. Graph., 547--562.
• 5: I. J. Grimstead , R. R. Martin, Creating solid models from single 2D sketches, Proceedings of the third ACM symposium on Solid modeling and applications, p.323-337, May 17-19, 1995, Salt Lake City, Utah, United States [doi>10.1145/218013.218082]
• 6: Derek Hoiem , Alexei A. Efros , Martial Hebert, Automatic photo pop-up, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 7: Hong, W., Ma, Y., and Yu, Y. 2004. Reconstruction of 3D symmetric curves from perspective images without discrete features. In European Conference on Computer Vision. Vol. 3. 533--545.
• 8: Youichi Horry , Ken-Ichi Anjyo , Kiyoshi Arai, Tour into the picture: using a spidery mesh interface to make animation from a single image, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.225-232, August 1997 [doi>10.1145/258734.258854]
• 9: Hou, S. and Ramani, K. 2006. Sketch-based 3D engineering part class browsing and retrieval. In EuroGraphics Workshop on Sketch-Based Interfaces and Modeling. 131--138.
• 10: D. P. Huttenlocher , G. A. Klanderman , W. A. Rucklidge, Comparing Images Using the Hausdorff Distance, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.15 n.9, p.850-863, September 1993 [doi>10.1109/34.232073]
• 11: Takeo Igarashi , John F. Hughes, A suggestive interface for 3D drawing, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502379]
• 12: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 13: Jatupoj, P. 2005. Sketchboard: The simple 3D modeling from architectural sketch recognition. In Proceedings of Computer Aided Architectural Design in Asia.
• 14: Olga A. Karpenko , John F. Hughes, SmoothSketch: 3D free-form shapes from complex sketches, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 15: Lee, H.-J. and Chung, J.-H. 1999. Hand gesture recognition using orientation histogram. In Proceedings of IEEE Region 10 Conference Vol. 2. 1355--1358.
• 16: Lipson, H. and Shpitalni, M. 1996. Optimization-based reconstruction of a 3D object from a single freehand line drawing. J. Comput. Aid. Des. 28, 8, 651--663.
• 17: Masry, M., Kang, D., and Lipson, H. 2005. A freehand sketching interface for progressive construction of 3D objects. J. Comput. Graph., (Special Issue on Pen-Based User Interfaces) 29, 4, 563--575.
• 18: Koichi Matsuda , Satoru Sugishita , Zheng Xu , Kunio Kondo , Hisashi Sato , Shizuo Shimada, Freehand Sketch System for 3D Geometric Modeling, Proceedings of the 1997 International Conference on Shape Modeling and Applications (SMA '97), p.55, March 03-06, 1997
• 19: Pascal Müller , Peter Wonka , Simon Haegler , Andreas Ulmer , Luc Van Gool, Procedural modeling of buildings, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 20: Yoav I. H. Parish , Pascal Müller, Procedural modeling of cities, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.301-308, August 2001 [doi>10.1145/383259.383292]
• 21: Mukta Prasad , Andrew Fitzgibbon, Single View Reconstruction of Curved Surfaces, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.1345-1354, June 17-22, 2006 [doi>10.1109/CVPR.2006.281]
• 22: Pu, J. and Ramani, K. 2006. On visual similarity based 2D drawing retrieval. Comput.-Aid. Des. 38, 3, 249--259.
• 23: Rother, C. 2000. A new approach for vanishing point detection in architecture environment. In Proceedings of British Machine Vision Conference 382--391.
• 24: Tevfik Metin Sezgin , Thomas Stahovich , Randall Davis, Sketch based interfaces: early processing for sketch understanding, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971487]
• 25: Shesh, A. and Chen, B. 2004. SMARTPAPER--An interactive and easy-to-use sketching system. In Proceedings of Eurographics.
• 26: Shilman, M., Pasula, H., Russell, S., and Newton, R. 2000. Statistical visual language models for ink parsing. In AAAI Spring Symposium on Sketching Understanding. 126--132.
• 27: Moshe Shpitalni , Hod Lipson, Identification of Faces in a 2D Line Drawing Projection of a Wireframe Object, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.18 n.10, p.1000-1012, October 1996 [doi>10.1109/34.541409]
• 28: P. A. C. Varley , R. R. Martin, A System for Constructing Boundary Representation Solid Models from a Two-Dimensional Sketch, Proceedings of the Geometric Modeling and Processing 2000, p.13, April 10-12, 2000
• 29: Peter Wonka , Michael Wimmer , François Sillion , William Ribarsky, Instant architecture, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 30: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.6 COMPUTER-AIDED ENGINEERING
      Subjects: Computer-aided design (CAD)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding

General Terms:
Algorithms, Experimentation, Measurement

Keywords:
Sketching, realistic imagery, shape