ModelCraft: capturing freehand annotations and edits on physical 3D models

ABSTRACT

With the availability of affordable new desktop fabrication techniques such as 3D printing and laser cutting, physical models are used increasingly often during the architectural and industrial design cycle. Models can easily be annotated to capture comments, edits and other forms of feedback. Unfortunately, these annotations remain in the physical world and cannot be easily transferred back to the digital world. Here we present a simple solution to this problem based on a tracking pattern printed on the surface of each model. Our solution is inexpensive, requires no tracking infrastructure or per object calibration, and can be used in the field without a computer nearby. It lets users not only capture annotations, but also edit the model using a simple yet versatile command system. Once captured, annotations and edits are merged into the original CAD models. There they can be easily edited or further refined. We present the design of a SolidWorks plug-in implementing this concept, and report initial feedback from potential users using our prototype. We also present how this prototype could be extended seamlessly to a fully functional system using current 3D printing technology.

REFERENCES

• 1: @Last Software, SketchUp. 2005.
• 2: Maneesh Agrawala , Andrew C. Beers , Marc Levoy, 3D painting on scanned surfaces, Proceedings of the 1995 symposium on Interactive 3D graphics, p.145-ff., April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199429]
• 3: David Anderson , James L. Frankel , Joe Marks , Aseem Agarwala , Paul Beardsley , Jessica Hodgins , Darren Leigh , Kathy Ryall , Eddie Sullivan , Jonathan S. Yedidia, Tangible interaction + graphical interpretation: a new approach to 3D modeling, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.393-402, July 2000 [doi>10.1145/344779.344960]
• 4: Anoto, Development Guide for Service Enabled by Anoto Functionality. 2002, Anoto.
• 5: Ching, F. D. K., Architecture: Form, Space, and Order. 2nd ed. 1996: Wiley.
• 6: Raphael Grasset , Laurence Boissieux , Jean D. Gascuel , Dieter Schmalstieg, Interactive mediated reality, Proceedings of the Sixth Australasian conference on User interface, p.21-29, January 30-February 03, 2005, Newcastle, Australia
• 7: François Guimbretière, Paper augmented digital documents, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.51-60, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964702]
• 8: Pat Hanrahan , Paul Haeberli, Direct WYSIWYG painting and texturing on 3D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.215-223, September 1990, Dallas, TX, USA
• 9: Hart, S., Building a State-of-the Art Home: Part II. Achitectural Record Innovation, 2005: p. 24--29.
• 10: Hart, S., An Icon is Completed After 80 Years: Part I. Achitectural Record Innovation, 2005: p. 20--23.
• 11: Hecht, D. L. Embedded Data Glyph Technology for Hardcopy Digital Documents. Proceedings of SPIE Color Hard Copy and Graphic Arts III, pp. 341--352.
• 12: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, Passive real-world interface props for neurosurgical visualization, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.452-458, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191821]
• 13: Ken Hinckley , Patrick Baudisch , Gonzalo Ramos , Francois Guimbretiere, Design and analysis of delimiters for selection-action pen gesture phrases in scriboli, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055035]
• 14: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 15: Takeo Igarashi , John F. Hughes, Smooth meshes for sketch-based freeform modeling, Proceedings of the 2003 symposium on Interactive 3D graphics, April 27-30, 2003, Monterey, California [doi>10.1145/641480.641507]
• 16: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 17: Thomas Jung , Mark D. Gross , Ellen Yi-Luen Do, Sketching annotations in a 3D web environment, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506512]
• 18: Chunyuan Liao , François Guimbretière , Ken Hinckley, PapierCraft: a command system for interactive paper, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095074]
• 19: Liu, X., Editing Digital Models Using Physical Materails, PhD thesis, University of Toronto. 2004
• 20: Logitech, IO digital pen. (http://www.logitech.com). 2005.
• 21: Lynggard, S. and M. P. Pettersson, Devices Method and Computer Program For Position Determination, in US Patent Office. 2005, Anoto AB: USA.
• 22: Lee Markosian , Jonathan M. Cohen , Thomas Crulli , John Hughes, Skin: a constructive approach to modeling free-form shapes, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.393-400, July 1999 [doi>10.1145/311535.311595]
• 23: Masry, M., D. Kang, and H. Lipson, A Pen-Based Freehand Sketching Interface for Progressive Construction of 3D Objects. Computer & Graphics, 2005. 29: p. 563--575.
• 24: Jun Mitani , Hiromasa Suzuki, Making papercraft toys from meshes using strip-based approximate unfolding, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 25: Petrie, G. W. and D. L. Hecht, Parallel propagating embedded binary sequences for characterizing objects in N-dimensional address space, in US Patent Office. 1999, Xerox Corporation.
• 26: Ben Piper , Carlo Ratti , Hiroshi Ishii, Illuminating clay: a 3-D tangible interface for landscape analysis, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503439]
• 27: Polthier, K., Imaging maths - Unfolding polyhedra. Plus Magazine, 2003.
• 28: Sekendur, O. F., Absolute Optical Position Determination, in US Patent office. 1998: USA.
• 29: Sheng, J., A Gestural 3D modeling Interface using Fingers and a Physical Prop Traceked in 3D, PhD thesis, University of Toronto. 2005
• 30: Solid Concepts Inc, SolidView. 2004.
• 31: SolidWorks, SolidWorks. 2005.
• 32: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 33: John Underkoffler , Hiroshi Ishii, Illuminating light: an optical design tool with a luminous-tangible interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.542-549, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274717]
• 34: John Underkoffler , Hiroshi Ishii, Urp: a luminous-tangible workbench for urban planning and design, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.386-393, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303114]
• 35: ZCorp, ZCorp 3D printing system. 2005.
• 36: Robert Zeleznik , Timothy Miller, Fluid inking: augmenting the medium of free-form inking with gestures, Proceedings of the 2006 conference on Graphics interface, June 07-09, 2006, Quebec, Canada
• 37: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Human Factors

Keywords:
pen based interactions, rapid prototyping, tangible interactions