ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models

ABSTRACT

We present ILoveSketch, a 3D curve sketching system that captures some of the affordances of pen and paper for professional designers, allowing them to iterate directly on concept 3D curve models. The system coherently integrates existing techniques of sketch-based interaction with a number of novel and enhanced features. Novel contributions of the system include automatic view rotation to improve curve sketchability, an axis widget for sketch surface selection, and implicitly inferred changes between sketching techniques. We also improve on a number of existing ideas such as a virtual sketchbook, simplified 2D and 3D view navigation, multi-stroke NURBS curve creation, and a cohesive gesture vocabulary. An evaluation by a professional designer shows the potential of our system for deployment within a real design process.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, More than dotting the i's --- foundations for crossing-based interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503390]
• 2: Anand Agarawala , Ravin Balakrishnan, Keepin' it real: pushing the desktop metaphor with physics, piles and the pen, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124965]
• 3: Bae, S.-H., Kim, W.-S., & Kwon, E.-S. (2003). Digital Styling for Designers: Sketch Emulation in Computer Environment. ICCSA, 690--700.
• 4: Bae, S.-H., Kijima, R., and Kim, W.-S. (2003). Digital Styling for Designers: 3D Plane-Symmetric Freeform Curve Creation Using Sketch Interface. ICCSA, 701--710.
• 5: Bae, S.-H. (2007). Pen-Based Drawing System. International Patent Application (Pending), Publication No. WO 2007/098243 A2.
• 6: Thomas Baudel, A mark-based interaction paradigm for free-hand drawing, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.185-192, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192496]
• 7: Michel Beaudouin-Lafon, Novel interaction techniques for overlapping windows, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502371]
• 8: Buxton, W. (1986). Chunking and Phrasing and the Design of Human-Computer Dialogues. IFIP World Computer Congress, 475--480.
• 9: William Buxton, A three-state model of graphical input, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.449-456, August 27-31, 1990
• 10: Jonathan M. Cohen , Lee Markosian , Robert C. Zeleznik , John F. Hughes , Ronen Barzel, An interface for sketching 3D curves, Proceedings of the 1999 symposium on Interactive 3D graphics, p.17-21, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300655]
• 11: Pierre Dragicevic, Combining crossing-based and paper-based interaction paradigms for dragging and dropping between overlapping windows, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029667]
• 12: Elber, G. (1995). Line Illustrations ∈ Computer Graphics. The Visual Computer 11, 6, 290--296.
• 13: George W. Fitzmaurice , Ravin Balakrishnan , Gordon Kurtenbach , Bill Buxton, An exploration into supporting artwork orientation in the user interface, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.167-174, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303033]
• 14: Barry Fowler , Richard Bartels, Constraint-Based Curve Manipulation, IEEE Computer Graphics and Applications, v.13 n.5, p.43-49, September 1993 [doi>10.1109/38.232098]
• 15: François, A., Medioni, G., & Waupotitsch, R. (2003). Mirror Symmetry ⇒⇒ 2-View Stereo Geometry. Image Vision Computing 21, 2, 137--143.
• 16: Tovi Grossman , Ravin Balakrishnan , Gordon Kurtenbach , George Fitzmaurice , Azam Khan , Bill Buxton, Interaction techniques for 3D modeling on large displays, Proceedings of the 2001 symposium on Interactive 3D graphics, p.17-23, March 2001 [doi>10.1145/364338.364341]
• 17: Tovi Grossman , Ravin Balakrishnan , Gordon Kurtenbach , George Fitzmaurice , Azam Khan , Bill Buxton, Creating principal 3D curves with digital tape drawing, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503398]
• 18: Kurt Hanks , Larry Belliston, Rapid Viz, Third Edition: A New Method for the Rapid Visualitzation of Ideas, Course Technology Press, Boston, MA, 2006
• 19: Ken Hinckley , Patrick Baudisch , Gonzalo Ramos , Francois Guimbretiere, Design and analysis of delimiters for selection-action pen gesture phrases in scriboli, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055035]
• 20: Takeo Igarashi , John F. Hughes, A suggestive interface for 3D drawing, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502379]
• 21: Levent Burak Kara , Chris M. D'Eramo , Kenji Shimada, Pen-based styling design of 3D geometry using concept sketches and template models, Proceedings of the 2006 ACM symposium on Solid and physical modeling, June 06-08, 2006, Cardiff, Wales, United Kingdom [doi>10.1145/1128888.1128909]
• 22: Kara, L. & Shimada, K. (2006). Construction and Modification of 3D Geometry Using a Sketch-Based Interface. SBIM, 59--66.
• 23: Levent Burak Kara , Kenji Shimada, Sketch-Based 3D-Shape Creation for Industrial Styling Design, IEEE Computer Graphics and Applications, v.27 n.1, p.60-71, January 2007 [doi>10.1109/MCG.2007.18]
• 24: Karpenko, O., Hughes, J., & Raskar, R. (2004). Epipolar Methods for Multi-View Sketching. SBIM, 167--173.
• 25: Gordon Kurtenbach , William Buxton, Issues in combining marking and direct manipulation techniques, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.137-144, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120797]
• 26: Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, The design of a GUI paradigm based on tablets, two-hands, and transparency, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-42, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258574]
• 27: Lewin, T. & Borroff, R. (2003). How To: Design Cars Like a Pro -- A Comprehensive Guide to Car Design from the Top Professionals, Motorbooks International.
• 28: Yang Li , Ken Hinckley , Zhiwei Guan , James A. Landay, Experimental analysis of mode switching techniques in pen-based user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055036]
• 29: Martin, G. (1997). The Art of Comic Book Inking, Dark Horse Comics.
• 30: Mitani, J., Suzuki, H., & Kimura, F. (2000). 3D Sketch: Sketch-Based Model Reconstruction and Rendering. Workshop on Geometric Modeling, 85--98.
• 31: Thomas P. Moran , Patrick Chiu , William van Melle, Pen-based interaction techniques for organizing material on an electronic whiteboard, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.45-54, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263508]
• 32: Andrew Nealen , Takeo Igarashi , Olga Sorkine , Marc Alexa, FiberMesh: designing freeform surfaces with 3D curves, ACM SIGGRAPH 2007 papers, August 05-09, 2007, San Diego, California
• 33: Owada, S., Nielsen, F., Nakazawa, K., & Igarashi, T. (2003) A Sketching Interface for Modeling the Internal Structures of 3D Shapes. Smart Graphics, 49--57.
• 34: Gonzalo Ramos , Matthew Boulos , Ravin Balakrishnan, Pressure widgets, Proceedings of the SIGCHI conference on Human factors in computing systems, p.487-494, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985754]
• 35: Robertson, S. (2004). How to Draw Cars the Hot WheelsTM Way, MBI.
• 36: Eric Saund , Edward Lank, Stylus input and editing without prior selection of mode, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.213-216, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964720]
• 37: Schmidt, R., Wyvill, B., Sousa, M., & Jorge J. (2005). ShapeShop: Sketch-Based Solid Modeling with BlobTrees. SBIM, 53--62.
• 38: Ryan Schmidt , Tobias Isenberg , Pauline Jepp , Karan Singh , Brian Wyvill, Sketching, scaffolding, and inking: a visual history for interactive 3D modeling, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274875]
• 39: Schmidt, R., Singh, K., & Balakrishnan, R. (2008). Sketching and Composing Widgets for 3D Manipulation. Eurographics, 301--310.
• 40: Karan Singh , Cindy Grimm , Nisha Sudarsanam, The IBar: a perspective-based camera widget, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029648]
• 41: Taylor, T. & Hallett, L. (1996). How to Draw Cars Like a Pro, Motorbooks International.
• 42: Steve Tsang , Ravin Balakrishnan , Karan Singh , Abhishek Ranjan, A suggestive interface for image guided 3D sketching, Proceedings of the SIGCHI conference on Human factors in computing systems, p.591-598, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985767]
• 43: Wood, P. (1994). Scientific Illustration: A Guide to Biological, Zoological, and Medical Rendering Techniques, Design, Printing, and Display, John Wiley & Sons.
• 44: Robert Zeleznik , Timothy Miller, Fluid inking: augmenting the medium of free-form inking with gestures, Proceedings of Graphics Interface 2006, June 07-09, 2006, Quebec, Canada

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Modeling packages; Geometric algorithms, languages, and systems; Splines

General Terms:
Algorithms, Design, Human Factors

Keywords:
3d curve, axis widget, implicit mode change, product design, sketch-based modeling, sketchability