Sketch based interfaces: early processing for sketch understanding

ABSTRACT

Freehand sketching is a natural and crucial part of everyday human interaction, yet is almost totally unsupported by current user interfaces. We are working to combine the exibility and ease of use of paper and pencil with the processing power of a computer, to produce a user interface for design that feels as natural as paper, yet is considerably smarter. One of the most basic steps in accomplishing this is converting the original digitized pen strokes in a sketch into the intended geometric objects. In this paper we describe an implemented system that combines multiple sources of knowledge to provide robust early processing for freehand sketching.

REFERENCES

• 1: C. Alvarado. A natural sketching environment: Bringing the computer into early stages of mechanical design. Master's thesis, Massachusetts Institute of Technology, 2000.
• 2: Henry S. Baird , K. Yamamoto , H. Bunke, Structured Document Image Analysis, Springer-Verlag New York, Inc., Secaucus, NJ, 1992
• 3: Michael Banks , Elaine Cohen, Real time spline curves from interactively sketched data, Proceedings of the 1990 symposium on Interactive 3D graphics, p.99-107, February 1990, Snowbird, Utah, United States
• 4: Ann Bengtsson , Jan-Olof Eklundh, Shape Representation by Multiscale Contour Approximation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.1, p.85-93, January 1991 [doi>10.1109/34.67634]
• 5: L. Eggli. Sketching with constraints. Master's thesis, University of Utah, 1994.
• 6: Lee D. Erman , Frederick Hayes-Roth , Victor R. Lesser , D. Raj Reddy, The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty, ACM Computing Surveys (CSUR), v.12 n.2, p.213-253, June 1980 [doi>10.1145/356810.356816]
• 7: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]
• 8: Takeo Igarashi , Satoshi Matsuoka , Sachiko Kawachiya , Hidehiko Tanaka, Interactive beautification: a technique for rapid geometric design, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.105-114, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263525]
• 9: James A. Landay , Brad A. Myers, Sketching Interfaces: Toward More Human Interface Design, Computer, v.34 n.3, p.56-64, March 2001
• 10: T. Lindeberg. Edge detection and ridge detection with automatic scale selection. ISRN KTH/NA/P--96/06--SE, 1996., 1996.
• 11: Anothai Rattarangsi , Roland T. Chin, Scale-Based Detection of Corners of Planar Curves, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.14 n.4, p.430-449, April 1992 [doi>10.1109/34.126805]
• 12: Nicholas J. Redding, Implicit Polynomials, Orthogonal Distance Regression, and the Closest Point on a Curve, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.2, p.191-199, February 2000 [doi>10.1109/34.825757]
• 13: R. Rosin. Techniques for assessing polygonal approximations of curves. 7th British Machine Vision Conf., Edinburgh, 1996.
• 14: Dean Rubine, Specifying gestures by example, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.329-337, July 1991
• 15: P. Schneider. Phoenix: An interactive curve design system based on the automatic fitting of hand-sketched curves. Master's thesis, University of Washington, 1988.
• 16: Karl Tombre, Analysis of Engineering Drawings: State of the Art and Challenges, Selected Papers from the Second International Workshop on Graphics Recognition, Algorithms and Systems, p.257-264, August 22-23, 1997

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  J. Computer Applications
  J.6 COMPUTER-AIDED ENGINEERING

General Terms:
Design, Human Factors

Keywords:
freehand sketching, multiple sources of knowledge, natural interaction