Recognition of freehand sketches using mean shift

ABSTRACT

Freehand sketching is a natural and powerful means of interpersonal communication. But to date, it still cannot be supported effectively by human-computer interface. In this paper, we propose a robust method for sketch recognition. It uses mean shift, a nonparametric technique which can delineate arbitrarily shaped clusters, as a pre-process to analyze the direction-curvature joint space and suppress the severe noise of sketched strokes. Furthermore, it combines the vertex detection and primitive shape approximation into a unified and incremental procedure which, by fully utilizing the visual features, can handle hybrid and smooth curves gracefully. Our method does not rely on any domain-specific knowledge, and therefore it can be easily integrated with other high-level applications

REFERENCES

• 1: James Arvo , Kevin Novins, Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.73-80, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354413]
• 2: Calhoun, C., Stahovich, T.F., Kurtoglu, T., and Kara, L.B. Recognizing Multi-Stroke Symbols. AAAI Spring Symposium on Sketch Understanding, 2002.
• 3: Yizong Cheng, Mean Shift, Mode Seeking, and Clustering, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.8, p.790-799, August 1995 [doi>10.1109/34.400568]
• 4: Dorin Comaniciu , Peter Meer, Mean Shift: A Robust Approach Toward Feature Space Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.603-619, May 2002 [doi>10.1109/34.1000236]
• 5: Fonseca, M.J., and Jorge, J.A. Using Fuzzy Logic to Recognize Geometric Shapes Interactively. Proceedings of the 9th International Conference on Fuzzy Systems, 2000.
• 6: Fukunaga, K., and Hostetler, L.D. The Estimation of the Gradient of a Density Function. IEEE Transactions on Information Theory, Vol. 21, 1975, 32--40.
• 7: Hammond, T., and Davis, R. Tahuti: A Sketch Recognition System for UML Class Diagrams. AAAI Spring Symposium on Sketch Understanding, 2002.
• 8: Takeo Igarashi , Satoshi Matsuoka , Sachiko Kawachiya , Hidehiko Tanaka, Interactive beautification: a technique for rapid geometric design, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.105-114, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263525]
• 9: Michael Oltmans , Randall Davis, Naturally conveyed explanations of device behavior, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971498]
• 10: Dean Rubine, Specifying gestures by example, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.329-337, July 1991
• 11: Tevfik Metin Sezgin , Thomas Stahovich , Randall Davis, Sketch based interfaces: early processing for sketch understanding, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971487]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Human Factors

Keywords:
HCI, mean shift, multimodal interface, sketch recognition