P-recognition: you are already recognized

ABSTRACT

The user's intention is reflected in not only the actual input action but the ones immediately before it as well. "P-Recognition"" recognizes the preceding actions, and predicts the intention just when the actual action starts. This paper tests P-Recognition in a pen-based map navigation interface as an example, where the map is panned by user's dragging strokes and zoomed by user's enclosure by a circle. The feasibility of the proposal is confirmed in an experiment. We find that dragging and circling actions are distinguishable before the pen touches the screen. Moreover, for some users we can recognize their intention to write text. It is confirmed that the user's intention is present in the preceding actions and so is detectable.

REFERENCES

• 1: Google Maps. http://maps.google.com/.
• 2: George Fitzmaurice , Azam Khan , Robert Pieké , Bill Buxton , Gordon Kurtenbach, Tracking menus, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.71-79, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964704]
• 3: Tovi Grossman , Ken Hinckley , Patrick Baudisch , Maneesh Agrawala , Ravin Balakrishnan, Hover widgets: using the tracking state to extend the capabilities of pen-operated devices, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124898]
• 4: Jun Rekimoto , Takaaki Ishizawa , Carsten Schwesig , Haruo Oba, PreSense: interaction techniques for finger sensing input devices, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.203-212, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964719]
• 5: Yang Li , Ken Hinckley , Zhiwei Guan , James A. Landay, Experimental analysis of mode switching techniques in pen-based user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055036]
• 6: Apple iPhone. http://www.apple.com/iphone/.
• 7: Eric Saund , Edward Lank, Stylus input and editing without prior selection of mode, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.213-216, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964720]
• 8: Takeo Igarashi , Satoshi Matsuoka , Sachiko Kawachiya , Hidehiko Tanaka, Interactive beautification: a technique for rapid geometric design, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.105-114, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263525]
• 9: Dean Rubine, Combining gestures and direct manipulation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.659-660, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143072]
• 10: James Arvo , Kevin Novins, Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.73-80, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354413]
• 11: Gonzalo Ramos , Andy Cockburn , Ravin Balakrishnan , Michel Beaudouin-Lafon, Pointing lenses: facilitating stylus input through visual-and motor-space magnification, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240741]
• 12: Feng Tian , Lishuang Xu , Hongan Wang , Xiaolong Zhang , Yuanyuan Liu , Vidya Setlur , Guozhong Dai, Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357269]
• 13: Toshiyuki Masui, Integrating pen operations for composition by example, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.211-212, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288610]
• 14: HTK. http://htk.eng.cam.ac.uk/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Performance

Keywords:
gesture recognition, hover, map navigation, mode, pan & zoom, predictive interface, stroke recognition, stylus pen