MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb

ABSTRACT

The input vocabulary for touch-screen interaction on handhelds is dramatically limited, especially when the thumb must be used. To enrich that vocabulary we propose to discriminate, among thumb gestures, those we call MicroRolls, characterized by zero tangential velocity of the skin relative to the screen surface. Combining four categories of thumb gestures, Drags, Swipes, Rubbings and MicroRolls, with other classification dimensions, we show that at least 16 elemental gestures can be automatically recognized. We also report the results of two experiments showing that the roll vs. slide distinction facilitates thumb input in a realistic copy and paste task, relative to existing interaction techniques.

REFERENCES

• 1: Pär-Anders Albinsson , Shumin Zhai, High precision touch screen interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642631]
• 2: Gilles Bailly , Eric Lecolinet , Laurence Nigay, Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization, Proceedings of the working conference on Advanced visual interfaces, May 28-30, 2008, Napoli, Italy [doi>10.1145/1385569.1385575]
• 3: Hrvoje Benko , Andrew D. Wilson , Patrick Baudisch, Precise selection techniques for multi-touch screens, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124963]
• 4: William Buxton, A three-state model of graphical input, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.449-456, August 27-31, 1990
• 5: Cross, R. (1999). The bounce of a ball. Am. J. Physics, 67, 222--227.
• 6: Jörg Geißler, Shuffle, throw or take it! working efficiently with an interactive wall, CHI 98 conference summary on Human factors in computing systems, p.265-266, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286745]
• 7: Tovi Grossman , Pierre Dragicevic , Ravin Balakrishnan, Strategies for accelerating on-line learning of hotkeys, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240865]
• 8: François Guimbretiére , Terry Winograd, FlowMenu: combining command, text, and data entry, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.213-216, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354778]
• 9: Amy K. Karlson , Benjamin B. Bederson, One-handed touchscreen input for legacy applications, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357274]
• 10: Amy K. Karlson , Benjamin B. Bederson , John SanGiovanni, AppLens and launchTile: two designs for one-handed thumb use on small devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055001]
• 11: Karlson, A., Bederson, B., Contreras-Vidal, J. (2007). Understandingon User Interface Design and Evaluation for Mobile Technology, Idea Group.
• 12: Gordon Kurtenbach , William Buxton, Issues in combining marking and direct manipulation techniques, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.137-144, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120797]
• 13: I. Scott MacKenzie , Aleks Oniszczak, A comparison of three selection techniques for touchpads, Proceedings of the SIGCHI conference on Human factors in computing systems, p.336-343, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274691]
• 14: Alex Olwal , Steven Feiner , Susanna Heyman, Rubbing and tapping for precise and rapid selection on touch-screen displays, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357105]
• 15: Aleks Oniszczak , I. Scott MacKenzie, A comparison of two input methods for keypads on mobile devices, Proceedings of the third Nordic conference on Human-computer interaction, p.101-104, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028030]
• 16: Pekka Parhi , Amy K. Karlson , Benjamin B. Bederson, Target size study for one-handed thumb use on small touchscreen devices, Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, September 12-15, 2006, Helsinki, Finland [doi>10.1145/1152215.1152260]
• 17: Jason Pascoe , Nick Ryan , David Morse, Using while moving: HCI issues in fieldwork environments, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.3, p.417-437, Sept. 2000 [doi>10.1145/355324.355329]
• 18: Stuart Pook , Eric Lecolinet , Guy Vaysseix , Emmanuel Barillot, Control menus: excecution and control in a single interactor, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633446]
• 19: R. L. Potter , L. J. Weldon , B. Shneiderman, Improving the accuracy of touch screens: an experimental evaluation of three strategies, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-32, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57171]
• 20: Resnick, R.&Halliday, D. (1966). Physics, Part I. New York: John Wiley&Sons, Inc.
• 21: Anne Roudaut , Stéphane Huot , Eric Lecolinet, TapTap and MagStick: improving one-handed target acquisition on small touch-screens, Proceedings of the working conference on Advanced visual interfaces, May 28-30, 2008, Napoli, Italy [doi>10.1145/1385569.1385594]
• 22: Dean Rubine, Specifying gestures by example, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.329-337, July 1991
• 23: Grham Smith , m. c. schraefel , Patrick Baudisch, Curve dial: eyes-free parameter entry for GUIs, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056855]
• 24: Daniel Vogel , Patrick Baudisch, Shift: a technique for operating pen-based interfaces using touch, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240727]
• 25: Koji Yatani , Kurt Partridge , Marshall Bern , Mark W. Newman, Escape: a target selection technique using visually-cued gestures, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357104]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Screen design (e.g., text, graphics, color)

General Terms:
Design, Human Factors

Keywords:
gestures, interaction, microroll, mobile devices, one-handed, rolling/sliding gestures, rollmark, rolltap, selection techniques, thumb interaction, touch-screen