Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation

ABSTRACT

Multitouch workstations support direct-touch, bimanual, and multifinger interaction. Previous studies have separately examined the benefits of these three interaction attributes over mouse-based interactions. In contrast, we present an empirical user study that considers these three interaction attributes together for a single task, such that we can quantify and compare the performances of each attribute. In our experiment users select multiple targets using either a mouse-based workstation equipped with one mouse, or a multitouch workstation using either one finger, two fingers (one from each hand), or multiple fingers. We find that the fastest multitouch condition is about twice as fast as the mouse-based workstation, independent of the number of targets. Direct-touch with one finger accounts for an average of 83% of the reduction in selection time. Bimanual interaction, using at least two fingers, one on each hand, accounts for the remaining reduction in selection time. Further, we find that for novice multitouch users there is no significant difference in selection time between using one finger on each hand and using any number of fingers for this task. Based on these observations we conclude with several design guidelines for developing multitouch user interfaces.

REFERENCES

• 1: Ravin Balakrishnan , Ken Hinckley, The role of kinesthetic reference frames in two-handed input performance, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.171-178, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322599]
• 2: Ravin Balakrishnan , Ken Hinckley, Symmetric bimanual interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.33-40, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332404]
• 3: W. Barnert. A comparison of one-handed and two-handed direct and indirect computer interaction. Technical report, Department of Computer Science, Tufts University, Medford, Mass., 11 2005.
• 4: Hrvoje Benko , Andrew D. Wilson , Patrick Baudisch, Precise selection techniques for multi-touch screens, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124963]
• 5: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, August 02-06, 1993, Anaheim, CA [doi>10.1145/166117.166126]
• 6: W. Buxton , B. Myers, A study in two-handed input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 13-17, 1986, Boston, Massachusetts, United States
• 7: Didier Casalta , Yves Guiard , Michel Beaudouin Lafon, Evaluating two-handed input techniques: rectangle editing and navigation, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632862]
• 8: J. Diedrichsen, E. Hazeltine, S. Kennerley, and R. B. Ivry. Moving to directly cued locations abolishes spatial interference during bimanual actions. Psychological Science, 12(6):493--498, 2001.
• 9: R. F. Dillon , Jeff D. Edey , Jo W. Tombaugh, Measuring the true cost of command selection: techniques and results, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.19-26, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97247]
• 10: Clifton Forlines , Daniel Wigdor , Chia Shen , Ravin Balakrishnan, Direct-touch vs. mouse input for tabletop displays, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240726]
• 11: Y. Guiard. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a mode. Journal of Motor Behavior, 19(4):486--517, 1987.
• 12: Y. Guiard and T. Ferrand. Asymmetry in bimanual skills. In Manual asymmetries in motor performance, CRC Press., 1995.
• 13: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 14: Mark Hancock , Sheelagh Carpendale , Andy Cockburn, Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240798]
• 15: Ken Hinckley , Mary Czerwinski , Mike Sinclair, Interaction and modeling techniques for desktop two-handed input, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.49-58, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288572]
• 16: Ken Hinckley , Randy Pausch , Dennis Proffitt , Neal F. Kassell, Two-handed virtual manipulation, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.3, p.260-302, Sept. 1998 [doi>10.1145/292834.292849]
• 17: Ken Hinckley , Randy Pausch , Dennis Proffitt , James Patten , Neal Kassell, Cooperative bimanual action, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-34, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258571]
• 18: Paul Kabbash , William Buxton , Abigail Sellen, Two-handed input in a compound task, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.417-423, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191808]
• 19: J Karat , J E McDonald , M Anderson, A comparison of menu selection techniques: touch panel, mouse and keyboard, International Journal of Man-Machine Studies, v.25 n.1, p.73-88, July 1986 [doi>10.1016/S0020-7373(86)80034-7]
• 20: J. A. S. Kelso, D. L. Southard, and D. Goodman. On the coordination of two-handed movements. Journal of Experimental Psychology, 5(2):229--238, 1979.
• 21: J. A. S. Kelso, D. L. Southard, and D. Goodman. On the nature of human interlimb coordination. Journal of Experimental Psychology, 203(4384):1029--1031, 1979.
• 22: Celine Latulipe , Craig S. Kaplan , Charles L. A. Clarke, Bimanual and unimanual image alignment: an evaluation of mouse-based techniques, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095057]
• 23: Celine Latulipe , Stephen Mann , Craig S. Kaplan , Charlie L. A. Clarke, symSpline: symmetric two-handed spline manipulation, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124825]
• 24: MERL - DiamondTouch. http://www.merl.com/projects/DiamondTouch/.
• 25: Microsoft Surface. http://www.microsoft.com/surface/index.html.
• 26: Meredith June Morris , Terry Winograd, Supporting effective interaction with tabletop groupware, Stanford University, Stanford, CA, 2006
• 27: Tomer Moscovich , John F. Hughes, Indirect mappings of multi-touch input using one and two hands, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357254]
• 28: Daniel Ostroff , Ben Shneiderman, Selection devices for users of an electronic encyclopedia: an empirical comparison of four possibilities, Information Processing and Management: an International Journal, v.24 n.6, p.665-680, November 1988 [doi>10.1016/0306-4573(88)90004-0]
• 29: Russell Owen , Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, When it gets more difficult, use both hands: exploring bimanual curve manipulation, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia
• 30: Perceptive Pixel. http://www.perceptivepixel.com/.
• 31: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 32: Stacey D. Scott , Karen D. Grant , Regan L. Mandryk, System guidelines for co-located, collaborative work on a tabletop display, Proceedings of the eighth conference on European Conference on Computer Supported Cooperative Work, p.159-178, September 14-18, 2003, Helsinki, Finland
• 33: Andrew Sears , Ben Shneiderman, High precision touchscreens: design strategies and comparisons with a mouse, International Journal of Man-Machine Studies, v.34 n.4, p.593-613, April 1991 [doi>10.1016/0020-7373(91)90037-8]
• 34: Mike Wu , Ravin Balakrishnan, Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.193-202, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964718]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Keywords:
bimanual input, direct-touch input, mouse, multifinger input, multitarget selection, multitouch