Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces

ABSTRACT

Many research projects have demonstrated the benefits of bimanual interaction for a variety of tasks. When choosing bimanual input, system designers must select the input device that each hand will control. In this paper, we argue for the use of pen and touch two-handed input, and describe an experiment in which users were faster and committed fewer errors using pen and touch input in comparison to using either touch and touch or pen and pen input while performing a representative bimanual task. We present design principles and an application in which we applied our design rationale toward the creation of a learnable set of bimanual, pen and touch input commands.

REFERENCES

• 1: Anoto. http://www.anoto.com
• 2: Ravin Balakrishnan , Ken Hinckley, The role of kinesthetic reference frames in two-handed input performance, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.171-178, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322599]
• 3: Ravin Balakrishnan , Ken Hinckley, Symmetric bimanual interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.33-40, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332404]
• 4: Ravin Balakrishnan , Pranay Patel, The PadMouse: facilitating selection and spatial positioning for the non-dominant hand, Proceedings of the SIGCHI conference on Human factors in computing systems, p.9-16, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274646]
• 5: Hrvoje Benko , Andrew D. Wilson , Patrick Baudisch, Precise selection techniques for multi-touch screens, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124963]
• 6: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, August 02-06, 0093, Anaheim, CA [doi>10.1145/166117.166126]
• 7: Colin G. Butler , Robert St. Amant, HabilisDraw DT: a bimanual tool-based direct manipulation drawing environment, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986049]
• 8: W. Buxton , B. Myers, A study in two-handed input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 13-17, 1986, Boston, Massachusetts, United States
• 9: Didier Casalta , Yves Guiard , Michel Beaudouin Lafon, Evaluating two-handed input techniques: rectangle editing and navigation, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632862]
• 10: Stéphane Chatty, Extending a graphical toolkit for two-handed interaction, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.195-204, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192500]
• 11: Stephané Chatty, Issues and experience in designing two-handed interaction, Conference companion on Human factors in computing systems, p.253-254, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260470]
• 12: Lawrence D. Cutler , Bernd Fröhlich , Pat Hanrahan, Two-handed direct manipulation on the responsive workbench, Proceedings of the 1997 symposium on Interactive 3D graphics, p.107-114, April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253315]
• 13: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 14: Alan Esenther , Kathy Ryall, Fluid DTMouse: better mouse support for touch-based interactions, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133289]
• 15: Flider, M. J., Bailey, B. P. (2004). An evaluation of techniques for controlling focus+context screens. GI 2004. p. 135--144.
• 16: Clifton Forlines , Daniel Wigdor , Chia Shen , Ravin Balakrishnan, Direct-touch vs. mouse input for tabletop displays, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240726]
• 17: Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4), 486--517.
• 18: Ken Hinckley , Patrick Baudisch , Gonzalo Ramos , Francois Guimbretiere, Design and analysis of delimiters for selection-action pen gesture phrases in scriboli, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055035]
• 19: Ken Hinckley , Mary Czerwinski , Mike Sinclair, Interaction and modeling techniques for desktop two-handed input, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.49-58, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288572]
• 20: Ken Hinckley , Randy Pausch , Dennis Proffitt , James Patten , Neal Kassell, Cooperative bimanual action, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-34, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258571]
• 21: Paul Kabbash , I. Scott MacKenzie , William Buxton, Human performance using computer input devices in the preferred and non-preferred hands, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.474-481, May 1993, Amsterdam, The Netherlands
• 22: Krueger, M., VIDEOPLACE and the interface of the future. The art of human computer interface design, B. Laurel, Editor. 1991, Addison Wesley: Menlo Park, CA. p. 417--422.
• 23: Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, The design of a GUI paradigm based on tablets, two-hands, and transparency, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-42, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258574]
• 24: Celine Latulipe , Stephen Mann , Craig S. Kaplan , Charlie L. A. Clarke, symSpline: symmetric two-handed spline manipulation, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124825]
• 25: Andrea Leganchuk , Shumin Zhai , William Buxton, Manual and cognitive benefits of two-handed input: an experimental study, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.4, p.326-359, Dec. 1998 [doi>10.1145/300520.300522]
• 26: I. Scott MacKenzie , Yves Guiard, The two-handed desktop interface: are we there yet?, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634275]
• 27: Nobuyuki Matsushita , Yuji Ayatsuka , Jun Rekimoto, Dual touch: a two-handed interface for pen-based PDAs, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.211-212, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354774]
• 28: Nobuyuki Matsushita , Jun Rekimoto, HoloWall: designing a finger, hand, body, and object sensitive wall, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.209-210, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263549]
• 29: Maxell PenIT. http://www.maxell.co.jp/e/products/industrial/digitalpen/
• 30: Brad A. Myers , Kin Pou Lie , Bo-Chieh Yang, Two-handed input using a PDA and a mouse, Proceedings of the SIGCHI conference on Human factors in computing systems, p.41-48, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332405]
• 31: Russell Owen , Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, When it gets more difficult, use both hands: exploring bimanual curve manipulation, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia
• 32: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 33: Garth Shoemaker , Carl Gutwin, Supporting multi-point interaction in visual workspaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240777]
• 34: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 35: Mike Wu , Ravin Balakrishnan, Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.193-202, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964718]
• 36: Mike Wu , Chia Shen , Kathy Ryall , Clifton Forlines , Ravin Balakrishnan, Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces, Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, p.185-192, January 05-07, 2006 [doi>10.1109/TABLETOP.2006.19]
• 37: Ka-Ping Yee, Two-handed interaction on a tablet display, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986098]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Keywords:
bimanual input, pen and touch, self revealing gestures