Two-handed interaction on a tablet display

ABSTRACT

A touchscreen can be overlaid on a tablet computer to support asymmetric two-handed interaction in which the preferred hand uses a stylus and the non-preferred hand operates the touchscreen. The result is a portable device that allows both hands to interact directly with the display, easily constructed from commonly available hardware. The method for tracking the independent motions of both hands is described. A wide variety of existing two-handed interaction techniques can be used on this platform, as well as some new ones that exploit the reconfigurability of touchscreen interfaces. Informal tests show that, when the non-preferred hand performs simple actions, users find direct manipulation on the display with both hands to be comfortable, natural, and efficient.

REFERENCES

• 1: Ravin Balakrishnan , Pranay Patel, The PadMouse: facilitating selection and spatial positioning for the non-dominant hand, Proceedings of the SIGCHI conference on Human factors in computing systems, p.9-16, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274646]
• 2: Eric A. Bier , Maureen C. Stone , Ken Fishkin , William Buxton , Thomas Baudel, A taxonomy of see-through tools, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.358-364, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191786]
• 3: W. Buxton , B. Myers, A study in two-handed input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 13-17, 1986, Boston, Massachusetts, United States
• 4: Y. Guiard. Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. J. Motor Behavior 19 (4), 1987, 486--517.
• 5: Ken Hinckley , Randy Pausch , Dennis Proffitt, Attention and visual feedback: the bimanual frame of reference, Proceedings of the 1997 symposium on Interactive 3D graphics, p.121-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253318]
• 6: Ken Hinckley , Randy Pausch , Dennis Proffitt , James Patten , Neal Kassell, Cooperative bimanual action, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-34, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258571]
• 7: Ken Hinckley , Mary Czerwinski , Mike Sinclair, Interaction and modeling techniques for desktop two-handed input, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.49-58, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288572]
• 8: Paul Kabbash , William Buxton , Abigail Sellen, Two-handed input in a compound task, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.417-423, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191808]
• 9: Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, The design of a GUI paradigm based on tablets, two-hands, and transparency, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-42, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258574]
• 10: Nobuyuki Matsushita , Yuji Ayatsuka , Jun Rekimoto, Dual touch: a two-handed interface for pen-based PDAs, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.211-212, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354774]
• 11: Brad A. Myers , Kin Pou Lie , Bo-Chieh Yang, Two-handed input using a PDA and a mouse, Proceedings of the SIGCHI conference on Human factors in computing systems, p.41-48, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332405]
• 12: Roope Raisamo, An alternative way of drawing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.175-182, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303035]
• 13: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]

INDEX TERMS

Keywords:
asymmetric bimanual interaction, commodity hardware, tablet computing, touch-sensitive screens