Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces

ABSTRACT

We present Scratch Input, an acoustic-based input technique that relies on the unique sound produced when a fingernail is dragged over the surface of a textured material, such as wood, fabric, or wall paint. We employ a simple sensor that can be easily coupled with existing surfaces, such as walls and tables, turning them into large, unpowered and ad hoc finger input surfaces. Our sensor is sufficiently small that it could be incorporated into a mobile device, allowing any suitable surface on which it rests to be appropriated as a gestural input surface. Several example applications were developed to demonstrate possible interactions. We conclude with a study that shows users can perform six Scratch Input gestures at about 90% accuracy with less than five minutes of training and on wide variety of surfaces.

REFERENCES

• 1: Brian Amento , Will Hill , Loren Terveen, The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506566]
• 2: William Buxton , Ralph Hill , Peter Rowley, Issues and techniques in touch-sensitive tablet input, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.215-224, July 1985
• 3: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 4: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 5: Ken Hinckley , Patrick Baudisch , Gonzalo Ramos , Francois Guimbretiere, Design and analysis of delimiters for selection-action pen gesture phrases in scriboli, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055035]
• 6: Ji-Eun Kim , John Sunwoo , Yong-Ki Son , Dong-Woo Lee , Il-Yeon Cho, A gestural input through finger writing on a textured pad, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1241030]
• 7: Roderick Murray-Smith , John Williamson , Stephen Hughes , Torben Quaade, Stane: synthesized surfaces for tactile input, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357257]
• 8: Shwetak N. Patel , Gregory D. Abowd, Blui: low-cost localized blowable user interfaces, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294250]
• 9: J. A. Paradiso , K. Hsiao , J. Strickon , J. Lifton , A. Adler, Sensor systems for interactive surfaces, IBM Systems Journal, v.39 n.3-4, p.892-914, July 2000
• 10: Paradiso, J., Leo, C., Checka, N., and Hsiao, K. Passive acoustic sensing for tracking knocks atop large interactive displays. In Proc. of IEEE Sensors Conference, 2002, pp. 521--527.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Human Factors

Keywords:
acoustic sensing, ad hoc interaction, finger input, gestures, mobile devices, surfaces