Ambient touch: designing tactile interfaces for handheld devices

ABSTRACT

This paper investigates the sense of touch as a channel for communicating with miniature handheld devices. We embedded a PDA with a TouchEngine^TM --- a thin, miniature lower-power tactile actuator that we have designed specifically to use in mobile interfaces (Figure 1). Unlike previous tactile actuators, the TouchEngine is a universal tactile display that can produce a wide variety of tactile feelings from simple clicks to complex vibrotactile patterns. Using the TouchEngine, we began exploring the design space of interactive tactile feedback for handheld computers. Here, we investigated only a subset of this space: using touch as the ambient, background channel of interaction. We proposed a general approach to design such tactile interfaces and described several implemented prototypes. Finally, our user studies demonstrated 22% faster task completion when we enhanced handheld tilting interfaces with tactile feedback.

REFERENCES

• 1: Design innovations yearbook 2000. 2000, Design-Zentrum Nordrhein Westfallen, Verlagpp.
• 2: Motoyuki Akamatsu , Sigeru Sato, A multi-modal mouse with tactile and force feedback, International Journal of Human-Computer Studies, v.40 n.3, p.443-453, March 1994 [doi>10.1006/ijhc.1994.1020]
• 3: Annaswamy, A.M., M.A. Srinivasan, The role of compliant fingerpads in grasping and manipulation: Identification and control, in Essays on Mathematical Robotics: The IMA Volumes in Mathematics and its Applications., J. Baillieul and S. Sastry, Editors. 1998, Springer-Verlag.
• 4: Apelle, S., Haptic perception of form: activity and stimulus attributes, in The psychology of touch, M. Heller and W. Schiff, Editors. 1991, Lawrence Erlbaum: Hillsdale, NJ. p. 169-188.
• 5: Joel F. Bartlett, Rock 'n' Scroll Is Here to Stay, IEEE Computer Graphics and Applications, v.20 n.3, p.40-45, May 2000 [doi>10.1109/38.844371]
• 6: M. Billinghurst , J. Bowskill , N. Dyer , J. Morphett, An Evaluation of Wearable Information Spaces, Proceedings of the Virtual Reality Annual International Symposium, p.20, March 14-18, 1998
• 7: Frederick P. Brooks, Jr. , Ming Ouh-Young , James J. Batter , P. Jerome Kilpatrick, Project GROPEHaptic displays for scientific visualization, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.177-185, September 1990, Dallas, TX, USA
• 8: Grigore C. Burdea, Force and touch feedback for virtual reality, John Wiley & Sons, Inc., New York, NY, 1996
• 9: P. Buttolo , B. Hannaford, Pen-based force display for precision manipulation in virtual environments, Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95), p.217, March 11-15, 1995
• 10: Buxton, B. Integrating the periphery and context: a new taxonomy of telematics. in Graphics Interfaces. 1995 p. 239-246.
• 11: Cholewiak, R., A. Collins, Sensory and physiological bases of touch, in The psychology of touch, M. Heller and W. Schiff, Ed. 1991, Lawrence Erlbaum. p. 23-60.
• 12: Cholewiak, R., C. Sherrick, A computer-controlled matrix system for presentation to skin of complex spatiotemporal pattern. Behavior Research Methods and Instrumentation, 1981. 13(5): p. 667-673.
• 13: George W. Fitzmaurice , Hiroshi Ishii , William A. S. Buxton, Bricks: laying the foundations for graspable user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.442-449, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223964]
• 14: George W. Fitzmaurice , Shumin Zhai , Mark H. Chignell, Virtual reality for palmtop computers, ACM Transactions on Information Systems (TOIS), v.11 n.3, p.197-218, July 1993 [doi>10.1145/159161.159160]
• 15: George W. Fitzmaurice, Situated information spaces and spatially aware palmtop computers, Communications of the ACM, v.36 n.7, p.39-49, July 1993 [doi>10.1145/159544.159566]
• 16: Masaaki Fukumoto , Toshiaki Sugimura, Active click: tactile feedback for touch panels, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634141]
• 17: Gault, R., Progress in experiments on tactual interpretation of oral speech. Journal of Abnormal and Social Psychology, 1925(14): p. 155-159.
• 18: Geldard, F., Adventures in tactile literacy. American Psychologist, 1957. 12: p. 115-124.
• 19: Geldard, F., Some neglected possibilities for communication. Science, 1960. 131(3413): p. 1583-1588.
• 20: Francine Gemperle , Nathan Ota , Dan Siewiorek, Design of a Wearable Tactile Display, Proceedings of the 5th IEEE International Symposium on Wearable Computers, p.5, October 08-09, 2001
• 21: Gescheider, G., et al., The effects of a surround on the vibrotactile thresholds. Sensory Process, 1978. 2(2): p. 99-115.
• 22: Grob, B., Basic electronics. 8 ed. 1997, McGrow-Hill. 1010 pp.
• 23: Beverly L. Harrison , Kenneth P. Fishkin , Anuj Gujar , Carlos Mochon , Roy Want, Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-24, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274647]
• 24: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, Passive real-world interface props for neurosurgical visualization, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.452-458, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191821]
• 25: Ken Hinckley , Jeff Pierce , Mike Sinclair , Eric Horvitz, Sensing techniques for mobile interaction, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.91-100, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354417]
• 26: Robert G. Hughes , A. Robin Forrest, Perceptualisation using a tactile mouse, Proceedings of the 7th conference on Visualization '96, p.181-ff., October 28-29, 1996, San Francisco, California, United States
• 27: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 28: Hiroyuki Kajimoto , Naoki Kawakami , Taro Maeda , Susumu Tachi, Electrocutaneous Display as an Interface to a Virtual Tactile World, Proceedings of the Virtual Reality 2001 Conference (VR'01), p.289, March 13-17, 2001
• 29: Steinar Kristoffersen , Fredrik Ljungberg, “Making place” to make IT work: empirical explorations of HCI for mobile CSCW, Proceedings of the international ACM SIGGROUP conference on Supporting group work, p.276-285, November 14-17, 1999, Phoenix, Arizona, United States [doi>10.1145/320297.320330]
• 30: I. Scott MacKenzie , Aleks Oniszczak, A comparison of three selection techniques for touchpads, Proceedings of the SIGCHI conference on Human factors in computing systems, p.336-343, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274691]
• 31: Timothy Miller , Robert Zeleznik, The design of 3D haptic widgets, Proceedings of the 1999 symposium on Interactive 3D graphics, p.97-102, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300534]
• 32: Margaret Minsky , Ouh-young Ming , Oliver Steele , Frederick P. Brooks, Jr. , Max Behensky, Feeling and seeing: issues in force display, Proceedings of the 1990 symposium on Interactive 3D graphics, p.235-241, February 1990, Snowbird, Utah, United States
• 33: Jason Pascoe , Nick Ryan , David Morse, Using while moving: HCI issues in fieldwork environments, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.3, p.417-437, Sept. 2000 [doi>10.1145/355324.355329]
• 34: Elin Rønby Pedersen , Tomas Sokoler, AROMA: abstract representation of presence supporting mutual awareness, Proceedings of the SIGCHI conference on Human factors in computing systems, p.51-58, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258584]
• 35: Ivan Poupyrev , Desney S. Tan , Mark Billinghurst , Hirokazu Kato , Holger Regenbrecht , Nobuji Tetsutani, Developing a Generic Augmented-Reality Interface, Computer, v.35 n.3, p.44-50, March 2002 [doi>10.1109/2.989929]
• 36: Jun Rekimoto, Tilting operations for small screen interfaces, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.167-168, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237115]
• 37: Nitin Sawhney , Chris Schmandt, Nomadic radio: scaleable and contextual notification for wearable audio messaging, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.96-103, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303005]
• 38: Sherrick, C., Vibrotactile pattern perception: some findings and applications, in The Psychology of Touch, M. Heller and W. Schiff, Editors. 1991, Lawrence Erlbaum Associates. p. 189-217.
• 39: Hong Z. Tan , Alex Pentland, Tactual Displays for Wearable Computing, Proceedings of the 1st IEEE International Symposium on Wearable Computers, p.84, October 13-14, 1997
• 40: Uchino, K., Piezoelectric Actuators and Ultrasonic Motors. 1996, Kluwer Academic Publishers. 349 pp.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.3 Microcomputers
          Subjects: Portable devices (e.g., laptops, personal digital assistants)

Additional Classification:
  C. Computer Systems Organization
  C.1 PROCESSOR ARCHITECTURES
      C.1.3 Other Architecture Styles
          Subjects: Cellular architecture (e.g., mobile)
      C.1.4 Parallel Architectures
          Subjects: Mobile processors

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
          Subjects: Input devices

General Terms:
Experimentation, Human Factors, Reliability

Keywords:
mobile devices and interfaces, tactile feedback