A role for haptics in mobile interaction: initial design using a handheld tactile display prototype

ABSTRACT

Mobile interaction can potentially be enhanced with well-designed haptic control and display. However, advances have been limited by a vicious cycle whereby inadequate haptic technology obstructs inception of vitalizing applications. We present the first stages of a systematic design effort to break that cycle, beginning with specific usage scenarios and a new handheld display platform based on lateral skin stretch. Results of a perceptual device characterization inform mappings between device capabilities and specific roles in mobile interaction, and the next step of hardware re-engineering.

REFERENCES

• 1: Lorna M. Brown , Stephen A. Brewster , Helen C. Purchase, A First Investigation into the Effectiveness of Tactons, Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.167-176, March 18-20, 2005 [doi>10.1109/WHC.2005.6]
• 2: Andrew Chan , Karon MacLean , Joanna McGrenere, Learning and Identifying Haptic Icons under Workload, Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.432-439, March 18-20, 2005 [doi>10.1109/WHC.2005.86]
• 3: Angela Chang , Conor O'Sullivan, Audio-haptic feedback in mobile phones, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056892]
• 4: Cholewiak, R., Sherrick, C. A computer-controlled ma-trix system for presentation to skin of complex spatio-temporal pattern. Behavior Research Methods and In-strumentation, 13, 5 (1981), 667--673.
• 5: Geldard, F., Some neglected possibilities of communication. Science, 131, 3413 (1960), 1583--1588.
• 6: Francine Gemperle , Nathan Ota , Dan Siewiorek, Design of a Wearable Tactile Display, Proceedings of the 5th IEEE International Symposium on Wearable Computers, p.5, October 08-09, 2001
• 7: Enriquez, M. and MacLean, K. E. (2005). Common On-set Masking of Vibrotactile Stimuli - POSTER, in Proc. World Haptics, IEEE (2005).
• 8: Hayward, V. and Cruz-Hernandez, M. Tactile display device using distributed lateral skin stretch. In Proc. Haptic Interfaces for Virtual Environment and Teleoperator Sys. Symposium, IEEE (2000), 1309--1314.
• 9: Vincent Lévesque , Jérôme Pasquero , Vincent Hayward , Maryse Legault, Display of virtual braille dots by lateral skin deformation: feasibility study, ACM Transactions on Applied Perception (TAP), v.2 n.2, p.132-149, April 2005 [doi>10.1145/1060581.1060587]
• 10: Jukka Linjama , Topi Kaaresoja, Novel, minimalist haptic gesture interaction for mobile devices, Proceedings of the third Nordic conference on Human-computer interaction, p.457-458, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028095]
• 11: Karon E. MacLean , Michael J. Shaver , Dinesh K. Pai, Handheld Haptics: A USB Media Controller with Force Sensing, Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.311, March 24-25, 2002
• 12: MacLean, K.E., and Enriquez, M. Perceptual Design of Haptic Icons. In Proc. EuroHaptics 2003, IEEE (2003).
• 13: Bonnie A. Nardi , Steve Whittaker , Erin Bradner, Interaction and outeraction: instant messaging in action, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.79-88, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358975]
• 14: Antti Oulasvirta , Sakari Tamminen , Virpi Roto , Jaana Kuorelahti, Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055101]
• 15: Pasquero, J., Luk, J., Little, S., MacLean, K.E. Perceptual analysis of haptic icons: an investigation into the validity of cluster sorted MDS. In Proc. Of Symp. On Haptic Interfaces for Virtual Environment and Teleoperator Systems (IEEE-VR), IEEE (2006).
• 16: Ivan Poupyrev , Shigeaki Maruyama , Jun Rekimoto, Ambient touch: designing tactile interfaces for handheld devices, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571993]
• 17: Ivan Poupyrev , Shigeaki Maruyama, Tactile interfaces for small touch screens, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.217-220, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964721]
• 18: Shimoga, K.B. Finger Force and Touch Feedback Issues in Dexterous Telemanipulation. In Proc. Intelligent Ro-botic Sys. for Space Exploration, IEEE (1992), 159--178.
• 19: VibeTonz system. Immersion Corporation (2005). http://www.immersion.com/mobility
• 20: Wagner, C.R., Lederman, S.J., Howe, R.D. Design and performance of a tactile display using RC servomotors. Haptics-e Electronic Journal of Haptics Research (www.haptics-e.org), 3, 4 (Sept. 1999).
• 21: Ward, L. Multidimensional scaling of the molar physical environment. Multivariate Behavioral Research, 12 (1977) 23--42.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
design process, display, handheld interaction, haptic, lateral skin stretch, mobile, multimodal, tactile