Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Haptic icons are brief, meaningful tactile or force stimuli designed to support the communication of information through the often-underutilized haptic modality. Challenges to producing large, reusable sets of haptic icons include technological constraints and the need for broadly-applicable and validated design heuristics to guide the process. The largest set of haptic stimuli to date was produced through systematic use of heuristics for monotone rhythms. We hypothesized that further extending signal expressivity would continue to enhance icon learnability. Here, we introduce melody into the design of rhythmic stimuli as a means of increasing expressiveness while retaining the principle of systematic design, as guided by music theory. Haptic melodies are evaluated for their perceptual distinctiveness; experimental results from grouping tasks indicate that rhythm dominates user categorization of melodies, with frequency and amplitude potentially left available as new dimensions for the designer to control within-group variation.

REFERENCES

• 1: Meera M. Blattner , Denise A. Sumikawa , Robert M. Greenberg, Earcons and icons: their structure and common design principles, Human-Computer Interaction, v.4 n.1, p.11-44, March 1989 [doi>10.1207/s15327051hci0401_1]
• 2: S. Brewster, P. Wright, and A. Edwards. Experimentally derived guidelines for the creation of earcons. In HCI '95, 1995.
• 3: Lorna M. Brown , Stephen A. Brewster , Helen C. Purchase, A First Investigation into the Effectiveness of Tactons, Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.167-176, March 18-20, 2005 [doi>10.1109/WHC.2005.6]
• 4: L. M. Brown. Tactons: Structured Vibrotactile Messages for NonVisual Information Display. PhD thesis, University of Glasgow, April 2007.
• 5: Andrew Chan , Karon MacLean , Joanna McGrenere, Learning and Identifying Haptic Icons under Workload, Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.432-439, March 18-20, 2005 [doi>10.1109/WHC.2005.86]
• 6: Andrew Chan , Karon MacLean , Joanna McGrenere, Designing haptic icons to support collaborative turn-taking, International Journal of Human-Computer Studies, v.66 n.5, p.333-355, May, 2008 [doi>10.1016/j.ijhcs.2007.11.002]
• 7: T. W. Deacon. The Symbolic Species. W. W. Norton & Company Ltd., 1997.
• 8: Mario Enriquez , Karon MacLean , Christian Chita, Haptic phonemes: basic building blocks of haptic communication, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada [doi>10.1145/1180995.1181053]
• 9: William W. Gaver, Auditory icons: using sound in computer interfaces, Human-Computer Interaction, v.2 n.2, p.167-177, June 1986 [doi>10.1207/s15327051hci0202_3]
• 10: K. Hevner. The affective character of major and minor modes in music. American Journal of Psychology, 47:103--118, 1935.
• 11: Eve E. Hoggan , Stephen A. Brewster, Crossmodal icons for information display, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125619]
• 12: M. Hollins, R. Faldowski, S. Rao, and F. Young. Perceptual dimensions of tactile surface textures: A multidimensional scaling analysis. Perception and Psychophysics, 54:697--705, 1993.
• 13: T. Kaaresoja, L. Brown, and J. Linjama. Snap-Crackle-Pop: Tactile Feedback for Mobile Touch Screens. Proceedings of Eurohaptics 2006, pages 565--566, 2006.
• 14: S. Lederman. Auditory texture perception. Perception, 8(1):93--103, 1979.
• 15: Joseph Luk , Jerome Pasquero , Shannon Little , Karon MacLean , Vincent Levesque , Vincent Hayward, A role for haptics in mobile interaction: initial design using a handheld tactile display prototype, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124800]
• 16: Karon E. MacLean, Foundations of Transparency in Tactile Information Design, IEEE Transactions on Haptics, v.1 n.2, p.84-95, July 2008 [doi>10.1109/TOH.2008.20]
• 17: K. MacLean and M. Enriquez. Perceptual design of haptic icons. In Eurohaptics, Dublin, UK, July 2003.
• 18: G. Miller. The magical number seven, plus or minus two: some limits on our capability for processing information. Psychological Review, 63:81--97, 1956.
• 19: S. E. Newman, A. D. Hall, D. J. Foster, and V. Gupta. Learning as a function of haptic discriminability among items. The American Journal of Psychology, 97(3):359--372, 1984.
• 20: Takuya Nojima , Kohei Funabiki, Cockpit Display Using Tactile Sensation, Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.501-502, March 18-20, 2005 [doi>10.1109/WHC.2005.27]
• 21: Jerome Pasquero , Joseph Luk , Shannon Little , Karon MacLean, Perceptual Analysis of Haptic Icons: an Investigation into the Validity of Cluster Sorted MDS, Proceedings of the Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.67, March 25-29, 2006 [doi>10.1109/HAPTICS.2006.171]
• 22: I. Peretz, L. Gagnon, and B. Bouchard. Music and emotion: perceptual determinants, immediacy and isolation after brain damage. Cognition, 68:111--141, 1998.
• 23: M. Rigg. The mood effects of music: A comparison of data from four investigators. Journal of Psychology, 58:427--438, 1964.
• 24: D. Ternes. Building large sets of haptic icons: Rhythm as a design parameter, and between-subjects mds for evaluation. Master's thesis, University of British Columbia, 2007.
• 25: David Ternes , Karon E. Maclean, Designing Large Sets of Haptic Icons with Rhythm, Proceedings of the 6th international conference on Haptics: Perception, Devices and Scenarios, June 10-13, 2008, Madrid, Spain [doi>10.1007/978-3-540-69057-3_24]
• 26: J. van Erp and M. Spape. Distilling the underlying dimensions of tactile melodies. In Eurohaptics, pages 111--120, 2003.
• 27: M. Weiser and J. Brown. Designing calm technology. Powergrid Journal, 1.01:94--110, 1996.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
haptic UIs, multi-modal interfaces, user studies