Audio or tactile feedback: which modality when?

ABSTRACT

When designing interfaces for mobile devices it is import-ant to take into account the variety of contexts of use. We present a study that examines how changing noise and dis-turbance in the environment affects user performance in a touchscreen typing task with the interface being presented through visual only, visual and tactile, or visual and audio feedback. The aim of the study is to show at what exact environmental levels audio or tactile feedback become inef-fective. The results show significant decreases in perform-ance for audio feedback at levels of 94dB and above as well as decreases in performance for tactile feedback at vibration levels of 9.18g/s. These results suggest that at these levels, feedback should be presented by a different modality. These findings will allow designers to take advantage of sensor enabled mobile devices to adapt the provided feed-back to the user's current context.

REFERENCES

• 1: Angela Chang , Conor O'Sullivan, Audio-haptic feedback in mobile phones, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056892]
• 2: Eve Hoggan , Stephen Brewster, Designing audio and tactile crossmodal icons for mobile devices, Proceedings of the 9th international conference on Multimodal interfaces, November 12-15, 2007, Nagoya, Aichi, Japan [doi>10.1145/1322192.1322222]
• 3: Eve Hoggan , Stephen A. Brewster , Jody Johnston, Investigating the effectiveness of tactile feedback for mobile touchscreens, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357300]
• 4: C. Lenay , S. Canu , P. Villon, Technology and perception: the contribution of sensory substitution systems, Proceedings of the 2nd International Conference on Cognitive Technology (CT '97), p.44, August 25-28, 1997
• 5: I. Scott MacKenzie , R. William Soukoreff, Phrase sets for evaluating text entry techniques, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765971]
• 6: Ivan Poupyrev , Shigeaki Maruyama, Tactile interfaces for small touch screens, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.217-220, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964721]
• 7: Mika Raento , Antti Oulasvirta , Renaud Petit , Hannu Toivonen, ContextPhone: A Prototyping Platform for Context-Aware Mobile Applications, IEEE Pervasive Computing, v.4 n.2, p.51-59, April 2005 [doi>10.1109/MPRV.2005.29]
• 8: R. William Soukoreff , I. Scott MacKenzie, Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642632]
• 9: John Williamson , Roderick Murray-Smith , Stephen Hughes, Shoogle: excitatory multimodal interaction on mobile devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240642]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Auditory (non-speech) feedback

General Terms:
Experimentation, Human Factors, Measurement, Performance

Keywords:
auditory feedback, crossmodal interaction, mobile touchscreen interaction, tactile feedback