Effects of feedback, mobility and index of difficulty on deictic spatial audio target acquisition in the horizontal plane

ABSTRACT

We present the results of an empirical study investigating the effect of feedback, mobility and index of difficulty on a deictic spatial audio target acquisition task in the horizontal plane in front of a user. With audio feedback, spatial audio display elements are found to enable usable deictic interac-tion that can be described using Fitts law. Feedback does not affect perceived workload or preferred walking speed compared to interaction without feedback. Mobility is found to degrade interaction speed and accuracy by 20%. Participants were able to perform deictic spatial audio target acquisition when mobile while walking at 73% of their pre-ferred walking speed. The proposed feedback design is ex-amined in detail and the effects of variable target widths are quantified. Deictic interaction with a spatial audio display is found to be a feasible solution for future interface designs.

REFERENCES

• 1: Akamatsu, M., MacKenzie, S. I., and Hasbrouc, T., A Comparison of Tactile, Auditory and Visual Feedback in a Pointing Task using a Mouse-Type device. Ergo-nomics, 1995. 38: p. 816--827.
• 2: Blauert, J., Spatial Hearing: The psychophysics of hu-man sound localization. 1999: The MIT Press.
• 3: Stephen Brewster , Joanna Lumsden , Marek Bell , Malcolm Hall , Stuart Tasker, Multimodal 'eyes-free' interaction techniques for wearable devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642694]
• 4: Michael Cohen, Throwing, pitching and catching sound: audio windowing models and modes, International Journal of Man-Machine Studies, v.39 n.2, p.269-304, Aug. 1993 [doi>10.1006/imms.1993.1062]
• 5: Michael Cohen , Lester F. Ludwig, Multidimensional audio window management, International Journal of Man-Machine Studies, v.34 n.3, p.319-336, March 1991 [doi>10.1016/0020-7373(91)90023-Z]
• 6: Naomi Friedlander , Kevin Schlueter , Marilyn Mantei, Bullseye! when Fitts' law doesn't fit, Proceedings of the SIGCHI conference on Human factors in computing systems, p.257-264, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274681]
• 7: Stuart Goose , Carsten Möller, A 3D audio only interactive Web browser: using spatialization to convey hypermedia document structure, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.363-371, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319649]
• 8: Jagacinski, R. J. and Monk, D. L., Fitts' law in two di-mensions with hand and head movements. Journal of Motor Behavior, 1985. 17: p. 77--95.
• 9: Minoru Kobayashi , Chris Schmandt, Dynamic Soundscape: mapping time to space for audio browsing, Proceedings of the SIGCHI conference on Human factors in computing systems, p.194-201, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258702]
• 10: Kondraske, G. An angular motion Fitts' Law for human performance modelling and prediction. in 16th Annual Conference on Engineering in Medical and Biology Society, 1994. p. 307--308.
• 11: I. Scott MacKenzie , William Buxton, Extending Fitts' law to two-dimensional tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.219-226, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142794]
• 12: I. Scott MacKenzie , Tatu Kauppinen , Miika Silfverberg, Accuracy measures for evaluating computer pointing devices, Proceedings of the SIGCHI conference on Human factors in computing systems, p.9-16, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365028]
• 13: I. Scott MacKenzie , Abigail Sellen , William A. S. Buxton, A comparison of input devices in element pointing and dragging tasks, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.161-166, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108868]
• 14: Georgios N. Marentakis , Stephen A. Brewster, Effects of reproduction equipment on interaction with a spatial audio interface, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056982]
• 15: Marentakis, G. and Brewster, S, A study on gesture interaction with a 3D Audio Display. in Mobile HCI, 2004. Glasgow, UK. p. 55--62.
• 16: Georgios Marentakis , Stephen A. Brewster, A comparison of feedback cues for enhancing pointing efficiency in interaction with spatial audio displays, Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, September 19-22, 2005, Salzburg, Austria [doi>10.1145/1085777.1085787]
• 17: Meyer, E.., Abrams, A., Kornblum, S., Wright, E., and Smith, J., Optimality in Human Motor Performance: Ideal Control of Rapid Aimed Movements. Psychologi-cal Review, 1988. 95(3): p. 340--370.
• 18: Antti Pirhonen , Stephen Brewster , Christopher Holguin, Gestural and audio metaphors as a means of control for mobile devices, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503428]
• 19: Anthony Savidis , Constantine Stephanidis , Andreas Korte , Kai Crispien , Klaus Fellbaum, A generic direct-manipulation 3D-auditory environment for hierarchical navigation in non-visual interaction, Proceedings of the second annual ACM conference on Assistive technologies, p.117-123, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228366]
• 20: Nitin Sawhney , Chris Schmandt, Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.3, p.353-383, Sept. 2000 [doi>10.1145/355324.355327]
• 21: Wenzel, E., Marianne, A., Kistler, D., and Wightman, L. F., Localization using non-individualized head-related transfer functions, Journal of the Acoustical So-ciety of America, 1993. 94(1): p. 111--123.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
3D audio, Fitts' Law, gestures, mobile interaction, spatial audio target acquisition