Sonic mapping: towards engaging the user in the design of sound for computerized artifacts

ABSTRACT

This paper argues for new approaches to the design of sound for contemporary interactive technologies. We begin by presenting what we feel to be the key challenges as yet unaddressed by conventional auditory display research. Subsequently, we propose a user-centered, acoustic ecology-informed, design method that we feel can be built upon to inform the design of sound for contemporary interactive technologies, thus tackling some of the challenges introduced. Our approach consists of three stages: firstly, encouraging designers and users to experience the original auditory environment, identifying the key sounds within that environment, and then summarizing this information into an 'earwitness account' that can be used as a prelude for informing the design of sonically enhanced technologies that may be used within similar environments. By trialing this method with undergraduate interactive media design students, we identify the methodological challenges involved in attempting to engage people, who are not necessarily 'sound professionals', with their existing auditory environments. We highlight the opportunities that arise and pitfalls that should be avoided when attempting to introduce such approaches within real-world design studies.

REFERENCES

• 1: Petter Alexanderson , Konrad Tollmar, Being and mixing: designing interactive soundscapes, Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, p.252-261, October 14-18, 2006, Oslo, Norway [doi>10.1145/1182475.1182502]
• 2: Stephen Barrass , Phil Robertson, Auditory information design, The Australian National University (Australia), 1998
• 3: Benyon, D. R. 2001. The New HCI? Navigation of Information Space. Knowledge-based Systems, vol. 14(8), pp. 425--430.
• 4: Berendt, J. E. 1988. The Third Ear. Longmead: Element Books Ltd.
• 5: Bussemakers, M. P. and de Haan, A. 2000. When it Sounds like a Duck and it Looks like a Dog -- Auditory Icons vs. Earcons in Multimedia Environments. In Proceedings of ICAD 2000 (Atlanta, Georgia, 2--5 April 2000), ICAD, pp. 184--189.
• 6: Brewster, S. 1994. Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interface. Doctoral Thesis, University of York, UK.
• 7: Delage, B. 1998. On Sound Design. Presented at "Stockholm, Hey Listen!" (Stockholm, Sweden, 9--13 June 1998).
• 8: Droumeva, M. 2005. Understanding Immersive Audio: A Historical and Socio-Cultural Exploration of Auditory Displays. In Proceedings of ICAD 2005 (Limerick, Ireland, 6--9 July, 2005), ICAD, pp. 162--168,
• 9: William W. Gaver, Auditory icons: using sound in computer interfaces, Human-Computer Interaction, v.2 n.2, p.167-177, June 1986 [doi>10.1207/s15327051hci0202_3]
• 10: Gaver, W. W. 1993. How Do We Hear in the World? Explorations in Ecological Acoustics. Ecological Psychology, vol. 5(4), pp. 285--313.
• 11: Hug, D. 2008. Towards a Hermeneutics and Typology of Sound for Interactive Commodities. In Proceedings of the Sonic Interaction Design: Sound Information and Experience Workshop held at CHI 2008 (Florence, Italy, 6 April 2008).
• 12: Jordan, P. W. 2000. Designing Pleasurable Products: An Introduction to the New Human Factors. London: Taylor & Francis.
• 13: Jordan, P. W. and Engelen, H. 1998. Sound Design for Consumer Products. In Proceedings of "Stockholm, Hey Listen!" (Stockholm, Sweden, 9--13 June 1998), Stockholm: The Royal Swedish Academy for Music, pp. 88--92.
• 14: Kildal, J. and Brewster, S. A. 2006. Exploratory Strategies and Procedures to Obtain Non-Visual Overviews using TableVis. In Proceedings of the International Conference on Disability, Virtual Reality and Associated Technology (Esbjerg, Denmark, 18--20 September, 2006), ICDVRAT/University of Reading.
• 15: Kramer, G. 1994. Some Organizing Principles for Representing Data with Sound. In Auditory Display: Sonification, Audification and Auditory Interfaces (Ed: G. Kramer). Reading, Massachusetts: Addison-Wesley, pp. 185--221.
• 16: Macaulay, C. and Crerar, A. 1998. "Observing" the Workplace Soundscape: Ethnography and Auditory Interface Design. In Proceedings of ICAD 1998 (Glasgow, UK, 1--4 November, 1998), ICAD.
• 17: Macaulay, C., Benyon, D. and Crerar, A. 1998. Voices in the Forest: Sounds, Soundscapes and Interface Design. In: Exploring Navigation: Towards a Framework for the Design and Evaluation of Electronic Spaces, SICS Technical Report T98:01 (Ed: Dahlbäck, N). Stockholm: SICS.
• 18: McGregor, I., Crerar A., Benyon, D. and Léplâtre, G. 2006. Worplace Soundscape Mapping: A Trial of Macaulay and Crerar's Method. In Proceedings of ICAD 2006 (London, UK, 20--23 June 2006), ICAD, pp. 285--288.
• 19: McGregor, I., Crerar, A., Benyon, D. and Macaulay, C. 2002. Soundfields and Soundscapes: Reifying Auditory Communities. In Proceedings of ICAD 2002 (Kyoto, Japan, 2--5 July, 2002), ICAD, pp. 290--294.
• 20: Nesbitt, K. V. and Barrass, S. 2002. Evaluation of a Multimodal Sonification and Visualisation of Depth of Market Stock Data. In Proceedings of ICAD 2002 (Kyoto, Japan, 2--5 July, 2002), ICAD, pp. 233--238.
• 21: Palladino, D. K. and Walker, B. N. 2007. Learning Rates for Auditory Menus Enhanced With Spearcons versus Earcons. In Proceedings of ICAD 2007 (Montreal, Canada, 26--29 June, 2007), ICAD, pp. 274--279.
• 22: Pauletto, S. and Hunt, A. 2006. The Sonification of EMG Data. In Proceedings of ICAD 2006 (London, UK, 20--23 June, 2006), ICAD, pp. 152--157.
• 23: Scaletti, C. 1994. Sound Synthesis Algorithms for Auditory Data Representations. In Auditory Display: Sonification, Audification and Auditory Interfaces (Ed: G. Kramer). Reading, Massachusetts: Addison-Wesley, pp. 223--251.
• 24: Schafer, R. M. 1977. The Soundscape: Our Sonic Environment and the Tuning of the World. Rochester, Vermont, USA: Destiny Books.
• 25: Schafer, R. M. 2005. I Have Never Seen a Sound. Environmental & Architectural Phenomenology Newsletter. Available from: http://www.arch.ksu.edu/seamon/Schafer06.htm (accessed 22 May 2005).
• 26: Stockman, T., Hind, G. and Frauenberger, C. 2005. Interactive Sonification of Spreadsheets. In Proceedings of ICAD 2005 (Limerick, Ireland, 6--9 July, 2005), ICAD, pp. 134--139.
• 27: Truax, B. 2001. Acoustic Communication. 2^nd Edition. Westport, CT, USA: Ablex Publishing.
• 28: Vickers, P. and Alty, J. L. 2002. When Bugs Sing. Interacting with Computers, vol. 14(6), pp. 793--819.
• 29: Wright, P. and McCarthy, J. 2005. The Value of the Novel in Designing for Experience. In Future Interaction Design (Eds: A. Pirhonen, P. Saariluoma, H. Isomäki, and C. Roast). London: Springer-Verlag, pp. 9--30.
• 30: Wrightson, K. 2000. An Introduction to Acoustic Ecology. Soundscape: The Journal of Acoustic Ecology, vol. 1, pp. 10--13.
• 31: Özcan, E. and van Egmond, R. 2005. Characterizing Descriptions of Product Sounds. In Proceedings of ICAD 2005 (Limerick, Ireland, 6--9 July, 2005), ICAD, pp. 55--60.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Auditory (non-speech) feedback

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design; Theory and methods

General Terms:
Design, Theory

Keywords:
acoustic ecology, auditory environments, auditory interfaces, non-speech sound, soundscapes, user-centered design methods