Reflections on sonic browsing: Comments on Fernström and McNamara, ICAD 1998

ABSTRACT

In the original Fernström and McNamara paper at ICAD 1998, we described our work on a novel user interface for sonic browsing of music collections. In this commentary, we reflect upon the continued research in this area and how our interactive sonification approach has come to be used also for browsing collections of everyday sounds and for perception experiments.

REFERENCES

• 1: Liam J. Bannon, The pioneering work of Douglas C. Engelbart (1987), Perspectives on the computer revolution, Ablex Publishing Corp., Norwood, NJ, 1989
• 2: Brazil, E. and Fernström, M. 2003. Where's that sound? Exploring arbitrary user classifications of sounds for audio collection management. In Proceedings of the International Conference on Auditory Display (ICAD1993). Boston, MA.
• 3: Brazil, E., Fernström, M., and Ottaviani, L. 2003. A new experimental technique for gathering similarity ratings for sounds. In Proceedings of the International Conference on Auditory Display (ICAD1993). Boston, MA.
• 4: Brewster, S. A. 1994. Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interfaces. Unpublished Ph.D. thesis, University of York, Heslington, York.
• 5: Stephen A. Brewster, Navigating Telephone-Based Interfaces with Earcons, Proceedings of HCI on People and Computers XII, p.39-56, January 1997
• 6: Stephen A. Brewster, Sound in the interface to a mobile computer, Proceedings of the HCI International '99 (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Communication, Cooperation, and Application Design-Volume 2, p.43-47, August 22-26, 1999
• 7: Stephen Brewster, Nonspeech auditory output, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
• 8: Stephen Brewster, Overcoming the Lack of Screen Space on Mobile Computers, Personal and Ubiquitous Computing, v.6 n.3, p.188-205, May 2002 [doi>10.1007/s007790200019]
• 9: Brewster, S. A., Wright, P. C., Dix, A. J., et al. 1995. The sonic enhancement of graphical buttons. In Proceedings of Interact'95. Lillehammer, Norway.
• 10: Stephen A. Brewster , Peter C. Wright , Alistair D. N. Edwards, The design and evaluation of an auditory-enhanced scrollbar, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.173-179, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191733]
• 11: Brewster, S. A., Wright, P. C., and Edwards, A. D. N. 1994b. A Detailed Investigation into the Effectiveness of Earcons. In G. Kramer, Ed. Auditory Display: Sonification, Audification and Auditory Interfaces. Addison-Wesley, Reading, MA. 471--498.
• 12: Mikael Fernström , Liam J. Bannon, Explorations in Sonic Browsing, Proceedings of HCI on People and Computers XII, p.117-131, January 1997
• 13: Fernström, J. M. and Bannon, L. J. 1997b. Multimedia browsing. Atlanta. In Proceedings of ACM CHI'97. Atlanta, GA.
• 14: Fernström, J. M. and McNamara, C. 1998. After direct manipulation---direct sonification. In Proceedings of the International Conference on Auditory Display (ICAD1998 ). Glasgow, Scotland.
• 15: Fernström, M. and Brazil, E. 2001. Sonic browsing: An auditory tool for multimedia asset management. In Proceedings of the International Conference on Auditory Display (ICAD2001). Helsinki, Finland.
• 16: Mikael Fernstrom , Eoin Brazil , Liam Bannon, HCI Design and Interactive Sonification for Fingers and Ears, IEEE MultiMedia, v.12 n.2, p.36-44, April 2005 [doi>10.1109/MMUL.2005.27]
• 17: Gaver, W. W. 1989. The sonic finder: An interface that uses auditory icons. The use of non-speech audio at the interface. In Proceedings of ACM CHI '89. Austin, TX.
• 18: Gaver, W. W. 1993a. How do we hear in the world? Explorations of ecological acoustics. Ecological Psychology 5, 4, 285--313.
• 19: Gaver, W. W. 1993b. What in the world do we hear? An ecological approach to auditory source perception. Ecological Psychology 5, 1, 1--29.
• 20: Gaver, W. W. 1994. Using and creating auditory icons. In Auditory Display: Sonification, Audification and Auditory Interfaces. G. Kramer, Ed. Addison-Wesley, Reading, MA, 417--446.
• 21: Gregory Kramer, Auditory Display: Sonification, Audification and Auditory Interfaces, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2000
• 22: Ottaviani, L. and Fernström, M. 2003. Investigations with the sonic browser on two of the perceptual auditory dimensions of sound objects: Elasticity and force. In Proceedings of Digital Audio Effects DAFx-03. London, UK.
• 23: Davide Rocchesso , Roberto Bresin , Mikael Fernström, Sounding Objects, IEEE MultiMedia, v.10 n.2, p.42-52, March 2003 [doi>10.1109/MMUL.2003.1195160]
• 24: Somers, E. 2000. Abstract sound objects to expand the vocabulary of sound design for visual and theatrical media. In Proceedings of the International Conference on Auditory Display (ICAD2000). Georgia Institute of Technology, Atlanta, GA.

INDEX TERMS

General Terms:
Experimentation, Human Factors, Performance

Keywords:
Sonification, auditory display