Synthesizing auditory icons

ABSTRACT

Auditory icons add valuable functionality to computer interfaces, particularly when they are parameterized to convey dimensional information. They are difficult to create and manipulate, however, because they usually rely on digital sampling techniques. This paper suggests that new synthesis algorithms, controlled along dimensions of events rather than those of the sounds themselves, may solve this problem. Several algorithms, developed from research on auditory event perception, are described in enough detail here to permit their implementation. They produce a variety of impact, bouncing, breaking, scraping, and machine sounds. By controlling them with attributes of relevant computer events, a wide range of parameterized auditory icons may be created.

REFERENCES

• 1: Blattner, M., Sumikawa, D., & Greenberg, R. Earcons and icons: Their structure and common design principles. Human-Computer Interaction, 4 (1989).
• 2: Chowning, J. The synthesis of complex audio spectra by means of frequency modulation. Journal of the Audio Engineering Society, 21 (1973): 526-534.
• 3: Charles Dodge , Thomas A. Jerse, Computer Music: Synthesis, Composition, and Performance, Macmillan Library Reference, 1985
• 4: Stephen W. Draper , Kevin W. Waite , Philip D. Gray, Alternative bases for comprehensibility and competition for expression in an icon generation tool, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.473-477, August 27-31, 1990
• 5: Freed, D. Auditory correlates of perceived mallet hardness for a set of recorded percussive sound events. Journal of the Acoustical Society of America, 87 (1990): 311-322.
• 6: William W. Gaver , Donald A. Norman, Everyday listening and auditory icons, 1988
• 7: Gaver, W. The SonicFinder: An interface that uses auditory icons. Human-Computer Interaction, 4 (1989): 67-94.
• 8: Gaver, W. What in the world do we hear? An ecological approach to auditory source perception. Ecological Psychology, 5 (1993): 1-29.
• 9: William W. Gaver , Randall B. Smith , Tim O'Shea, Effective sounds in complex systems: the ARKOLA simulation, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.85-90, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108857]
• 10: Lamb, H. The dynamical theory of sound. 2nd ed. New York, Dover, 1960.
• 11: Risset, J., & Wessel, D. Exploration of timbre by analysis and synthesis. In D. Deutsch (Ed.), The psychology of music. New York: Academic Press, 1982.
• 12: Smith, R. A prototype futuristic technology for distance education. Proceedings of the NATO Advanced Workshop on New Directions in Educational Technology. (Nov. 10- 13, 1988, Cranfield, UK.)
• 13: Warren, W. & Verbrugge, R. Auditory perception of breaking and bouncing events: A case study in ecological acoustics. Journal of Experimental Psychology: Human Perception and Performance, 10 (1984): 704- 712.
• 14: Wildes, R., & Richards, W. Recovering material properties from sound. Richards, W. (ed.), Natural computation. Cambridge, MA: MIT Press, 1988.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output; Artificial, augmented, and virtual realities

General Terms:
Algorithms, Design

Keywords:
auditory interfaces, interface techniques, multimedia, sound