Extending the Notion of a Window System to Audio

ABSTRACT

With audio's increasing importance in computer applications, users will soon need presentation, management and organizational capabilities similar to visual window systems to avoid a confusing cacophony of multiple audio sources sounding at once. The ways in which an audio window system could be used are described. These include multimedia documents, spatial data management systems, and teleconferencing. The signal processing methods used to create hierarchical and spatial distribution among nearly arbitrary (not pure sine wave) audio sources are discussed. A prototype system, combining hierarchical and spatial processing functions with a computer-controlled switch, software and human input devices, is presented. Two envisioned implementations, a terminal-based system and a network-based server, are described. Preliminary work suggests that an effective audio window system needs much less complexity and fewer levels of digital signal processing precision than the current prototype.

REFERENCES

• 1: 1. "Multimedia Stirs a Revolution in Corporate US: Apple, IBM, Others Rush into New Market," <i>PC Week</i>, Vol. 6, No. 35. Sept. 4, 1989, p. 109.
• 2: 2. B. Arons et al., "The Vox Audio Server," <i>Multimedia 89</i>, IEEE.
• 3: 3. W. Slawson, <i>Sound Color</i>, University of California Press, Berkeley, 1985.
• 4: 4. J. Blauert, <i>Spatial Hearing</i>, MIT Press, Cambridge Mass., 1983.
• 5: 5. G. Kendall and W. Martens, "Simulating the Cues of Spatial Hearing in Natural Environments," <i>Proc. 1984 Int'l Computer Music Conf.</i>, Paris, pp. 111-125.
• 6: 6. R.A. Bolt, <i>The Human Interface</i>, Van Nostrand Reinhold, New York, 1984.
• 7: Irene Greif, Computer-supported cooperative work: a book of readings, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1988
• 8: L. F. Ludwig , D. F. Dunn, Laboratory for emulation and study of integrated and coordinated media communication, Proceedings of the ACM workshop on Frontiers in computer communications technology, p.283-291, August 11-13, 1987, Stowe, Vermont, United States
• 9: 9. L. Pate and R. Lake, "A Network Environment for Studying Multimedia Network Architecture and Control," <i>Proc. Globecom 89</i>, IEEE, pp. 1,232-1,236.
• 10: 10. L. Ludwig and N. Pincever, "Audio Windowing Realization," tech. report, to be submitted to <i>IEEE Acoustics, Speech, and Signal Processing</i> (contact Ludwig at the address below).
• 11: 11. E. Wenzel, F. Wightman, and S. Foster, "A Virtual Display System for Conveying Three-Dimensional Acoustic Information," <i>32nd Human Factors Soc. Proc.</i>, 1988, pp. 86-90.
• 12: Michael Cohen , Lester F. Ludwig, Multidimensional audio window management, International Journal of Man-Machine Studies, v.34 n.3, p.319-336, March 1991 [doi>10.1016/0020-7373(91)90023-Z]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Windowing systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output

General Terms:
Languages, Theory