Mixage mobile

ABSTRACT

This paper takes two examples of Audio Augmented Realities and Wave Field Synthesis to show evidence of some evolution in the task of a sound engineer: his task which is commonly known to be static becomes necessarily mobile in these particular contexts.We first comment and describe these new tasks and show evidence of the needs for evolution of the corresponding tools : we show why these mixing situations can not be properly handled without an appropriate design tool that allows controlling the virtual scene while walking through the rendering space.We then present our proposition for such a context through two software prototypes : first, the "Listen-Space" application, an authoring tool specially designed for the particular case of audio augmented realities and that allows performing mobile control of spatialization when run on a wireless ultra-portable tablet PC. Second, we describe the "L-Scanner", a "see-through" interface implementation dedicated to the control of sound spatialization.We finally discuss applications of our system such as collaborative mixing, thanks to a distributed software architecture as well as the split between the graphic user control interface and the DSP audio rendering engine: in this context, each participant can work on a shared virtual sound scene while adapting its representation at its personal taste and needs.

REFERENCES

• 1: [1] Boone, Marius M. Acoustic rendering with wave field synthesis . ACM Siggraph and eurographics campfire: Acoustic Rendering for Virtual Environments, Snowbird, Utah, May 26-29, 2001.
• 2: [2] Corteel, Etienne, Roux, Sebastien, Warusfel, Olivier, Creation of Virtual Sound Scenes Using Wave Field Synthesis , in Tonmeistertagung. Hannovre, November 2002.
• 3: [3] Delerue, Olivier, A Mixed Physical and Perceptual approach to control spatialization in audio augmented realities . Proc. 6th Int. Conference on Digital Audio Effects (DAFX03), London, 2003.
• 4: [4] Delerue, Olivier and Warusfel, Olivier. Authoring virtual sound scenes in the context of the LISTEN project. Proc. Of the 22nd Audio Engineering Society Conference (AES 22), Espoo, Finland, June 2002.
• 5: [5] De Vries, D. and Boone, Marius M., Wave Field Synthesis and analysis using array technology, Proc. 1999 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, New York, Oct 17-20, 1999.
• 6: Immersive Audio-Augmented Environments: The LISTEN Project, Proceedings of the Fifth International Conference on Information Visualisation, p.571, July 25-27, 2001
• 7: [7] Eckel, G., Immersive Audio-Augmented Environments, in Proceedings of the 8th Biennial Symposium on Arts and Technology at Connecticut College, New London, CT, USA, 2001.
• 8: George W. Fitzmaurice , Shumin Zhai , Mark H. Chignell, Virtual reality for palmtop computers, ACM Transactions on Information Systems (TOIS), v.11 n.3, p.197-218, July 1993 [doi>10.1145/159161.159160]
• 9: [9] ISO/IEC 14496-1. MPEG-4 Standard, Amendment 1. Information Technology - Coding of audiovisual objects 2000, Part 1 (Systems).
• 10: Jean-Marc Jot, Real-time spatial processing of sounds for music, multimedia and interactive human-computer interfaces, Multimedia Systems, v.7 n.1, p.55-69, Jan. 1999 [doi>10.1007/s005300050111]
• 11: [11] Jullien, J.P., Structured model for the representation and the control of room acoustical quality, in Proceedings of the 15th International Conference on Acoustics, 1995, pp517-520.
• 12: Robert W. Lindeman , John L. Sibert , James K. Hahn, Hand-Held Windows: Towards Effective 2D Interaction in Immersive Virtual Environments, Proceedings of the IEEE Virtual Reality, p.205, March 13-17, 1999
• 13: François Pachet , Olivier Delerue, MidiSpace: a temporal constraint-based music spatializer, Proceedings of the sixth ACM international conference on Multimedia, p.351-359, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290801]
• 14: [14] Pottier, Laurent, Holophon : projet de spatialization multi sources pour une diffusion multi-haut-parleurs, Actes des Journées d'Informatique Musicale, JIM 2000, Bordeaux, pp 96-102.
• 15: Michael Tsang , George W. Fitzmaurice , Gordon Kurtenbach , Azam Khan , Bill Buxton, Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572001]
• 16: [16] Todoroff Todor, Traube Caroline, Ledent Jean-Marc, NeXTSTEP Graphical Interfaces to Control Sound Processing and Spatialization instruments. in Actes de l' International Computer Music Conference (ICMC), Thessaloniki, Grèce, pp.325-328, 1997.
• 17: [17] Walsh, A. E. and Bourges-Sevenier, M. (eds), MPEG-4 Jump Start, Prentice-Hall 2001. ISBN-0130600369.
• 18: [18] Wright, M., and A. Freed. 1997. OpenSound Control: A New Protocol for Communicating with Sound Synthesizers . Proceedings of the 1997 International Computer Music Conference. San Francisco: International Computer Music Association, pp. 101-104

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)
      H.5.5 Sound and Music Computing
          Subjects: Modeling

General Terms:
Design, Theory

Keywords:
audio augmented realities, audio mixing, mobile devices, spatialization