Ambient music experience in real and virtual worlds using audio similarity

ABSTRACT

Sound and, specifically, music is a medium that is used for a wide range of purposes in different situations in very different ways. Ways for music selection and consumption may range from completely passive, almost unnoticed perception of background sound environments to the very specific selection of a particular recording of a piece of music with a specific orchestra and conductor on a certain event. Different systems and interfaces exist for the broad range of needs in music consumption. Locating a particular recording is well supported by traditional search interfaces via metadata. Other interfaces support the creation of playlists via artist or album selection, up to more artistic installation of sound environments that users can navigate through. In this paper we will present a set of systems that support the creation of as well as the navigation in musical spaces, both in the real world as well as in virtual environments. We show some common principles and point out further directions for a more direct coupling of the various spaces and interaction methods.

REFERENCES

• 1: D. Baum and A. Rauber. Emotional descriptors for map-based access to music libraries. In Proceedings of the 9th International Conference on Asian Digital Libraries Kyoto, Japan, November 27-30 2006.
• 2: J. S. Downie. Annual Review of Information Science and Technology volume 37, chapter Music information retrieval, pages 295--340. Information Today, Medford, NJ, USA, 2003.
• 3: R. Genswaider, H. Berger, M. Dittenbach, A. Pesenhofer, D. Merkl, A. Rauber, and T. Lidy. Computational Intelligence in Multimedia Processing: Recent Advances volume96of Studies in Computational Intelligence chapter A Synthetic 3D Multimedia Environment, pages 79--98. Springer Berlin /Heidelberg, April 23 2008.
• 4: Asif Ghias , Jonathan Logan , David Chamberlin , Brian C. Smith, Query by humming: musical information retrieval in an audio database, Proceedings of the third ACM international conference on Multimedia, p.231-236, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215273]
• 5: Peter Knees , Markus Schedl , Tim Pohle , Gerhard Widmer, An innovative three-dimensional user interface for exploring music collections enriched, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180652]
• 6: T. Kohonen , M. R. Schroeder , T. S. Huang, Self-Organizing Maps, Springer-Verlag New York, Inc., Secaucus, NJ, 2001
• 7: T. Lidy and A. Rauber. Evaluation of feature extractors and psycho-acoustic transformations for music genre classification. In Proceedings of the International Conference on Music Information Retrieval (ISMIR pages 34--41, London, UK, September 11-15 2005.
• 8: T. Lidy and A. Rauber. Machine Learning Techniques for Multimedia chapter Classification and Clustering of Music for Novel Music Access Applications, pages 249--285. Cognitive Technologies. Springer, Berlin Heidelberg, February 2008.
• 9: D. Lübbers. SoniXplorer: Combining visualization and auralization for content-based exploration of music collections. In Proceedings of the 6th International Conference on Music Information Retrieval (ISMIR 2005)pages 590--593, 2005.
• 10: R. Mayer, T. Lidy, and A. Rauber. The map of mozart. In Proceedings of the International Conference on Music Information Retrieval (ISMIR)Victoria, Canada, October 8-12 2006.
• 11: Rodger J. McNab , Lloyd A. Smith , Ian H. Witten , Clare L. Henderson , Sally Jo Cunningham, Towards the digital music library: tune retrieval from acoustic input, Proceedings of the first ACM international conference on Digital libraries, p.11-18, March 20-23, 1996, Bethesda, Maryland, United States [doi>10.1145/226931.226934]
• 12: R. Neumayer, M. Dittenbach, and A. Rauber. PlaySOM and PocketSOMPlayer-alternative interfaces to large music collections. In Proceedings of the International Conference on Music Information Retrieval (ISMIR)pages 618--623, London, UK, September 11-15 2005.
• 13: Robert Neumayer , Jakob Frank , Peter Hlavac , Thomas Lidy , Andreas Rauber, Bringing Mobile Map-Based Access to Digital Audio to the End User, Proceedings of the 14th International Conference of Image Analysis and Processing - Workshops, p.9-14, September 10-13, 2007 [doi>10.1109/ICIAPW.2007.14]
• 14: Nicola Orio, Music retrieval: a tutorial and review, Foundations and Trends in Information Retrieval, v.1 n.1, p.1-96, January 2006 [doi>10.1561/1500000002]
• 15: Andreas Rauber , Markus Frühwirth, Automatically Analyzing and Organizing Music Archives, Proceedings of the 5th European Conference on Research and Advanced Technology for Digital Libraries, p.402-414, September 04-09, 2001
• 16: A. Rauber, E. Pampalk, and D. Merkl. Using psycho-acoustic models and self-organizing maps to create a hierarchical structuring of music by musical styles. In Proceedings of the International Conference on Music Information Retrieval (ISMIR) pages 71--80, Paris, France, October 13-17 2002.
• 17: M. Torrens, P. Hertzog, and J.-L. Arcos. Visualizing and exploring personal music libraries. In Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR 2004)2004.
• 18: G. Tzanetakis and P. Cook. Marsyas3D: A prototype audio browser-editor using a large scale immersive visual and audio display. In Proceedings of the International Conference on Auditory Display 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing
          Subjects: Systems

General Terms:
Design, Human Factors

Keywords:
mobile music selection, music similarity, music spaces, user interaction, virtual world