Musicsim: integrating audio analysis and user feedback in an interactive music browsing ui

ABSTRACT

In music information retrieval (MIR), there are two main research directions, which are based either on a folder hierarchy and metadata, or on the actual acoustic content. We believe that both content-based and hierarchy-based retrieval have their respective strengths for browsing and organizing music collections, and that the integration of content analysis techniques in metadata-based media UIs can lead to more powerful UIs. In this paper we present a prototype, in which audio analysis techniques and user feedback are integrated into an interactive UI for browsing and organizing large music collections. We also provide visual assistance to support non-visual perception of music. We discussed our system with test users and received encouragement as well as valuable suggestions for future re-search.

REFERENCES

• 1: Kim, J.Y. and Belkin, N. Categories of Music Description and Search Terms and Phrases Used by Non-Music Experts. Proc. of the 3rd International Conference on Music Information Retrieval (Paris, France, 2002). ISMIR '02.
• 2: Vignoli F. Digital Music Interaction concepts: a user study. Proc. of the 5 th International Conference on Music Information Retrieval (Barcelona, Spain, 2004). ISMIR '04.
• 3: Frank Bentley , Crysta Metcalf , Gunnar Harboe, Personal vs. commercial content: the similarities between consumer use of photos and music, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124871]
• 4: Brown, B., Geelhoed, E. and Sellen, A. The Use of Conventional and New Music Media: Implications for Future Technologies. 8th IFIP TC.13 conference on Human-Computer Interaction (Tokyo, Japan, 2001). INTERACT '01.
• 5: Sally Jo Cunningham , Nina Reeves , Matthew Britland, An ethnographic study of music information seeking: implications for the design of a music digital library, Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries, May 27-31, 2003, Houston, Texas
• 6: Downie, J. S., and Cunningham, S.J. Toward a Theory of Music Information Retrieval Queries: System Design Implications. Proc. of the 3rd International Conference on Music Information Retrieval (Paris, France, 2002). ISMIR '02.
• 7: Pampalk, E. Islands of Music: Analysis, Organization, and Visualization of Music Archives. Journal of the Austrian Soc. for Artificial Intelligence, 2003.
• 8: Peter Knees , Markus Schedl , Tim Pohle , Gerhard Widmer, An innovative three-dimensional user interface for exploring music collections enriched, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180652]
• 9: Gulik, R van, Vignoli, F. Visual Playlist Generation on the Artist Map. Proc. of the 6th International Conference on Music Information Retrieval (London, UK, 2002). ISMIR '05.
• 10: Torrens, M., Hertzog, P., Arcos JL. Visualizing and exploring personal music libraries. Proc. of the 5th International Conference on Music Information Retrieval (Barcelona, Spain, 2004). ISMIR '04.
• 11: Goto, M., Goto, T. Musicream: New Music Playback Interface for Streaming, Sticking, Sorting, and Recalling Musical Pieces. Proc. of the 6th International Conference on Music Information Retrieval (London, UK, 2002). ISMIR '05.
• 12: Hilliges, O., Holzer, P., Kluber, R., Butz, A. AudioRadar: A metaphorical visualization for the navigation of large music collections. Proc. of the International Symposium on Smart Graphics (Vancouver, Canada, 2006).
• 13: Prefuse, interactive information sisualization toolkit: http://www.prefuse.org/.
• 14: jAudio: Towards a standardized extensible audio music feature extraction. System,Course Paper. http://www.music.mcgill.ca/~cmckay/papers/musictech/jAudio.pdf, McGill University, Canada.
• 15: Tapas Kanungo , David M. Mount , Nathan S. Netanyahu , Christine Piatko , Ruth Silverman , Angela Y. Wu, The analysis of a simple k-means clustering algorithm, Proceedings of the sixteenth annual symposium on Computational geometry, p.100-109, June 12-14, 2000, Clear Water Bay, Kowloon, Hong Kong [doi>10.1145/336154.336189]
• 16: Elias Pampalk , Andreas Rauber , Dieter Merkl, Content-based organization and visualization of music archives, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641121]
• 17: Cunningham SJ, Bainbridge D., Falconer A. 'More of an Art than a Science': Supporting the Creation of Playlists and Mixes. Proc. of the 7th International Conference on Music Information Retrieval (Victoria, Canada, 2006). ISMIR '06.
• 18: Pauws S. PATS: Realization and user evaluation of an automatic playlist generator. Proc. of the 3rd International Conference on Music Information Retrieval (Paris, France, 2002). ISMIR '02.
• 19: Phole T., Pampalk, E., Widmer G. Generating Similarity-based Playlists Using Traveling Salesman Algorithms. Proc. of the 7th International Conference on Digital Audio Effects ( Madrid, Spain, 2005). DAFx '05.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Experimentation, Human Factors, Performance

Keywords:
audio analysis, music browser, music information retrieval, playlist generation, user feedback