The effectiveness study of various music information retrieval approaches

ABSTRACT

In this paper, we describe the Ultima project which aims to construct a platform for evaluating various approaches of music information retrieval. Two kinds of approaches are adopted in this project. These approaches differ in various aspects, such as representations of music objects, index structures, and approximate query processing strategies. For a fair comparison, we propose a measurement of the retrieval effectiveness by recall-precision curves with a scaling factor adjustment. Finally, the performance study of the retrieval effectiveness based on various factors of these approaches is presented.

REFERENCES

• 1: Steven Blackburn , David DeRoure, A tool for content based navigation of music, Proceedings of the sixth ACM international conference on Multimedia, p.361-368, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290802]
• 2: Chen, A. L. P., Chang, M., Chen, J., Hsu, J. L., Hsu, C. H. and Hua, S. Y. S. (2000). Query by music segments: An efficient approach for song retrieval. In Proceedings of IEEE International Conference on Multimedia and Expo. New York.
• 3: J. C. C. Chen , A. L. P. Chen, Query by Rhythm: An Approach for Song Retrieval in Music Databases, Proceedings of the Workshop on Research Issues in Database Engineering, p.139, February 23-24, 1998
• 4: T.-C. Chou , A. L. P. Chen , C.-C. Liu, Music Databases: Indexing Techniques and Implementation, Proceedings of the 1996 International Workshop on Multi-Media Database Management Systems (IW-MMDBMS '96), p.46, August 14-16, 1996
• 5: Clausen, M., Engelbrecht, R., Mayer, D. and Smith, J. (2000). PROMS: A web-based tool for searching in polyphonic music. In Proceedings of ISMIR.
• 6: David C. De Roure , Steven G. Blackburn, Content-based navigation of music using melodic pitch contours, Multimedia Systems, v.8 n.3, p.190-200, October 2000 [doi>10.1007/s005300000044]
• 7: Downie, S. (2000). Thinking about formal MIR system evaluation: Some prompting thoughts. Available at http://www.lis.uiuc.edu~jdownie/mir_papers/downie_mir_eval.html.
• 8: Stephen Downie , Michael Nelson, Evaluation of a simple and effective music information retrieval method, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.73-80, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345551]
• 9: William B. Frakes , Ricardo Baeza-Yates, Information retrieval: data structures and algorithms, Prentice-Hall, Inc., Upper Saddle River, NJ, 1992
• 10: Asif Ghias , Jonathan Logan , David Chamberlin , Brian C. Smith, Query by humming: musical information retrieval in an audio database, Proceedings of the third ACM international conference on Multimedia, p.231-236, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215273]
• 11: Goncalves, P.F., Robin, J. T.L.V.L., Miranda, O.G., Meira, S.L. (1998). Measuring the Effect of Centroid Size on Web Search Precision and Recall. In Processings 8th Annual Conference of the Internet Society.
• 12: Dan Gusfield, Algorithms on strings, trees, and sequences: computer science and computational biology, Cambridge University Press, New York, NY, 1997
• 13: Hsu, J. L. and Arbee L.P. Chen. (2001). Building a platform for performance study of various music information retrieval approaches. In Proceedings of the 2nd Annual International Symposium on Music Information Retrieval (ISMIR 2001). Bloomington, Indiana, USA.
• 14: Hsu, J. L. and Arbee L. P. Chen. A quantitative comparison of various techniques for content-based music information retrieval. In Stephen Downie, Tim Crawford, and Don Byrd (eds.). Music information retrieval: audio, midi, and score. Kluwer Academic Publishers (to appear).
• 15: Lee, W. and Chen, A. L. P. (2000). Efficient multi-feature index structures for music data retrieval. In Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases.
• 16: Liu, C. C., Hsu, J. L., and Chen, A. L. P. (1999). An approximate string matching algorithm for content-based music data retrieval. In Proceedings ICMCS.
• 17: Lemstrom, K. and Perttu, S. (2000). SEMEX: An efficient music retrieval prototype. In Proceedings of ISMIR.
• 18: Edward M. McCreight, A Space-Economical Suffix Tree Construction Algorithm, Journal of the ACM (JACM), v.23 n.2, p.262-272, April 1976 [doi>10.1145/321941.321946]
• 19: MIDI Manufactures Association (MMA), MIDI 1.0 Specification, http://www.midi.org/.
• 20: Rodger J. McNab , Lloyd A. Smith , Ian H. Witten , Clare L. Henderson, Tune Retrieval in the Multimedia Library, Multimedia Tools and Applications, v.10 n.2-3, p.113-132, April 2000 [doi>10.1023/A:1009606600500]
• 21: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 22: Selfridge-Field, E. (1998). Conceptual and representational issues in melodic comparison. In Hewlett, W. B. and Selfridge-Field E. (Ed.), Melodic similarity: Concepts, procedures, and applications (Computing in Musicology: 11), The MIT Press.
• 23: Jean Tague-Sutcliffe, The pragmatics of information retrieval experimentation, revisited, Information Processing and Management: an International Journal, v.28 n.4, p.467-490, July-Aug. 1992 [doi>10.1016/0306-4573(92)90005-K]
• 24: Yuen-Hsien Tseng, Content-based retrieval for music collections, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.176-182, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312675]
• 25: Alexandra L. Uitdenbogerd , Justin Zobel, Manipulation of music for melody matching, Proceedings of the sixth ACM international conference on Multimedia, p.235-240, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290776]
• 26: Alexandra Uitdenbgerd , Justin Zobel, Melodic matching techniques for large music databases, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.57-66, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319470]
• 27: Ian H. Witten , Timothy C. Bell , Alistair Moffat, Managing Gigabytes: Compressing and Indexing Documents and Images, John Wiley & Sons, Inc., New York, NY, 1994
• 28: Yanase, T. and Takasu, A. (1999). Phrase based feature extraction for musical information retrieval. In Proceedings of IEEE Pacific Rim Conference on communications, Computers, and Signal Processing.
• 29: Yip, C. L. and Kao, B. (2000). A study on n-gram indexing of musical features. In Proceedings of IEEE International Conference on Multimedia and Expo. New York.

INDEX TERMS

Keywords:
evaluation platform, music database, performance study, retrieval effectiveness, retrieval methods