Exploring composite acoustic features for efficient music similarity query

ABSTRACT

Music similarity query based on acoustic content is becoming important with the ever-increasing growth of the music information from emerging applications such as digital libraries and WWW. However, relative techniques are still in their infancy and much less than satisfactory. In this paper, we present a novel index structure, called Composite Feature tree, CF-tree, to facilitate efficient content-based music search adopting multiple musical features. Before constructing the tree structure, we use PCA to transform the extracted features into a new space sorted by the importance of acoustic features. The CF-tree is a balanced multi-way tree structure where each level represents the data space at different dimensionalities. The PCA transformed data and reduced dimensions in the upper levels can alleviate suffering from dimensionality curse. To accurately mimic human perception, an extension, named CF+-tree, is proposed, which further applies multivariable regression to determine the weight of each individual feature. We conduct extensive experiments to evaluate the proposed structures against state-of-art techniques. The experimental results demonstrate superiority of our technique.

REFERENCES

• 1: Independent Quantization: An Index Compression Technique for High-Dimensional Data Spaces, Proceedings of the 16th International Conference on Data Engineering, p.577, February 28-March 03, 2000
• 2: Stefan Berchtold , Daniel A. Keim , Hans-Peter Kriegel, The X-tree: An Index Structure for High-Dimensional Data, Proceedings of the 22th International Conference on Very Large Data Bases, p.28-39, September 03-06, 1996
• 3: Christian Böhm , Stefan Berchtold , Daniel A. Keim, Searching in high-dimensional spaces: Index structures for improving the performance of multimedia databases, ACM Computing Surveys (CSUR), v.33 n.3, p.322-373, September 2001 [doi>10.1145/502807.502809]
• 4: Donald Byrd , Tim Crawford, Problems of music information retrieval in the real world, Information Processing and Management: an International Journal, v.38 n.2, p.249-272, March 2002 [doi>10.1016/S0306-4573(01)00033-4]
• 5: George Casella and Roger L. Berger. Statistical Inference. Duxbury Press, 2nd edition, 2001.
• 6: Kaushik Chakrabarti , Sharad Mehrotra, Local Dimensionality Reduction: A New Approach to Indexing High Dimensional Spaces, Proceedings of the 26th International Conference on Very Large Data Bases, p.89-100, September 10-14, 2000
• 7: Paolo Ciaccia , Marco Patella , Pavel Zezula, M-tree: An Efficient Access Method for Similarity Search in Metric Spaces, Proceedings of the 23rd International Conference on Very Large Data Bases, p.426-435, August 25-29, 1997
• 8: B. Cui, J. Hu, H. T. Shen, and C. Yu. Adaptive quantization of the high-dimensional data for efficient knn processing. In Proc. 9th DASFAA Conference, 2004.
• 9: Bin Cui , Beng Chin Ooi , Jianwen Su , Kian-Lee Tan, Contorting high dimensional data for efficient main memory KNN processing, Proceedings of the 2003 ACM SIGMOD international conference on Management of data, June 09-12, 2003, San Diego, California [doi>10.1145/872757.872815]
• 10: G.H. Golub and C.F. Van Loan. Matrix Computations. The Johns Hopkins University Press, 1989.
• 11: D. Huron. Perceptual and cognitive applications in music information retrieval. In Proc. Internationl Symposim of Music Information Retrieval, 2000.
• 12: I. T. Jolliffe. Principle Component Analysis. Springer-Verlag, 1986.
• 13: G. Li and A. A. Khokhar. Content-based indexing and retrieval of audio data using wavelets. In IEEE Internal Conference on Multimedia and Expo, 2000.
• 14: Tao Li , Mitsunori Ogihara , Qi Li, A comparative study on content-based music genre classification, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860487]
• 15: Ning-Han Liu , Yi-Hung Wu , Arbee L. P. Chen, Efficient K-NN search in polyphonic music databases using a lower bounding mechanism, Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, November 07-07, 2003, Berkeley, California [doi>10.1145/973264.973291]
• 16: B. Logan. Mel frequency cepstral coefficients for music modeling. In Proc. Multimedia Information Retrieval, 2000.
• 17: U. Nam and J. Berger. Addressing the same but different - different but similar problem in automatic music classification. In Proc. Multimedia Information Retrieval, 2001.
• 18: Lawrence Rabiner , Biing-Hwang Juang, Fundamentals of speech recognition, Prentice-Hall, Inc., Upper Saddle River, NJ, 1993
• 19: Jialie Shen , John Shepherd , Anne H.H. Ngu, Integrating heterogeneous reatures for efficient content based music retrieval, Proceedings of the thirteenth ACM international conference on Information and knowledge management, November 08-13, 2004, Washington, D.C., USA [doi>10.1145/1031171.1031200]
• 20: T. Tolonen and M. Karjalainen. A computationally efficient multipitch analysis model. In IEEE Transactions on Speech and Audio Processing, 2000.
• 21: G. Tzanetakis and P. Cook. Musical genre classification of audio signals. In IEEE Transactions on Speech and Audio Processing, pages 293--302, 2002.
• 22: Roger Weber , Hans-Jörg Schek , Stephen Blott, A Quantitative Analysis and Performance Study for Similarity-Search Methods in High-Dimensional Spaces, Proceedings of the 24rd International Conference on Very Large Data Bases, p.194-205, August 24-27, 1998
• 23: Cui Yu , Beng Chin Ooi , Kian-Lee Tan , H. V. Jagadish, Indexing the Distance: An Efficient Method to KNN Processing, Proceedings of the 27th International Conference on Very Large Data Bases, p.421-430, September 11-14, 2001

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  J. Computer Applications
  J.5 ARTS AND HUMANITIES

General Terms:
Algorithms, Experimentation, Performance

Keywords:
CF-tree, KNN, music, similarity query