COSIN: content-based retrieval system for cover songs

ABSTRACT

We develop a content-based audio COver Song IdeNtification (COSIN) system to detect/group cover songs. The COSIN takes music audio content as input and performs similarity searching to locate variants of the input (i.e., cover versions). Identified cover songs are returned in the rank order according to their similarity to the input. The COSIN also incorporates a set of tools to evaluate retrieval performance so researchers can explore different retrieval schemes and parameters (e.g. recall, precision). The COSIN utilizes a suite of techniques to detect cover songs including: Pitch + Dynamic Programming (DP), Chroma + DP, and Semantic Feature Summarization (SFS) + Hash-Based Approximate Matching (HBAM). Demonstration system shows that COSIN is a very potential music content retrieval tool. Running some music retrieval schemes on COSIN platform, recent experiments with SFS + LSH Variants demonstrate a nicely balanced efficiency (search speed) v. performance (search accuracy) tradeoff.

REFERENCES

• 1: D. Ellis and G. Poliner. Identifying cover songs with chroma features and dynamic programming beat tracking. IEEE ICASSP'07, Vol.4, pp.1429--1432, 2007.
• 2: W. H. Tsai, H. M. Yu, and H. M. Wang, A Query-by-Example Technique for Retrieving Cover versions of Popular Songs with Similar Melodies, ISMIR'05, pp.183--190, 2005.
• 3: Yi Yu , J. Stephen Downie , Kazuki Joe, An Evaluation of Feature Extraction for Query-by-Content Audio Information Retrieval, Proceedings of the Ninth IEEE International Symposium on Multimedia Workshops, p.297-302, December 10-12, 2007 [doi>10.1109/ISMW.2007.11]
• 4: Piotr Indyk , Rajeev Motwani, Approximate nearest neighbors: towards removing the curse of dimensionality, Proceedings of the thirtieth annual ACM symposium on Theory of computing, p.604-613, May 24-26, 1998, Dallas, Texas, United States [doi>10.1145/276698.276876]
• 5: Y. Yu, K. Joe, J. S. Downie, Efficient Query-by-Content Audio Retrieval by Locality Sensitive Hashing and Partial Sequence Comparison, IEICE Trans. Info. and Sys., Vol.E91-D, No.6, pp1730--1739, 2008.
• 6: Y. Yu, Scalable Content-Based Music Retrieval on Acoustic Datasets via Hashing, PhD Forum, GHC'08, 2008.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing

General Terms:
Algorithms, Experimentation, Performance

Keywords:
content-based audio retrieval, cover songs, hash-based indexing, musical audio sequences summarization