Identifying audio clips with RARE

ABSTRACT

In this paper, we describe RARE (Robust Audio Recognition Engine): a system for identifying audio streams and files. RARE can be used in a variety of applications: from enhancing the consumer listening experience to cleaning large audio databases. RARE was designed with two key qualities in mind: robustness to distortion of the audio, and lookup speed. RARE identifies audio clips in a stream against a database of 1/4 million songs in real time using approximately 10% CPU on an 850 MHz P3, and with a measured false positive rate of 1.5x10-8 per clip, per database entry, at a false negative rate of 0.2% per clip. We demo RARE in real-time on a stream and on distorted files.

REFERENCES

• 1: Burges, C.J.C, Platt, J.C., and Jana, S., "Extracting noise robust features from audio data", in Proceedings of ICASSP 2002, 1021-1024.
• 2: Burges, C.J.C., Platt, J.C. and Jana, S., "Distortion Discriminant Analysis for Audio Fingerprinting", to appear in IEEE Speech and Audio Processing, 2003
• 3: K. I. Diamantaras , S. Y. Kung, Principal component neural networks: theory and applications, John Wiley & Sons, Inc., New York, NY, 1996
• 4: Goldstein, J, Platt, J.C., and Burges, C.J.C., "Indexing high Dimensional Rectangles for Fast Multimedia Identification", Microsoft Research Tech. Report MSR-TR-2003-38, 2003.
• 5: Malvar, H.S., "A Modulated Complex Lapped Transform and its Applications to Audio Processing", in Proceedings of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 1999
• 6: Jonathan Goldstein , Raghu Ramakrishnan, Contrast Plots and P-Sphere Trees: Space vs. Time in Nearest Neighbour Searches, Proceedings of the 26th International Conference on Very Large Data Bases, p.429-440, September 10-14, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

General Terms:
Algorithms, Experimentation

Keywords:
audio fingerprinting, fast indexing, robust lookup