Visualizing music and audio using self-similarity

ABSTRACT

This paper presents a novel approach to visualizing the time structure of music and audio. The acoustic similarity between any two instants of an audio recording is displayed in a 2D representation, allowing identification of structural and rhythmic characteristics. Examples are presented for classical and popular music. Applications include content-based analysis and segmentation, as well as tempo and structure extraction.

REFERENCES

• 1: Potter Ralph K., George A. Kopp, Harriet C. Green, Visible Speech, D. Van Nostrand Co., NY, 1947
• 2: Koenig, Walter K., H.K. Dunn, L.Y. Lacey, "The Sound Spectrograph," in JASA, Vol. 18, p. 19~49.
• 3: Sean M. Smith , Glen N. Williams, A visualization of music, Proceedings of the 8th conference on Visualization '97, p.499-ff., October 18-24, 1997, Phoenix, Arizona, United States
• 4: Lawrence Rabiner , Biing-Hwang Juang, Fundamentals of speech recognition, Prentice-Hall, Inc., Upper Saddle River, NJ, 1993
• 5: Foote, Jonathan. "Content-Based Retrieval of Music and Audio," in C.-C. J. Kuo et al., editor, Multimedia Storage and Archiving Systems II, Proc. of SPIE, Vol. 3229, pp. 138-147, 1997.
• 6: Carey, M. J., et al., "A Comparision of Features for Speech and Music Discrimination," in Proc. ICASSP '99, vol. 1, pp. 149-152, IEEE, Phoenix AZ 1999
• 7: Johnson, P., "sci.skeptic FAQ," Section 0.6.2, http:// www. faqs.org/faqs/skeptic-faq/1, 1999

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design, Experimentation, Theory

Keywords:
audio analysis, audio similarity, music visualization