Content-based retrieval of MP3 music objects

ABSTRACT

In recent years, the searching and indexing techniques for multimedia data are getting more attention in the area of multimedia databases. As many research works were done on the content-based retrieval of image and video data, less attention was received to the content-based retrieval of audio data. In this paper, we propose an approach to retrieve MP3 music objects based on their content. In our approach, the coefficients extracting from the output of the polyphase filters are used to compute the MP3 features for indexing the MP3 objects. We also propose an MP3 similarity measuring function to provide users the ability to approximately retrieve the desired MP3 objects. Experiments are performed and analyzed to show the efficiency and the effectiveness of the proposed method.

REFERENCES

• 1: ISO/IEC I 1172-3: 1993, "Information Technology -Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbit/s - Part 3: Audio."
• 2: Bakhmutova, V., V. D. Gusev, and T. N. Titkova, "The Search for Adaptations in Song Melodies," Computer Music Journal, Vol. 2 1, No. 1, pages 58-67, Spring 1997.
• 3: Balaban, M., "The Music Structures Approach to Knowledge Representation for Music Processing," Computer Music Journal, Vol. 20, No. 2, pages 96-l 11, Summer 1996.
• 4: Brandenburg, K. and G. Stall, "IS0-MPEG-1 Audio: A Generic Standard for Coding of High Quality Digital Audio," Journal of the Audio Engineering Society, Vol. 42, No. 10, Ott 1994, pp. 780-792.
• 5: J. C. C. Chen , A. L. P. Chen, Query by Rhythm: An Approach for Song Retrieval in Music Databases, Proceedings of the Workshop on Research Issues in Database Engineering, p.139, February 23-24, 1998
• 6: T.-C. Chou , A. L. P. Chen , C.-C. Liu, Music Databases: Indexing Techniques and Implementation, Proceedings of the 1996 International Workshop on Multi-Media Database Management Systems (IW-MMDBMS '96), p.46, August 14-16, 1996
• 7: Dowling, W. J., "Pitch Structure," in Representing Musical Structure, P. Howell, R. West, and I. Cross, ed., Academic Press, London, 1991.
• 8: Jonathan Foote, An overview of audio information retrieval, Multimedia Systems, v.7 n.1, p.2-10, Jan. 1999 [doi>10.1007/s005300050106]
• 9: Foote, Jonathan, "Content-Based Retrieval of Music and Audio" in Proc. SPIE, Multimedia Storage and Archiving systems II, Vol.3229, pp 138-147.
• 10: Asif Ghias , Jonathan Logan , David Chamberlin , Brian C. Smith, Query by humming: musical information retrieval in an audio database, Proceedings of the third ACM international conference on Multimedia, p.231-236, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215273]
• 11: Jia-Lien Hsu , Arbee L. P. Chen , C.-C. Liu, Efficient repeating pattern finding in music databases, Proceedings of the seventh international conference on Information and knowledge management, p.281-288, November 02-07, 1998, Bethesda, Maryland, United States [doi>10.1145/288627.288668]
• 12: Jones, G. T., Music Theory, Harper & Row, Publishers, New York, 1974.
• 13: Keith D. Martin and Youngmoo E. Kim, "2pMU9. Musical Instrument Identification : A Pattern-Recognition Approach," the 13tjth meeting of the Acoustical Society of America, October 13, 1998.
• 14: Keith D. Martin, Eric D. Schrirer, and Barry L. Vercoe, "Music Content Analysis through Models of Audition", ACM Multimedia Workshop on Content Processing of Music for Multimedia Applications, Bristol UK, 12 Sept 1998.
• 15: Krumhansl, C. L., Cognitive Foundations of Musical Pitch, Oxford University Press, New York, 1990.
• 16: Liu, C. C., A. J. L. Hsu, and A. L. P. Chen, "1D-List: An Approximate String Matching Algorithm for Content-Based Music Data Retrieval," i n Proc. IEEE Intl. Conf o n Multimedia Computing and Systems, Vol. 1, pp. 451-456, 1999.
• 17: Efficient Theme and Non-Trivial Repeating Pattern Discovering in Music Databases, Proceedings of the 15th International Conference on Data Engineering, p.14, March 23-26, 1999
• 18: K. Melih , R. Gonzalez, Audio Retrieval Using Perceptually Based Structures, Proceedings of the IEEE International Conference on Multimedia Computing and Systems, p.338, June 28-July 01, 1998 [doi>10.1109/MMCS.1998.693662]
• 19: Narmour, E., The Analysis and Cognition of Basic Melodic Structures, The University of Chicago Press, Chicago, 1990.
• 20: Davis Pan, A Tutorial on MPEG/Audio Compression, IEEE MultiMedia, v.2 n.2, p.60-74, June 1995 [doi>10.1109/93.388209]
• 21: Silvia Pfeiffer , Stephan Fischer , Wolfgang Effelsberg, Automatic audio content analysis, Proceedings of the fourth ACM international conference on Multimedia, p.21-30, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244139]
• 22: R. E. Prather, Harmonic analysis from the computer representation of a musical score, Communications of the ACM, v.39 n.12es, Dec. 1996 [doi>10.1145/272682.272716]
• 23: Smith, G., H. Murase, and H. Kashino, "Quick Audio Retrieval Using Active Search", in Proc. of IEEE ICASSP , pp 3777-3780.
• 24: Erling Wold , Thom Blum , Douglas Keislar , James Wheaton, Content-Based Classification, Search, and Retrieval of Audio, IEEE MultiMedia, v.3 n.3, p.27-36, September 1996 [doi>10.1109/93.556537]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology
      H.5.5 Sound and Music Computing
          Subjects: Signal analysis, synthesis, and processing

General Terms:
Algorithms, Design, Performance

Keywords:
MP3 databases, MP3 indexing, content-based music data retrieval, music databases, music feature extraction