Towards the digital music library: tune retrieval from acoustic input

ABSTRACT

Music is traditionally retrieved by title, composer or subject classification. It is possible, with current technology, to retrieve music from a database on the basis of a few notes sung or hummed into a microphone. This paper describes the implementation of such a system, and discusses several issues pertaining to music retrieval. We first describe an interface that transcribes acoustic input into standard music notation. We then analyze string matching requirements for ranked retrieval of music and present the results of an experiment which tests how accurately people sing well known melodies. The performance of several string matching criteria are analyzed using two folk song databases. Finally, we describe a prototype system which has been developed for retrieval of tunes from acoustic input.

REFERENCES

• 1: Bainbridge, D. and Bell, T.C. (1996) "An extensible optical music recognition system." Proc Australian Conference on Computer Science. Melbourne; January.
• 2: Bauer, B. (1988) The new Real Book. Sher Music Co, Petaluma, CA.
• 3: Bishop, M. J. and Thompson, E. A. (1986) "Maximum likelihood alignment of DNA sequences." J. Molecular Biology 190: 159-165.
• 4: Carter, N.P. (1989) Automatic recognition of printed music in the context of electronic publishing. Ph.D. thesis, University of Surrey, UK; February.
• 5: Cohen, A. and Cohen, N. (1973) "Tune evolution as an indicator of traditional musical norms." J. American Folklore 86, 339: 37-47.
• 6: Deutsch, D. (1972) "Octave generalization and tune recognition." Perception and Psychophysics 11(6): 411-412.
• 7: Dowling, W. J. (1978) "Scale and contour: Two components of a theory of memory for melodies." Psychological Review 85(4) 341-354.
• 8: Asif Ghias , Jonathan Logan , David Chamberlin , Brian C. Smith, Query by humming: musical information retrieval in an audio database, Proceedings of the third ACM international conference on Multimedia, p.231-236, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215273]
• 9: Gold, B. and Rabmer, L. (1969) "Parallel processing techniques for estimating pitch periods of speech in the time domain." J. Acoust. Soc. Am. 46(2) 442-448.
• 10: Goodrum, C. A. and Dalrymple, H. W. (1982) Guide to the Library of Congress. Library of Congress, Washington, D. C.
• 11: Hess, W. (1983) Pitch Determination of Speech Signals. Springer- Verlag, New York.
• 12: Hawley, M. (1990) "The personal orchestra." Computing Systems 3(2): 289-329.
• 13: Shoshana Loeb, Architecting personalized delivery of multimedia information, Communications of the ACM, v.35 n.12, p.39-47, Dec. 1992 [doi>10.1145/138859.138862]
• 14: Robert A. Wagner , Roy Lowrance, An Extension of the String-to-String Correction Problem, Journal of the ACM (JACM), v.22 n.2, p.177-183, April 1975 [doi>10.1145/321879.321880]
• 15: McNab, R. J., Smith, L. A. and Witten, I.H. (1995) "Signal processing for melody transcriptlon." Working Paper 95/22. University of Waikato, Hamilton, New Zealand.
• 16: Mongeau, M. and Sankoff, D. (1990) "Comparison of musical sequences." Computers and the Humanities 24:161-I75.
• 17: Robert Sedgewick, Algorithms, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1984
• 18: Selfridge-Field, E. (1994) "Optical recognition of music notation: a survey of current work." Computing in Musicology, 9: 109-145.
• 19: Sloboda, J. (I982) "Music performance." in The Psychology of Music, edited by D. Deutsch, Academic Press, pp. 479- 496.
• 20: Sundberg, j. and B. Lindblom (1976) "Generative theories in language and music descriptions." Cognition 4: 99-122.
• 21: Robert A. Wagner , Michael J. Fischer, The String-to-String Correction Problem, Journal of the ACM (JACM), v.21 n.1, p.168-173, Jan. 1974 [doi>10.1145/321796.321811]
• 22: Waibel, A. and Yegnanarayana, B. (1983) "Comparative study of nonlinear warping techniques in isolated word speech recognition systems." IEEE Trans Acoustics, Speech, and Signal Proc. 31(6): 1582-1586.
• 23: Sun Wu , Udi Manber, Fast text searching: allowing errors, Communications of the ACM, v.35 n.10, p.83-91, Oct. 1992 [doi>10.1145/135239.135244]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems
          Subjects: Pattern matching

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Music**

General Terms:
Algorithms, Experimentation, Performance

Keywords:
acoustic interfaces, melody recall, musical retrieval, relevance ranking