Manipulation of music for melody matching

ABSTRACT

Many types of user would find it valuable to search collections of music via queries representing music fragments, but such searching requires a reliable technique for identifying whether a provided fragment occurs within a piece of music. The problem of matching fragments to music is made difficult by the psychology of music perception, because literal matching may have litile relation to perceived melodic similarity, and by the interactions between the multiple parts of typical pieces of music. In this paper we analyse the propeties of music, music perception, and music database users, and use the analysis to propose alternative techniques for extracting monophonic melodies from polyphonic music; we believe that such melodies can subsequently be used for matching of queries to data. We report on experiments with music listeners, which rank our proposed techniques for extracting melodies.

REFERENCES

• 1: V. D. Gusev B 'aktzmutox~ I. V. and T. N. Titko~~ A search and classification of imperfect repetitions in song melodies. Acta e~ Commentationes Universitatis Tartuensis: Quantitative Linguistics and Automatic Text Analysis, 827:20--32, 1988.
• 2: James C. Bartlett and \V. Jay Dowling. Recognition of transposed meloEes: A k~,-distance effect in developmental perspective. Journal of Ezperimentol Psychology: Human Perception and Performance, 6(3):501-515, 1980.
• 3: David C. Blair, STAIRS redux: thoughts on the STAIRS evaluation, ten years after, Journal of the American Society for Information Science, v.47 n.1, p.4-22, Jan. 1996 [doi>10.1002/(SICI)1097-4571(199601)47:1<4::AID-ASI2>3.3.CO;2-5]
• 4: Helene Charna~e and Bernard Stepien. Automatic tramscription of german lute tablatures: an artificial intelligence application. In Computer Representations and Models in Music, pages 143-170. Academic Press, 1992.
• 5: T.-C. Chou , A. L. P. Chen , C.-C. Liu, Music Databases: Indexing Techniques and Implementation, Proceedings of the 1996 International Workshop on Multi-Media Database Management Systems (IW-MMDBMS '96), p.46, August 14-16, 1996
• 6: Diana Deutsch. Grouping mechanisms in music. In The Psycholo~y of Music, chapter 4, pages 99--134. Academic Press, Inc., 1982.
• 7: W. Jay Dowling. Scale and contour: Two components of a theory of memory for melodies. Psychological Review, 85(4):341-354, 1978.
• 8: J. Stephen Downie. The musifind music information retrieval project, phase iii: evaluation of indexing options. In Cansdian Association for information Science proceedings of the 2$rd Annual Conference, Connectedness: Information, Systems, People, Organisations, pages 135-46. CAIS, 1995.
• 9: Barry M. Eaglestone. ~xtending the relational database model for computer music research. In Alan Marsden and Anthony Pople, editors, Computer Representations and Models in Music, pages 41-66. Academic Press, 1992.
• 10: Judy Edworthy. Interval and contour in melody processing. Music Perception, 2(3):375-388, 1985.
• 11: R. Frances. ~a Perception de la Musique. 1958. Translated by W. Jay. Dowling.
• 12: Asif Ghias , Jonathan Logan , David Chamberlin , Brian C. Smith, Query by humming: musical information retrieval in an audio database, Proceedings of the third ACM international conference on Multimedia, p.231-236, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215273]
• 13: Michael Jerome Hawley, Structure out of sound, Massachusetts Institute of Technology, Cambridge, MA, 1993
• 14: Vladimir D. Gusev Irene V. Bakhmutova and Tatiana N. Titkova. The search for adaptations in song melodies. Computer Music Journal, 21(1):58-67, 1997.
• 15: Carol L. Krumhansl and Roger N. Shepard. Quantification of the hierarchy of tonal functions within a diatonic context. Journal of Ezperimental Psychology: Human Perception and Performance, 5(4):579-594, 1979.
• 16: Alan Marsden. Modelling the perception of musical voices: a case study in rule-based systems. In Computer Representations and Models in Music, pages 239-263. Academic Press, 1992.
• 17: Rodger J. McNab. Interactive applications of music tram scription. Master's thesis, Department of Computer Science, University of ~Vaikato, New Zealand, 1996.
• 18: Rodger J. McNab , Lloyd A. Smith , Ian H. Witten , Clare L. Henderson , Sally Jo Cunningham, Towards the digital music library: tune retrieval from acoustic input, Proceedings of the first ACM international conference on Digital libraries, p.11-18, March 20-23, 1996, Bethesda, Maryland, United States [doi>10.1145/226931.226934]
• 19: Gerald Salton, Automatic text processing, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1988
• 20: Helmut Schaffrath. The retrieval of monophonic melodies and their variants: Concepts and strategies for computeraided analysis. In Alan Marsden and Anthony Pople, editors, Computer Representations and Models in Music, pages 95- 110. Academic Press, 1992.
• 21: Kazuhiro Mochizuki Tetsuya Kageyama and Yosuke Takashima. Melody retrieval with humming. In ICMC Proceedings 1993, 1993.
• 22: Rene van Egmond and Dirk-Jan Povel. Perceived similarity of exact and inexact transpositions. Acts Psychologica, 92:283-295, 1996.
• 23: Hugh E. Williams , Justin Zobel, Indexing Nucleotide Databases for Fast Query Evaluation, Proceedings of the 5th International Conference on Extending Database Technology: Advances in Database Technology, p.275-288, March 25-29, 1996
• 24: Justin Zobel , Philip Dart, Finding approximate matches in large lexicons, Software—Practice & Experience, v.25 n.3, p.331-345, March 1995 [doi>10.1002/spe.4380250307]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Design, Experimentation