Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

The paper presents our approach for human-machine interaction with an anthropomorphic mechanical percussionist that can listen to live players, analyze perceptual musical aspects in real-time, and use the product of this analysis to play along in a collaborative manner. Our robot, named Haile, is designed to combine the benefits of computational power, perceptual modeling, and algorithmic music with the richness, visual interactivity, and expression of acoustic playing. We believe that when interacting with live players, Haile can facilitate a musical experience that is not possible by any other means, inspiring users to collaborate with it in novel and expressive manners. Haile can, therefore, serve a test-bed for novel forms of musical human-machine interaction, bringing perceptual aspects of computer music into the physical world both visually and acoustically.

REFERENCES

• 1: Cope, D. Experiments in Music Intelligence. A-R Editions, Madison, WI, 1996.
• 2: Cycling74 - Max/MSP http://www.cycling74.com Accessed 2005.
• 3: Dannenberg, R. An On-line Algorithm for Real-Time Accompaniment. Proceedings of the 1984 International Computer Music Conference. Paris, France.
• 4: Desain, P. and Honing, H.J. Rhythmic stability as explanation of category size. Proceedings of the 2002 of the International Conference on Music Perception and Cognition Sydney CD-Rom.
• 5: Foote, J. and Uchihashi, S. The Beat Spectrum: a new approach to rhythmic analysis. Proceedings of the 2001 International Conference on Multimedia and Expo.
• 6: Sergi Jordà, Afasia: the ultimate homeric one-man-multimedia-band, Proceedings of the 2002 conference on New interfaces for musical expression, May 24-26, 2002, Dublin, Ireland
• 7: Lewis, G. Too Many Notes: Computers, Complexity and Culture in Voyager," Leonardo Music Journal 10 (2000) 33--39.
• 8: Makingthings - Teleo system http://www.makingthings.com
• 9: Pachet, F. The continuator: Musical interaction with style. Proceedings International Computer Music Conference, (2002) Goteborg, Sweden.
• 10: Paulus, J. and Kalpuri, A. Measuring the Similarity of Rhythmic Patterns. Proceedings of the 2002 International Conference on Music Information Retrieval. Paris, France.
• 11: Puckette, M. Real-time Audio Analysis Tools for Pd and MSP. Proceedings of the 1998 International Computer Music Conference. Cologne, Germany.
• 12: Rae, G. W. Robotic Instruments. http://logosfoundation.org/instrum_gwr/automatons.html
• 13: Robert Rowe, Machine Musicianship, MIT Press, Cambridge, MA, 2004
• 14: Scheirer, E. 1998. Tempo and beat analysis of acoustic musical signals. Journal of the Acoustical Society of America, 103:1 588--601.
• 15: Eric Singer , Jeff Feddersen , Chad Redmon , Bil Bowen, LEMUR's musical robots, Proceedings of the 2004 conference on New interfaces for musical expression, p.181-184, June 03-05, 2004, Hamamatsu, Shizuoka, Japan
• 16: Sony QRIO conductor Robot. http://www.sony.net/sonyInfo/QRIO/works/20040325e.html
• 17: Takanishi, A. Development of Anthropomorphic Flutist Robot WF-3RIV. Proceedings of International Computer Music Conference, Ann Arbor, Michigan, (1998) 328--331.
• 18: Andranik S. Tangiuane, Artificial Perception and Music Recognition, Springer-Verlag New York, Inc., Secaucus, NJ, 1993
• 19: Toyota Trumpet Robot. http://www.toyota.co.jp/ en/special/robot
• 20: Gili Weinberg , Maggie Orth , Peter Russo, The embroidered musical ball: a squeezable instrument for expressive performance, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633457]
• 21: Gil Weinberg, Interconnected Musical Networks: Toward a Theoretical Framework, Computer Music Journal, v.29 n.2, p.23-39, June 2005 [doi>10.1162/0148926054094350]
• 22: Weinberg G., Driscoll S., Parry M. Musical Interactions with a Perceptual Robotic Percussionist. Proceedings of IEEE International Workshop on Robot and Human Interactive Communication. Nashville, TN (2005).
• 23: Todd Winkler, Composing Interactive Music: Techniques and Ideas Using Max, MIT Press, Cambridge, MA, 2001

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing

Keywords:
collaborative systems, human-robot interaction, music