The andantephone: a musical instrument that you play by simply walking

ABSTRACT

I present a new way of teaching musical tempo and rhythm by writing out the music on a timeline along the ground, with, for example, chalk, in a form in which each beat of the music corresponds to one footstep. In some setups I use computer vision to track participants so that the music is actually generated by their footsteps moving through the space. In other embodiments I installed patio stones, leading to a musical garden, and outfitted each stone with a pressure sensor. I connected the pressure sensors to a central computer, which I programmed to step through a song, as people walk to the garden. Each footstep activates the next note in the song, so that there is perfect synchronization between the music and the speed of your walking (i.e. if you walk faster the song plays faster, if you stop walking the song stops, etc.). In one embodiment the computer controls an outdoor pipe-organ sculpture that I made from PVC pipes. Another provides a MIDI output to control a piano or other sound-producing device. Some versions of the sculpture are human-powered, either electrically, or wholly acoustically without the use of a computer.I also arranged various musical compositions suitable to this new form of art.This teaching method, together with various sculptural embodiments of it were found to break down social barriers and create cross-cultural and cross-generational ties. For example, children and their grand parents enjoyed walking through the gardens at Pine Hill Estates where a version of my sculpture is permanently installed.Other variations of the sculpture include arrays of hydraulophonic fountain jets that play a song in a water park when a person walks on the water. Each note or beat is triggered by a water pressure increase when one of the water jets is blocked by the foot of a user stepping on it.

REFERENCES

• 1: H. Ishii. Bottles: A transparent interface as a tribute to mark weiser. IEICE Transactions on Information and Systems, pages Vol. E87--D, No. 6, pp. 1299--1311, June 2004.
• 2: Hiroshi Ishii , Minoru Kobayashi, ClearBoard: a seamless medium for shared drawing and conversation with eye contact, Proceedings of the SIGCHI conference on Human factors in computing systems, p.525-532, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142977]
• 3: Steve Mann, "fl Huge UId streams": fountains that are keyboards with nozzle spray as keys that give rich tactile feedback and are more expressive and more fun than plastic keys, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101176]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing

  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Fine arts

General Terms:
Design, Experimentation, Performance, Theory, Verification

Keywords:
interactive sculptures, musical sculptures