On hyperstructure and musical structure

ABSTRACT

In this paper we report on an ongoing investigation into the relationship between musical structure and hyperstructure, based on a series of open hypermedia systems research projects that have featured case studies involving musical content. We provide a general overview of the intersection between hypermedia and musical structure, drawing also on ideas from narrative structure. Through the example systems we consider techniques for building hyperstructure from musical structure and, conversely, building musical structure from hyperstructure. Additionally we describe an experiment in the sonification of hyperstructure.

REFERENCES

• 1: Barra, M., Cillo, T., De Santis, A., Matlock, T., Petrillo, U.F., Negro, A., Scarano, V. and Maglio, P.P. Personal WebMelody: Customized Sonification of Web Servers, Proceedings of the 2001 International Conference on Auditory Display, Finland
• 2: Mark Bernstein, Patterns of hypertext, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.21-29, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276630]
• 3: Mark Bernstein, Card shark and thespis: exotic tools for hypertext narrative, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504233]
• 4: Steven Blackburn , David DeRoure, A tool for content based navigation of music, Proceedings of the sixth ACM international conference on Multimedia, p.361-368, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290802]
• 5: Davis, H.C., Reich, S. and Millard, D. A proposal for a common navigational hypertext protocol. Technical report, Dept. of Electronics and Computer Science, 1997. Presented at 3.5 Open Hypermedia System Working Group Meeting. Aarhus University, Denmark. September 8-11
• 6: David DeRoure , Steven Blackburn , Lee Oades , Jonathan Read , Neil Ridgway, Applying open hypermedia to audio, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.285-286, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276661]
• 7: De Roure, D.C. and Blackburn, S.G. (1998) Amphion: Open Hypermedia Applied to Temporal Media. Proceedings of the 4th Open Hypermedia Workshop p.27--32
• 8: Andrew M. Fountain , Wendy Hall , Ian Heath , Hugh C. Davis, MICROCOSM: an open model for hypermedia with dynamic linking, Hypertext: concepts, systems and applications, Cambridge University Press, New York, NY, 1992
• 9: Asif Ghias , Jonathan Logan , David Chamberlin , Brian C. Smith, Query by humming: musical information retrieval in an audio database, Proceedings of the third ACM international conference on Multimedia, p.231-236, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215273]
• 10: Lynda Hardman , Dick C. A. Bulterman , Guido van Rossum, The Amsterdam hypermedia model: adding time and context to the Dexter model, Communications of the ACM, v.37 n.2, p.50-62, Feb. 1994 [doi>10.1145/175235.175239]
• 11: Joyce, M. Afternoon, a story. Eastgate Systems, 1987
• 12: Danius T. Michaelides , David E. Millard , Mark J. Weal , David De Roure, Auld Leaky: A Contextual Open Hypermedia Link Server, Revised Papers from the nternational Workshops OHS-7, SC-3, and AH-3 on Hypermedia: Openness, Structural Awareness, and Adaptivity, p.59-70, August 14-18, 2001
• 13: Dave E. Millard , Luc Moreau , Hugh C. Davis , Siegfried Reich, FOHM: a fundamental open hypertext model for investigating interoperability between hypertext domains, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.93-102, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336334]
• 14: Theodor Holm Nelson, Xanalogical structure, needed now more than ever: parallel documents, deep links to content, deep versioning, and deep re-use, ACM Computing Surveys (CSUR), v.31 n.4es, Dec. 1999 [doi>10.1145/345966.346033]
• 15: Jacco van Ossenbruggen , Anton Eliëns, Technical briefing: Music in time-based hypermedia, Proceedings of the 1994 ACM European conference on Hypermedia technology, p.224-227, September 19-23, 1994, Edinburgh, Scotland [doi>10.1145/192757.376055]
• 16: Kevin R. Page , Don Cruickshank , David De Roure, Its about time: link streams as continuous metadata, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504242]
• 17: Jim Rosenberg, And And: conjunctive hypertext and the structure acteme juncture, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504235]
• 18: Eleanor Selfridge-Field, Beyond MIDI: the handbook of musical codes, MIT Press, Cambridge, MA, 1997
• 19: Smoliar, S. A Computer Aid for Schenkerian Analysis, Computer Music Journal, Volume 4, Number 2, pp. 41--59, MIT Press, 1980
• 20: Tanaka, A. Musical implications of media and network infrastructures, Hypertextes hypermedias Actes de H2PTM'01, p. 241--250. October 2001
• 21: Taube, H. and Kunze, T. An HTTP Interface to Common Music. Proceedings of the 1997 International Computer Music Conference, pp. 204--207. Thessaloniki, Greece and San Francisco, CA: ICMA, 1997
• 22: Mark J. Weal , David E. Millard , Danius T. Michaelides , David C. De Roure, Building narrative structures using context based linking, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504231]
• 23: Computer Music Journal, vol. 24, no. 1, MIT Press, Spring 2000
• 24: HyTime. ISO 10744:1997 - Hypermedia/Time-based Structuring Language (HyTime), 2nd Edition
• 25: SMDL draft international standard (ISO/IEC CD 10743), July 1995. ISO/IEC JTC1/SC34
• 26: W3C Synchronized Multimedia Integration Language (SMIL 2.0), World Wide Web Consortium Recommendation, 7 August 2001

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Architectures

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation
      H.5.5 Sound and Music Computing
          Subjects: Methodologies and techniques

General Terms:
Design, Human Factors

Keywords:
hyperstructure, musical structure, narrative structure, open hypermedia