Audio games: new perspectives on game audio

ABSTRACT

This paper discusses the design of audio games, a quite new computer game category that originates from games for players with visual impairments as well as from mainstream music games. In the TiM project (Tactile Interactive Multimedia), SITREC develops three sound-based games that point out new directions for game audio design. The TiM games demonstrate different ways in which games can be designed around an auditory experience. Several unique features of audio games are presented emphasising unexplored potentials for interactivity and future development areas are suggested.SITREC proposes an approach to the design of auditory interfaces that takes three listening modes into consideration: casual listening, semantic listening and reduced listening. A semiotic model is presented that illustrates this view on sound object design and ways in which sounds can be combined. The discourse focuses on issues of continuous display, musicality and clarity, and introduces the notion of "spatialised game soundtracks," as opposed to separated background music and game effect sounds.The main challenge when developing auditory interfaces is to balance functionality and aesthetics. Other important issues are the inclusion of meta-level information in order to achieve a high level of complexity and to provide elements of open-endedness. This refers to planning the overall gameplay, as well as to designing individual sound objects and combining them into complex, interactive soundscapes.

REFERENCES

• 1: G. Andersen. Playing by ear: Creating blind-accessible games. http://www.gamasutra.com/resource_guide/20020520/andersen_01.htm, 2002.
• 2: Audiogames. Audiogames.net. http://www.audiogames.net/, 2004.
• 3: Stephen A. Brewster, Using nonspeech sounds to provide navigation cues, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.3, p.224-259, Sept. 1998 [doi>10.1145/292834.292839]
• 4: M. Chion. Audio-Vision: Sound on Screen. Columbia University Press, New York, 1994.
• 5: W. W. Gaver. What in the world do we hear? an ecological approach to auditory event perception. Ecological Psychology, 5(1):1--29, 1993.
• 6: W. W. Gaver. Auditory interfaces. In M. G. Helander, T. K. Landauer, and P. V. Prabhu, editors, Handbook of Human-Computer Interaction, 2nd ed, pages 1003--1041. Elsevier, Amsterdam, 1997.
• 7: GMA. Gma games. http://www.gmagames.com/sod.html, 2004.
• 8: D. Gärdenfors. Designing sound-based computer games. Digital Creativity, 14(2):111--114, 2003.
• 9: Konami. Konami digital entertainment. http://www.konami.com/ddr/, 2004.
• 10: S. McCloud. Understanding Comics: The Invisible Art. Harper Collins Publishers, Inc, New York, 1993.
• 11: A. Menshikov. Modern audio technologies in games. http://www.digit-life.com/articles2/sound-technology/index.html, 2003.
• 12: M. O'Donnell. Producing audio for halo. http://www.gamasutra.com/resource_guide/20020520/odonnell_01.htm, 2002.
• 13: C. S. Peirce Collected Papers of Charles Sanders Peirce. Harvard University Press, Cambridge, 1931.
• 14: Pin. Pin interactive. http://www.terraformers.nu/eng/, 2004.
• 15: P. Schaeffer. Trait des objects musicaux. Editions du Seuil, Paris, 1966.
• 16: Sega. Sonicteam/sega. http://www.sonicteam.com/rez/, 2001.
• 17: SITREC, Sitrec, stockholm international toy research center. http://www.sitrec.kth.se/.
• 18: Sony. Sony computer entertainment. http://www.scea.com/Content/games/SCUS-97167/ogs/, 2002.
• 19: Sony. Sony computer entertainment. http://www.vib-ribbon.com/, 2002.
• 20: Sony. Sony computer entertainment. http://www.us.playstation.com/Content/games/-97258/ogs/, 2003.
• 21: Sony. Sony eye toy. http://www.eyetoy.com/english/, 2004.
• 22: TiM. The tim project, tactile interactive multimedia, ist-2000-25298. http://inova.snv.jussieu.fr/tim/.
• 23: J. Wall. Music for myst iii: Exile. the evolution of a videogame soundtrack. http://www.gamasutra.com/features/20020110/wall_01.htm, 2002.
• 24: B. Williamson. Accessing games through sound, motion and emotion. http://www.nestafuturelab.org/viewpoint/art12.htm, 2003.
• 25: F. Winberg and S.-O. Hellström. The quest for auditory direct manipulation: the sonified towers of hanoi. In Proceedings of the 3rd International Conference on Disability, Virtual Reality and Associated Technologies, pages 75--81. ICDVRAT, September 2000.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Auditory (non-speech) feedback

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output

  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Performing arts (e.g., dance, music)

General Terms:
Design, Human Factors, Theory

Keywords:
audio game, auditory interface, e-inclusion, game audio, sound design, sound-scape, spatial soundtrack, visual impairment