Tangible viewpoints: a physical approach to multimedia stories

ABSTRACT

We present a multimedia storytelling system that couples a tangible interface with a multiple viewpoint approach to interactive narratives. Over the centuries, stories have moved from the physical environment (around campfires and on the stage), to the printed page, then to movie, television and computer screens. Today, using wireless and tag sensing technologies, storytellers are able to bring digital stories back into our physical environment. The Tangible Viewpoints system explores how physical objects and augmented surfaces can be used as tangible embodiments of different character perspectives in an interactive tale. These graspable surrogates provide a direct mode of navigation to the story world, a means of bridging the gap between cyberspace and our physical environment as we engage with digital stories. The system supports stories told in a range of media, including audio, video, still image and text.In this paper, we first provide a context for Tangible Viewpoints based on research in the areas of tangible interfaces and interactive narratives. We then offer an overview of the Tangible Viewpoints functionality, and explain the design and implementation of the system. The current system has been used in two storytelling projects. We discuss each one, and look at how user feedback has affected or will affect further development. We conclude by suggesting several future applications for the Tangible Viewpoints interface.

REFERENCES

• 1: Steve Benford , Benjamin B. Bederson , Karl-Petter Åkesson , Victor Bayon , Allison Druin , Pär Hansson , Juan Pablo Hourcade , Rob Ingram , Helen Neale , Claire O'Malley , Kristian T. Simsarian , Danaë Stanton , Yngve Sundblad , Gustav Taxén, Designing storytelling technologies to encouraging collaboration between young children, Proceedings of the SIGCHI conference on Human factors in computing systems, p.556-563, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332502]
• 2: Brooks, Kevin. "Agent Stories" in AAAI Spring Symposium Series -Interactive Story Systems, Plot and Character. American Association for A.I., Stanford University, 1995.
• 3: Kevin M. Brooks, Do story agents use rocking chairs? The theory and implementation of one model for computational narrative, Proceedings of the fourth ACM international conference on Multimedia, p.317-328, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244233]
• 4: Bruner, Jerome. Actual Minds, Possible Worlds. Harvard University Press, Cambridge, MA, 1987.
• 5: Davenport, Glorianna. "New Orleans in Transition, 1983--1987: The Interactive Delivery of a Cinematic Case Study" in Proceedings of the International Congress for Design and Planning Theory, Education Group Conference, May 1987.
• 6: Glorianna Davenport , Michael Murtaugh, ConText towards the evolving documentary, Proceedings of the third ACM international conference on Multimedia, p.381-389, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215302]
• 7: G. Davenport , M. Murtaugh, Automatist storyteller systems and the shifting sands of story, IBM Systems Journal, v.36 n.3, p.446-456, 1997
• 8: Allison Druin , Jamie Montemayor , Jim Hendler , Britt McAlister , Angela Boltman , Eric Fiterman , Aurelie Plaisant , Alex Kruskal , Hanne Olsen , Isabella Revett , Thomas Plaisant Schwenn , Lauren Sumida , Rebecca Wagner, Designing PETS: a personal electronic teller of stories, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.326-329, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303103]
• 9: Gorbet, M. Beyond Input Devices: A New Conceptual Framework for the Design of Physical-Digital Objects. MS Thesis, MIT Media Lab, 1998.
• 10: Matthew G. Gorbet , Maggie Orth , Hiroshi Ishii, Triangles: tangible interface for manipulation and exploration of digital information topography, Proceedings of the SIGCHI conference on Human factors in computing systems, p.49-56, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274652]
• 11: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 12: Mazalek, A. Tangible Interfaces for Interactive Point-of-View Narratives. MS Thesis, MIT Media Lab, 2001.
• 13: Mazalek, A., Wood, A., Ishii, H., "genieBottles: An Interactive Narrative in Bottles" in Conference Abstracts and Applications of SIGGRAPH '01, ACM Press, p. 189.
• 14: Murtaugh, M. The Automatist Storytelling System: Putting the Editor's Knowledge in Software. MS Thesis, MIT Media Lab, 1996.
• 15: Richards, Ron. A Director's Method for Film and Television. Focal Press, 1992.
• 16: Kimiko Ryokai , Justine Cassell, StoryMat: a play space with narrative memories, Proceedings of the 4th international conference on Intelligent user interfaces, p.201, January 05-08, 1999, Los Angeles, California, United States [doi>10.1145/291080.291126]
• 17: Danae Stanton , Victor Bayon , Helen Neale , Ahmed Ghali , Steve Benford , Sue Cobb , Rob Ingram , Claire O'Malley , John Wilson , Tony Pridmore, Classroom collaboration in the design of tangible interfaces for storytelling, Proceedings of the SIGCHI conference on Human factors in computing systems, p.482-489, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365322]
• 18: Marcelle A. Stienstra, Creating an immersive broadcast experience, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500208]
• 19: Strohecker, Carol. Electronic Collage: The Videodisc and Interactive Narrative. MS Thesis, MIT Media Lab, 1986.
• 20: Strohecker, C. "Tired of Giving In: Experimenting with the Greek Chorus as a Model for Interaction with Stories" in Nov'Art: Les Etats Generaux de l'Ecriture Multimedia. ART3000, Paris, 1996.
• 21: Strohecker, C., Brooks, K., Friedlander, L. "Tired of Giving In: An Experiment in Narrative Unfolding." Available as Technical Report 99--16. Cambridge MA: MERL - A Mitsubishi Electric Research Laboratory, 1999.
• 22: Todorov, Tzvetan. "Narrative Men" in Poetics of Prose. Translated by Richard Howard. Cornell University Press, Ithaca, NY, 1977.

INDEX TERMS

Keywords:
character, design, interactive narrative, multimedia storytelling, multiple point-of-view, physical interaction, tangible interface