Communicating everyday experiences

ABSTRACT

In this paper, we present our approach to the problem of communicating everyday experiences. This is a challenging problem, since media from everyday events are unstructured, and often poorly annotated. We first attempt to communicate everyday experiences using a dramatic framework, by categorizing media and by introducing causal relations. Based on our experience of the dramatic framework for the everyday media, we introduce an event based framework as well as a viewpoint centric visualization that allows the viewer to have agency, in a highly interactive, non-linear manner. Our approach focuses on structured interaction for consumption of everyday experiences, in contrast to non-interactive consumption of structured communication. Our results indicate that dramatic structures do not work well with everyday media, and novel interactions / visualizations are needed. Experimental results indicate that the viewpoint centric visualization works well. We are in the process of creating a large event database of everyday events, and we are creating the necessary recording and annotation tools.

REFERENCES

• 1: Merriam Webster Dictionary http://www.m-w.com.
• 2: TIGER maps http://imagemaps.mle.ie/.
• 3: Processing http://proce55ing.net.
• 4: Friendster http://www.friendster.com.
• 5: WWMX http://wwmx.org/.
• 6: Preetha Appan , Hari Sundaram, Networked multimedia event expsoration, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027536]
• 7: Susanne Boll , Utz Westermann, MediÆther: an event space for context-aware multimedia experiences, Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence, November 07, 2003, Berkeley, California [doi>10.1145/982484.982488]
• 8: Branigan (1992). Narrative Comprehension and Film. New York.
• 9: Kevin M. Brooks, Do story agents use rocking chairs? The theory and implementation of one model for computational narrative, Proceedings of the fourth ACM international conference on Multimedia, p.317-328, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244233]
• 10: J. Brungart, H. Sridharan, A. Mani, et al. (2004). Adapting Multimedia Design To Context: A design framework for interactive, user context-adaptive multimodal learning environments,. Arts Media and Engineering Program, Arizona State University, AME-TR-2004-08, Jun. 2004 http://ame2.asu.edu/groups/xdg/pubs/ame-tr-2004-08.pdf.
• 11: Marc Davis, Editing out Video Editing, IEEE MultiMedia, v.10 n.2, p.54-64, March 2003 [doi>10.1109/MMUL.2003.1195161]
• 12: Marc Davis, Theoretical foundations for experiential systems design, Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence, November 07, 2003, Berkeley, California [doi>10.1145/982484.982491]
• 13: Where the action is: the foundations of embodied interaction, MIT Press, Cambridge, MA, 2001
• 14: Jim Gemmell , Gordon Bell , Roger Lueder , Steven Drucker , Curtis Wong, MyLifeBits: fulfilling the Memex vision, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641053]
• 15: Adrian Graham , Hector Garcia-Molina , Andreas Paepcke , Terry Winograd, Time as essence for photo browsing through personal digital libraries, Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, July 14-18, 2002, Portland, Oregon, USA [doi>10.1145/544220.544301]
• 16: H. Kang and B. Shneiderman (2000). Visualization Methods for Personal Photo Collections: Browsing and Searching in the PhotoFinder, In Proceedings of IEEE International Conference on Multimedia and Expo (ICME2000), New York:, IEEE, 1539--1542,
• 17: A. Kelliher, A. Mazalek and G. Davenport (2003). Documenting Digital Dialogues: Engaging Audience in the Construction of a Collective Documentary Across Time and Space, Proceedings of TIDSE 2003, Darmstadt, Germany, Springer-Verlag, pp. 248--259, 2003.
• 18: Ali Mazalek , Glorianna Davenport , Hiroshi Ishii, Tangible viewpoints: a physical approach to multimedia stories, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641037]
• 19: B. Moghaddam, Q. Tian, N. Lesh, et al. (2001). Visualization Layout for Personal Photo Libraries, Prof. of Int'l Workshop on Content-Based Mutlimedia Indexing (CBMI'01),,
• 20: Janet Horowitz Murray, Hamlet on the Holodeck: The Future of Narrative in Cyberspace, The Free Press, New York, NY, 1997
• 21: G. Polti and L. Ray (1940). The thirty-six dramatic situations. Boston,, The Writer.
• 22: V. Propp (1968). Morphology of the Folktale, University of Texas Press.
• 23: O. Schneider, N. Braun and G. Habinger (2003). Storylining Suspense - An Authoring Environment for Structuring Non-linear Interactive Narratives, Proceedings of WSCG 2003, Czech Republic,
• 24: Bageshree Shevade , Hari Sundaram, Vidya: an experiential annotation system, Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence, November 07, 2003, Berkeley, California [doi>10.1145/982484.982502]
• 25: H. Sridharan, A. Mani, H. Sundaram, et al. (2004). Geography for Active Learners. Arts Media and Engineering Program, Arizona State University, AME-TR-2004-01, Jan. 2004 http://ame2.asu.edu/groups/xdg/pubs/ame-tr-2004-01.pdf.
• 26: Yanfeng Sun , Hongjiang Zhang , Lei Zhang , Mingjing Li, MyPhotos: a system for home photo management and processing, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641022]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods; User-centered design
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

Keywords:
browser, events, networked media, storytelling