Theoretical foundations for experiential systems design

ABSTRACT

As multimedia researchers analyze and design "experiential systems' there is a pressing need to place that work on a solid theoretical foundation. Without careful analysis of the objects and methods, terminology, and conceptual frameworks of experiential systems design, misconceptions about what experiences are and how they can be computationally addressed can allow research to proceed in less fruitful directions. This paper addresses core theoretical issues in experiential systems design about the nature of experience, especially the distinction between data which can be represented computationally and experiences which are internal mental events We draw from theoretical work in the humanities that addresses models of human communication and meaning creation, the philosophical investigation of the structures of lived experience (phenomenology), and the application of that philosophical method to understanding the forms and functions of mediated experience (aesthetics). Phenomenology and aesthetics form a theoretical foundation for reassessing the limits and possibilities of computationally modeling and shaping experiences. Radically interdisciplinary work is required that truly integrates technical and humanistic research in order to design experiential systems.

REFERENCES

• 1: Armstrong, P. B. Phenomenology. in Groden, M. and Kreiswirth, M. eds. The Johns Hopkins Guide to Literary Theory and Criticism, Johns Hopkins University Press, Baltimore, Maryland, 1997.
• 2: Bazin, A. What is Cinema? University of California Press, Berkeley, 1971.
• 3: Bordwell, D. Narration in the Fiction Film. University of Wisconsin Press, Madison, 1985.
• 4: Bordwell, D. and Thompson, K. Film Art: An Introduction. McGraw Hill, New York, 2003.
• 5: Davis, M. and Travers, M. A Brief Overview of the Narrative Intelligence Reading Group. in Mateas, M. and Sengers, P. eds. Narrative Intelligence, John Benjamins, Amsterdam, 2003, 27--38.
• 6: Descartes, R., Spinoza, B. d. and Leibniz, G. W. The Rationalists. Doubleday, Garden City, New York, 1961.
• 7: Eisenstein, S. M. Film Form: Essays in Film Theory. Harcourt Brace Jovanovich, Publishers, San Diego, 1949.
• 8: Eisenstein, S. M. The Film Sense. Harcourt Brace Jovanovich, Publishers, San Diego, 1947.
• 9: Gadamer, H. G. Philosophical Hermeneutics. University of California Press, Berkeley, 1976.
• 10: Iser, W. The Act of Reading: A Theory of Aesthetic Response. The Johns Hopkins University Press, Baltimore, Maryland, 1978.
• 11: Iser, W. The Reading Process: A Phenomenological Approach. in The Implied Reader: Patterns of Communication in Prose Fiction from Bunyan to Beckett, The Johns Hopkins University Press, Baltimore, Maryland, 1974, 274--294.
• 12: Ramesh Jain, Experiential computing, Communications of the ACM, v.46 n.7, July 2003 [doi>10.1145/792704.792729]
• 13: Locke, J., Berkeley, G. and Hume, D. The Empiricists. Anchor Books/Doubleday, New York, 1990.
• 14: Manovich, L. The Language of New Media. The MIT Press, Cambridge, Massachusetts, 2001.
• 15: Merleau-Ponty, M. Phenomenology of Perception. Routledge & Kegan Paul, London, 1962.
• 16: Reddy, M. The Conduit Metaphor: A Case of Frame Conflict in Our Language about Language. in Ortony, A. ed. Metaphor and Thought, Cambridge University Press, Cambridge England; New York, NY, 1993, 164--201.
• 17: Saussure, F. d. Course in General Linguistics. McGraw-Hill, New York, 1983.
• 18: Tompkins, J. Reader-Response Criticism. The Johns Hopkins University Press, 1980.
• 19: Varela, F. J. The Specious Present: A Neurophenomenology of Time Consciousness. in Petitot, J., Varela, F. J., Pachoud, B. and Roy, J.-M. eds. Naturalizing Phenomenology: Issues in Contemporary Phenomenology and Cognitive Science, Stanford University Press, Stanford, California, 1999, 266--314.
• 20: Terry Winograd , Fernando Flores, Understanding Computers and Cognition: A New Foundation for Design, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.1 Systems and Information Theory
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General
          Subjects: Philosophical foundations

  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES
      Subjects: Psychology; Sociology
  J.5 ARTS AND HUMANITIES
      Subjects: Performing arts (e.g., dance, music); Fine arts

General Terms:
Design, Experimentation, Human Factors

Keywords:
aesthetics, cognitive science, communications theory, conduit metaphor, context, experiential systems, hermeneutics, interdisciplinary research, phenomenology, reader-response, reception aesthetics, representation