Story reaction structures to emotion detection

ABSTRACT

We have developed a model of "story viewer emotion" in order to understand how emotional viewing could be coded and that has led us to the devising of "emotional film structures". We then established direct relations between the viewer model and the elicitation film structure, taking into account the standard interactions between oral storyteller and story-listeners in order to categorize the possible story reactions toward user emotions in real time. In the end we present a case study of a hypothetic usage of "emotion detection" in a The Silence of the Lambs sequence.

REFERENCES

• 1: Frijda, N.H., The Emotions, Studies in Emotion and Social Interaction, Cambridge University Press, Cambridge, 1986.
• 2: Tan, Ed S., Emotions and the Structure of Narrative Film: Film as an Emotion Machine, Mahwah, NJ: Lawrence Erlbaum Associates, 1996.
• 3: Damásio, António, (1994), O Erro de Descartes, trad. Vicente, D. e Segurado, G., Pub. Europa-América, Lisboa, 1995
• 4: Affective Computing Group, <http://affect.media.mit.edu>
• 5: Ekman, P., Friesen, W., Hager, J., Facial Action Coding System Investigator's Guide, <http://face-and-emotion.com/dataface/facs/guide/FACSIVTi.html> , 2002 {online: 13/06/2004}
• 6: Cohn, J. F. & Kanade, T. (In press). "Use of automated facial image analysis for measurement of emotion expression". In J. A. Coan & J. B. Allen (Eds.), The handbook of emotion elicitation and assessment. Oxford University Press Series in Affective Science. New York
• 7: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 8: Rosalind W. Picard, Jonathan Klein (2002), "Computers that Recognise and Respond to User Emotion: Theoretical and Practical Implications", Interacting with Computers, 14,2 (2002), 141--169
• 9: Jonathan Sykes , Simon Brown, Affective gaming: measuring emotion through the gamepad, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765957]
• 10: Bordwell, David (1985), Narration in the Fiction Film, Routledge, London
• 11: Lipman, Doug, Improving Your Storytelling: Beyond the Basics for All Who Tell Stories in Work or Play, August House Publishers, 1999
• 12: Barthes, R. (1966), Introduction to the structural analysis of narratives, in Image-Music-Text, London, Fontana, 1977
• 13: Ekman, P., "Facial expression of emotion", American Psychologist, 48, 384--392, 1993, <http://www.paulekman.com/articles.php> , {online: 13/06/2004}
• 14: Damásio, António, (1999), O Sentimento de Si, trad. M.F.M., Pub. Europa-América, Lisboa, 2000
• 15: Russell, J.A., A circumplex model of affect, Journal of Personality and Social Psychology, 39, 1161--1178, 1980
• 16: Simons, R.F., Detenber, B.H., Roedema, T.M. & Reiss, J.E. (1999), Emotion-Processing in Three Systems: The Medium and the Message, Psychophysiology, 36, 619-627.
• 17: Goleman, Daniel,(1995), "Inteligência Emocional", Temas e Debates, Lisboa, 1997
• 18: Zillmann, D., "Mood Management: Using entertainment to full advantage", in Donohew, L, et al (eds.), Comunication, social cognition and affect, Lawrence Erlbaum, Hillsdale, (pp.147--171) 1988
• 19: Emmerich, Roland, (2004), "The Day After Tomorrow", 20th Century Fox
• 20: Hitchcock, Alfred, (1960), "Psycho", Universal Home Entertainment, 1998, USA, DVD
• 21: Demme, Jonathan, (1991), "Silence of The lambs", Criterion Collection, 1998, USA, DVD
• 22: Del Toro, Gillermo, (2002), "Blade 2", New Line Cinema, 2002, USA, DVD
• 23: Zagalo, N., Branco, V., Barker, A.,"Emoçࢳo e Suspense no Storytelling Interactivo", in Proceedings of Games2004, Universidade de Lisboa, Portugal, 12 July, 2004
• 24: Gordon, Robert M. e Cruz, Joe, (2003) "Simulation Theory", in Encyclopedia of Cognitive Science, eds. Lynn Nadel.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Software psychology

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models

  J. Computer Applications
  J.5 ARTS AND HUMANITIES

General Terms:
Design, Human Factors, Standardization, Theory

Keywords:
affective computing, emotion, film study, interaction design, story representation, storytelling