Affect: from information to interaction

ABSTRACT

While affective computing explicitly challenges the primacy of rationality in cognitivist accounts of human activity, at a deeper level it relies on and reproduces the same information-processing model of cognition. In affective computing, affect is often seen as another kind of information - discrete units or states internal to an individual that can be transmitted in a loss-free manner from people to computational systems and back. Drawing on cultural, social, and interactional critiques of cognition which have arisen in HCI, we introduce and explore an alternative model of emotion as interaction: dynamic, culturally mediated, and socially constructed and experienced. This model leads to new goals for the design and evaluation of affective systems - instead of sensing and transmitting emotion, systems should support human users in understanding, interpreting, and experiencing emotion in its full complexity and ambiguity.

REFERENCES

• 1: Joseph Bates, The role of emotion in believable agents, Communications of the ACM, v.37 n.7, p.122-125, July 1994 [doi>10.1145/176789.176803]
• 2: A. Batliner , K. Fischer , R. Huber , J. Spilker , E. Nöth, How to find trouble in communication, Speech Communication, v.40 n.1-2, p.117-143, April 2003 [doi>10.1016/S0167-6393(02)00079-1]
• 3: Blythe, M. A., Overbeeke, K., Monk, A. F. and Wright, P. C. (Eds.), Funology: From Usability to Enjoyment. Springer, 2003.
• 4: Boehner, K., Chen, M., and Liu, Z. The Vibe Reflector: An Emergent Impression of Collective Experience. CHI 2003 Workshop on Providing Elegant Peripheral Awareness, 2003.
• 5: Boellstorff, T. and Lindquist, J. Bodies of Emotion; Rethinking Culture and Emotion through Southeast Asia. Ethnos, 69, 4 (2004), 237--444.
• 6: Rodney A. Brooks, Intelligence without representation, Artificial Intelligence, v.47 n.1-3, p.139-159, Jan. 1991 [doi>10.1016/0004-3702(91)90053-M]
• 7: Dolores Cañamero, Modeling motivations and emotions as a basis for intelligent behavior, Proceedings of the first international conference on Autonomous agents, p.148-155, February 05-08, 1997, Marina del Rey, California, United States [doi>10.1145/267658.267688]
• 8: Clark, H. Using Language. Cambridge: Cambridge University Press, 1996.
• 9: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 10: Damasio, A. Descartes' Error: Emotion, Reason and the Human Brain. Quill, 1995.
• 11: Day, R. The Modern Invention of Information. Southern Illinois University Press, 2001.
• 12: Dewey, J. Art as Experience. New York: Perigree, 1934.
• 13: Elliott, C. The Affective Reasoner. PhD Thesis, Northwestern University, Institute for the Learning Sciences Tech. Report #32, 1992.
• 14: Fagerberg, P., Ståhl, A., and Höök, K. Designing Gestures for Affective Input. In Proceedings of Mobile Ubiquitous and Multimedia (MUM) (Norrköping, Sweden, 2003).
• 15: Petra Fagerberg , Anna Ståhl , Kristina Höök, eMoto: emotionally engaging interaction, Personal and Ubiquitous Computing, v.8 n.5, p.377-381, September 2004 [doi>10.1007/s00779-004-0301-z]
• 16: Garfinkel, H. Studies in Ethnomethodology. Polity, 1967.
• 17: Gaver, W., Designing for Homo Ludens. i3 Magazine, 12 (June 2002).
• 18: William W. Gaver , Jacob Beaver , Steve Benford, Ambiguity as a resource for design, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642653]
• 19: William W. Gaver , John Bowers , Andrew Boucher , Hans Gellerson , Sarah Pennington , Albrecht Schmidt , Anthony Steed , Nicholas Villars , Brendan Walker, The drift table: designing for ludic engagement, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.985947]
• 20: Geertz, C. Ritual and Social Change: A Javanese Example. American Anthropologist, 59(1) (1957), 32--54.
• 21: Kristina Höök , Phoebe Sengers , Gerd Andersson, Sense and sensibility: evaluation and interactive art, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642654]
• 22: Jaggar, A. Love and knowledge: Emotion in feminist epistemology. In A. Jaggar and S. Bordo, eds., Gender/Body/Knowledge. NJ: Rutgers, 1989.
• 23: Lutz, C. Unnatural Emotions. Chicago: University of Chicago Press, 1988.
• 24: John McCarthy , Peter Wright, Technology as Experience, The MIT Press, 2004
• 25: Norman, D. Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, 2004.
• 26: Paolo Petta , Robert Trappl, Emotions and agents, Mutli-agents systems and applications, Springer-Verlag New York, Inc., New York, NY, 2001
• 27: Pfeifer, R. (1994). The "Fungus Eater" Approach to Emotion: A View from Artificial Intelligence. Cognitive Studies, 1, 42--57.
• 28: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 29: Reddy, M. J. The conduit metaphor. Metaphor and Thought, A. Ortony (ed). Cambridge University Press, 1993.
• 30: Rosaldo, M. The Shame of Headhunters and the Autonomy of Self. Ethos, 11(3), 1983, 135--151.
• 31: Rosaldo, M. Towards an Anthropology of Self and Feeling. In Sweder and LeVine (eds), Culture Theory: Essays on Mind, Self, and Emotion. Cambridge University Press, 1984.
• 32: Schieffelin, E. Anger and Shame in the Tropical Forest: On Affect as a Cultural System in Papua New Guinea. Ethos, 11(3) (1983), 181--191.
• 33: Schutz, A. The Problem of Rationality in the Social World. Economica, 10 (1943), 130--149.
• 34: Sloman, A. and Croucher, M. Why robots will have emotions. Proceedings of IJCAI 1981 (Vancouver, August 1981).
• 35: Phoebe Sengers , Rainer Liesendahi , Werner Magar , Christoph Seibert , Boris Müller , Thorston Joachims , Weidong Geng , Pia Mårtensson , Kristina Höök, The enigmatics of affect, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778728]
• 36: Suchman, L. Figuring Personhood in Sciences of the Artificial. Department of Sociology, Lancaster University. 2004. http://www.comp.lancs.ac.uk/sociology/papers/suchman-figuring-personhood.pdf.
• 37: Suchman, L. Plans and Situated Actions. Cambridge: Cambridge UP, 1987.
• 38: Petra Sundström , Anna Ståhl , Kristina Höök, eMoto: affectively involving both body and mind, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057078]
• 39: Wittgenstein, L. Philosophical Investigations. Blackwell, 1953.

INDEX TERMS

Keywords:
affective computing, situated action