Interfaces with the ineffable: Meeting aesthetic experience on its own terms

ABSTRACT

A variety of approaches have emerged in HCI that grapple with the ineffable, ill-defined, and idiosyncratic nature of aesthetic experience. The most straightforward approach is to transform the ineffable aspects of these experiences into precise representations, producing systems that are well-defined and testable but may miss the fullness of the experienced phenomenon. But without formal models and codified methods, how can we design and evaluate for a phenomenon we aren't sure can be adequately captured? In this article, we present a case study of a system for reflection and awareness of emotional presence that was, in a sense, lived into being. Through system design, use, and evaluation we recount how the system evolved into something that enhanced rather than impoverished the sympathetic awareness of another. In discussing the strategies and results of the case study, we examine what it means for the HCI community to not only design for aesthetic experiences but also bring aesthetics into the practice of HCI.

REFERENCES

• 1: Jussi Ängeslevä , Carson Reynolds , Sile O'Modhrain, EmoteMail, ACM SIGGRAPH 2004 Posters, August 08-12, 2004, Los Angeles, California [doi>10.1145/1186415.1186426]
• 2: Liam J. Bannon , Susanne Bødker, Beyond the interface: encountering artifacts in use, Designing interaction: psychology at the human-computer interface, Cambridge University Press, New York, NY, 1991
• 3: Susanne Bødker, Understanding representation in design, Human-Computer Interaction, v.13 n.2, p.107-125, June 1998 [doi>10.1207/s15327051hci1302_1]
• 4: Kirsten Boehner , Rogério DePaula , Paul Dourish , Phoebe Sengers, Affect: from information to interaction, Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility, August 20-24, 2005, Aarhus, Denmark [doi>10.1145/1094562.1094570]
• 5: Kirsten Boehner , Rogério DePaula , Paul Dourish , Phoebe Sengers, How emotion is made and measured, International Journal of Human-Computer Studies, v.65 n.4, p.275-291, April, 2007 [doi>10.1016/j.ijhcs.2006.11.016]
• 6: Kirsten Boehner , Janet Vertesi , Phoebe Sengers , Paul Dourish, How HCI interprets the probes, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240789]
• 7: Rodney A. Brooks, Intelligence without representation, Artificial Intelligence, v.47 n.1-3, p.139-159, Jan. 1991 [doi>10.1016/0004-3702(91)90053-M]
• 8: Angela Chang , Ben Resner , Brad Koerner , XingChen Wang , Hiroshi Ishii, LumiTouch: an emotional communication device, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634252]
• 9: Ronald E. Day, The “Conduit Metaphor ” and the nature and politics of information studies, Journal of the American Society for Information Science, v.51 n.9, p.805-811, July 2000 [doi>10.1002/(SICI)1097-4571(2000)51:9<805::AID-ASI30>3.3.CO;2-3]
• 10: Dewey, J. 1934. Art as Experience. Minton, Balch and Company, New York, NY.
• 11: Anind K. Dey , Ed de Guzman, From awareness to connectedness: the design and deployment of presence displays, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124905]
• 12: Paul Dourish , Sara Bly, Portholes: supporting awareness in a distributed work group, Proceedings of the SIGCHI conference on Human factors in computing systems, p.541-547, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142982]
• 13: Paul Dourish, Implications for design, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124855]
• 14: Dunne, A, and Raby, F. 1994. Fields and Thresholds. Presented at Doors of Perception. http://www.mediamatic.nl/Doors/Doors2/DunRab/DunRab-Doors2-E3.html
• 15: Dunne, A. and Raby, F. 2001. Design Noir: The Secret Life of Objects. Birhauser, Basel, Switzerland.
• 16: Daniel Fallman, Design-oriented human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642652]
• 17: Paul A. Fishwick, Aesthetic Computing (Leonardo Books), The MIT Press, 2006
• 18: Gaver, W. 2001. Designing for ludic aspects of everyday life. ERCIM News 47, 20--21.
• 19: William W. Gaver , Jacob Beaver , Steve Benford, Ambiguity as a resource for design, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642653]
• 20: Heidegger, M. 1990. Being and time, John Macquarrie and Edward Robinson, (trans). In The Hermeneutic Tradition: From Ast to Ricoeur, Gayle L. Ormiston and Alan D. Schrift (Eds.). State University of New York Press, Albany, NY.
• 21: Hume, D. 1740. A Treatise of Human Nature (1967, edition). Oxford University Press, Oxford, England.
• 22: Kant, I. 1952. Critique of Judgement. Clarendon Press, Oxford, England.
• 23: Karrie Karahalios , Judith Donath, Telemurals: linking remote spaces with social catalysts, Proceedings of the SIGCHI conference on Human factors in computing systems, p.615-622, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985770]
• 24: Kolko, J. 2007. Thoughts on Interaction Design. Brown Bear LLC, Savannah, GA.
• 25: John McCarthy , Peter Wright, Technology as Experience, The MIT Press, 2004
• 26: John McCarthy , Peter Wright , Jayne Wallace , Andy Dearden, The experience of enchantment in human–computer interaction, Personal and Ubiquitous Computing, v.10 n.6, p.369-378, September 2006 [doi>10.1007/s00779-005-0055-2]
• 27: William J. Mitchell , Alan S. Inouye , Marjory S. Blumenthal, Beyond Productivity: Information, Technology, Innovation, and Creativity, National Academy Press, Washington, DC, 2003
• 28: Nake, F. and Grabowski, S. 2006. The interface as sign and as aesthetic event. In Aesthetic Computing, P., Fishwick (Ed.). MIT Press, Cambridge, MA, 53--70.
• 29: Elin Rønby Pedersen , Tomas Sokoler, AROMA: abstract representation of presence supporting mutual awareness, Proceedings of the SIGCHI conference on Human factors in computing systems, p.51-58, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258584]
• 30: Peters, J. D. 1986. Speaking into the Air. University of Chicago Press, Chicago, IL.
• 31: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 32: Søren Pold, The critical interface, Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility, August 20-24, 2005, Aarhus, Denmark [doi>10.1145/1094562.1094576]
• 33: Phoebe Sengers , Kirsten Boehner , Michael Mateas , Geri Gay, The disenchantment of affect, Personal and Ubiquitous Computing, v.12 n.5, p.347-358, June 2008 [doi>10.1007/s00779-007-0161-4]
• 34: Phoebe Sengers , Chris Csikszentmihályi, HCI and the arts: a conflicted convergence?, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766044]
• 35: Phoebe Sengers , Bill Gaver, Staying open to interpretation: engaging multiple meanings in design and evaluation, Proceedings of the 6th conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142422]
• 36: Phoebe Sengers , Rainer Liesendahi , Werner Magar , Christoph Seibert , Boris Müller , Thorston Joachims , Weidong Geng , Pia Mårtensson , Kristina Höök, The enigmatics of affect, Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778728]
• 37: Shepherd, G. J. 2006. Communication as transcendence. In, Communication as…, G. J. Shepherd et al. (Eds). Sage, Thousand Oaks, CA, 22--30.
• 38: Suchman, L. 1993. Plans and Situated Actions. University of Cambridge Press, Cambridge, England.
• 39: Petra Sundström , Anna Ståhl , Kristina Höök, eMoto: affectively involving both body and mind, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057078]
• 40: Deborah Tatar, The design tensions framework, Human-Computer Interaction, v.22 n.4, p.413-451, November 2007
• 41: Wilson, S. 2002. Information Arts: Intersections of Art, Science, and Technology. MIT Press, Cambridge, MA.
• 42: Terry Winograd , Fernando Flores, Understanding Computers and Cognition: A New Foundation for Design, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987
• 43: Tracee Vetting Wolf , Jennifer A. Rode , Jeremy Sussman , Wendy A. Kellogg, Dispelling "design" as the black art of CHI, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124853]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design

Keywords:
CSCW, Human-computer interaction, ambient displays, experience design