Anatomy of a failure: how we knew when our design went wrong, and what we learned from it

ABSTRACT

In this paper, we describe the failure of a novel sensor-based system intended to evoke user interpretation and appropriation in domestic settings. We contrast participants' interactions in this case study with those observed during more successful deployments to identify 'symptoms of failure' under four themes: engagement, reference, accommodation, and surprise and insight. These themes provide a set of sensitivities or orientations that may complement traditional task-based approaches to evaluation as well as the more open-ended ones we describe here. Our system showed symptoms of failure under each of these themes. We examine the reasons for this at three levels: problems particular to the specific design hypothesis; problems relevant for input-output mapping more generally; and problems in the design process we used. We conclude by noting that, although interpretive systems such as the one we describe here may succeed in a myriad of different ways, it is reassuring to know that they can also fail, and fail incontrovertibly, yet instructively.

REFERENCES

• 1: Susanne Bødker, When second wave HCI meets third wave challenges, Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, p.1-8, October 14-18, 2006, Oslo, Norway [doi>10.1145/1182475.1182476]
• 2: Kirsten Boehner , Rogério DePaula , Paul Dourish , Phoebe Sengers, Affect: from information to interaction, Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility, August 20-24, 2005, Aarhus, Denmark [doi>10.1145/1094562.1094570]
• 3: Geoff Cooper , John Bowers, Representing the user: notes on the disciplinary rhetoric of human-computer interaction, The social and interactional dimensions of human-computer interfaces, Cambridge University Press, New York, NY, 1995
• 4: William Gaver, Cultural commentators: Non-native interpretations as resources for polyphonic assessment, International Journal of Human-Computer Studies, v.65 n.4, p.292-305, April, 2007 [doi>10.1016/j.ijhcs.2006.11.014]
• 5: Gaver, W., Bowers, J., Boucher, A., Law, A., and Pennington, S. Electronic furniture for the Curious Home: Assessing ludic designs in the field. International Journal of Human-Computer Interaction, 22, 1-2 (2007), 119--152.
• 6: William Gaver , Phoebe Sengers , Tobie Kerridge , Joseph Kaye , John Bowers, Enhancing ubiquitous computing with user interpretation: field testing the home health horoscope, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240711]
• 7: Harrison S, Tatar D, Sengers P. The three paradigms of HCI. alt.CHI'07. (2007).
• 8: Kristina Höök , Phoebe Sengers , Gerd Andersson, Sense and sensibility: evaluation and interactive art, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642654]
• 9: Katherine Isbister , Kristina Höök , Michael Sharp , Jarmo Laaksolahti, The sensual evaluation instrument: developing an affective evaluation tool, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124946]
• 10: John McCarthy , Peter Wright, Technology as Experience, The MIT Press, 2004
• 11: Mario Romero , Zachary Pousman , Michael Mateas, Tableau machine: an alien presence in the home, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125687]
• 12: Phoebe Sengers , Bill Gaver, Staying open to interpretation: engaging multiple meanings in design and evaluation, Proceedings of the 6th conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142422]
• 13: John Zimmerman , Jodi Forlizzi , Shelley Evenson, Research through design as a method for interaction design research in HCI, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240704]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Design

Keywords:
failure, home, interpretation, ubiquitous computing