Living with tableau machine: a longitudinal investigation of a curious domestic intelligence

ABSTRACT

We present a longitudinal investigation of Tableau Machine, an intelligent entity that interprets and reflects the lives of occupants in the home. We created Tableau Machine (TM) to explore the parts of home life that are unrelated to accomplishing tasks. Task support for "smart homes" has inspired many researchers in the community. We consider design for experience, an orthogonal dimension to task-centric home life. TM produces abstract visualizations on a large LCD every few minutes, driven by a set of four overhead cameras that capture a sense of the social life of a domestic space. The openness and ambiguity of TM allow for a cycle of co-interpretation with householders. We report on three longitudinal deployments of TM for a period of six weeks. Participant families engaged with TM at the outset to understand how their behaviors were influencing the machine, and, while TM remained puzzling, householders interacted richly with TM and its images. We extract some key design implications for an experience-focused smart home.

REFERENCES

• 1: Gregory D. Abowd , Elizabeth D. Mynatt, Charting past, present, and future research in ubiquitous computing, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.29-58, March 2000 [doi>10.1145/344949.344988]
• 2: Genevieve Bell , Mark Blythe , Phoebe Sengers, Making by making strange: Defamiliarization and the design of domestic technologies, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.2, p.149-173, June 2005 [doi>10.1145/1067860.1067862]
• 3: Frank Bentley , Konrad Tollmar , David Demirdjian , Kimberle Koile , Trevor Darrell, Perceptive Presence, IEEE Computer Graphics and Applications, v.23 n.5, p.26-36, September 2003 [doi>10.1109/MCG.2003.1231175]
• 4: Bohlen, M., Mateas, M. Office Plant #1: Intimate Space and Contemplative Entertainment Leonardo. 31.5 (1998).
• 5: William W. Gaver , John Bowers , Andrew Boucher , Hans Gellerson , Sarah Pennington , Albrecht Schmidt , Anthony Steed , Nicholas Villars , Brendan Walker, The drift table: designing for ludic engagement, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.985947]
• 6: William Gaver , John Bowers , Andy Boucher , Andy Law , Sarah Pennington , Nicholas Villar, The history tablecloth: illuminating domestic activity, Proceedings of the 6th conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142437]
• 7: William Gaver , Phoebe Sengers , Tobie Kerridge , Joseph Kaye , John Bowers, Enhancing ubiquitous computing with user interpretation: field testing the home health horoscope, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240711]
• 8: Steve Harrison , Paul Dourish, Re-place-ing space: the roles of place and space in collaborative systems, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.67-76, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240193]
• 9: Mann, S., Nolan, J., Wellman, B. Sousveillance: Inventing and Using Wearable Computing Devices for Data Collection in Surveillance Environments Surveillance Society. 1.3 (2003):331--355.
• 10: John McCarthy , Peter Wright, Technology as Experience, The MIT Press, 2004
• 11: Pamela McCorduck, Aaron's code, W. H. Freeman & Co., New York, NY, 1991
• 12: Michael Mateas , Tony Salvador , Jean Scholtz , Doug Sorensen, Engineering ethnography in the home, Conference companion on Human factors in computing systems: common ground, p.283-284, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/257089.257323]
• 13: Elizabeth D. Mynatt , Jim Rowan , Sarah Craighill , Annie Jacobs, Digital family portraits: supporting peace of mind for extended family members, Proceedings of the SIGCHI conference on Human factors in computing systems, p.333-340, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365126]
• 14: Rogers, Y. Moving on from Weiser's Vision of Calm Computing: Engaging UbiComp Experiences. Proceedings of Ubicomp 2006. LNCS, 2006.
• 15: Mario Romero , Zachary Pousman , Michael Mateas, Alien presence in the home: the design of Tableau Machine, Personal and Ubiquitous Computing, v.12 n.5, p.373-382, June 2008 [doi>10.1007/s00779-007-0190-z]
• 16: Salavon, J. American Varietal. Last Retrieved on April 1, 2008 from http://www.salavon.com/
• 17: Albrecht Schmidt , Lucia Terrenghi, Methods and Guidelines for the Design and Development of Domestic Ubiquitous Computing Applications, Proceedings of the Fifth IEEE International Conference on Pervasive Computing and Communications, p.97-107, March 19-23, 2007 [doi>10.1109/PERCOM.2007.22]
• 18: Smith, A., Romero, M., Pousman, Z., Mateas, M. Tableau Machine: A Creative Alien Presence. AAAI Creative Intelligent Systems Symposium. Stanford University. 2008.
• 19: Sung, J., Guo, L., Grinter, R., Christensen, H. ''My Roomba Is Rambo'': Intimate Home Appliances In Proc. of Ubicomp 2006. pp145--162.
• 20: Lucia Terrenghi , Otmar Hilliges , Andreas Butz, Kitchen stories: sharing recipes with the Living Cookbook, Personal and Ubiquitous Computing, v.11 n.5, p.409-414, June 2007 [doi>10.1007/s00779-006-0079-2]
• 21: Fernanda B. Viégas , Ethan Perry , Ethan Howe , Judith Donath, Artifacts of the Presence Era: Using Information Visualization to Create an Evocative Souvenir, Proceedings of the IEEE Symposium on Information Visualization, p.105-111, October 10-12, 2004 [doi>10.1109/INFOVIS.2004.8]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Keywords:
activity characterization, ambient intelligence, casual information visualization, evaluation techniques, information visualization, interactive art, sensors