Momento: support for situated ubicomp experimentation

ABSTRACT

We present the iterative design of Momento, a tool that providesintegrated support for situated evaluation of ubiquitouscomputing applications. We derived requirements for Momento from a user-centered design process that includedinterviews, observations and field studies of early versionsof the tool. Motivated by our findings, Momento supportsremote testing of ubicomp applications, helps with participantadoption and retention by minimizing the need for newhardware, and supports mid-to-long term studies to addressinfrequently occurring data. Also, Momento can gather logdata, experience sampling, diary, and other qualitative data.

REFERENCES

• 1: M. Ananny, K. Biddick, and C. Strohecker. Constructing public discourse with ethnographic/SMS "texts?". In MobileHCI'03, 368--373, 2003.
• 2: Steve Benford , Andy Crabtree , Martin Flintham , Adam Drozd , Rob Anastasi , Mark Paxton , Nick Tandavanitj , Matt Adams , Ju Row-Farr, Can you see me now?, ACM Transactions on Computer-Human Interaction (TOCHI), v.13 n.1, p.100-133, March 2006 [doi>10.1145/1143518.1143522]
• 3: A. H. Betiol and W. de Abreu Cybis. Usability testing of mobile devices: A comparison of three approaches. In IFIP INTERACT'05, 470--481, 2005.
• 4: Scott Carter , Jennifer Mankoff, When participants do the capturing: the role of media in diary studies, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055098]
• 5: S. Carter, J. Mankoff, S. Klemmer, and T. Matthews. Exiting the cleanroom: On ecological validity and ubiquitous computing. HCI Journal. To appear.
• 6: Sunny Consolvo , Miriam Walker, Using the Experience Sampling Method to Evaluate Ubicomp Applications, IEEE Pervasive Computing, v.2 n.2, p.24-31, April 2003 [doi>10.1109/MPRV.2003.1203750]
• 7: Andy Crabtree , Steve Benford , Chris Greenhalgh , Paul Tennent , Matthew Chalmers , Barry Brown, Supporting ethnographic studies of ubiquitous computing in the wild, Proceedings of the 6th conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142417]
• 8: Nigel Davies , James Landay , Scott Hudson , Albrecht Schmidt, Guest Editors' Introduction: Rapid Prototyping for Ubiquitous Computing, IEEE Pervasive Computing, v.4 n.4, p.15-17, October 2005 [doi>10.1109/MPRV.2005.78]
• 9: A. K. Dey, G. D. Abowd, and D. Salber. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. HCI Journal, 16(2-4):97--166, 2001.
• 10: Steven Dow , Jaemin Lee , Christopher Oezbek , Blair MacIntyre , Jay David Bolter , Maribeth Gandy, Wizard of Oz interfaces for mixed reality applications, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056911]
• 11: J. Froehlich, M. Y. Chen, I. E. Smith, and F. Potter. Voting with you feet: An investigative study of the relationship between place visit behavior and preference. In Ubicomp'06, 333--350, 2006.
• 12: John Halloran , Eva Hornecker , Geraldine Fitzpatrick , Mark Weal , David Millard , Danius Michaelides , Don Cruickshank , David De Roure, Unfolding understandings: co-designing UbiComp In Situ, over time, Proceedings of the 6th conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142423]
• 13: Björn Hartmann , Scott R. Klemmer , Michael Bernstein , Leith Abdulla , Brandon Burr , Avi Robinson-Mosher , Jennifer Gee, Reflective physical prototyping through integrated design, test, and analysis, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166300]
• 14: Jeffrey Heer , Stuart K. Card , James A. Landay, prefuse: a toolkit for interactive information visualization, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055031]
• 15: R. M. Hogarth. Is confidence in decisions related to feedback? In K. Fiedler and P. Juslin, editors, In the beginning there is a sample: Information sampling as a key to understand adaptive cognition. Cambridge University Press, 2004.
• 16: Sami Hulkko , Tuuli Mattelmäki , Katja Virtanen , Turkka Keinonen, Mobile probes, Proceedings of the third Nordic conference on Human-computer interaction, p.43-51, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028020]
• 17: Giovanni Iachello , Khai N. Truong , Gregory D. Abowd , Gillian R. Hayes , Molly Stevens, Prototyping and sampling experience to evaluate ubiquitous computing privacy in the real world, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124923]
• 18: Infotrends. Mobile Imaging Study. http://www.capv.com/home/Multiclient/mobileimaging2.html, 2006.
• 19: S. S. Intille, E. M. Tapia, J. Rondoni, J. Beaudin, C. Kukla, S. Agarwal, L. Bao, and K. Larson. Tools for studying behavior and technology in natural settings. In Ubicomp'03, 157--174, 2003.
• 20: A. Kaikkonen, A. Kekäläinen, M. Cankar, T. Kallio, and A. Kankainen. Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies, 1(1):4--17, 2005.
• 21: J. Kjeldskov, M. B. Skov, B. S. Als, and R. T. Høegh. Is it worth the hassle? Exploring the added value of evaluating the usability of context-aware mobile systems in the field. In MobileHCI'04, 61--73, 2004.
• 22: Scott R. Klemmer , Anoop K. Sinha , Jack Chen , James A. Landay , Nadeem Aboobaker , Annie Wang, Suede: a Wizard of Oz prototyping tool for speech user interfaces, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.1-10, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354406]
• 23: Yang Li , Jason I. Hong , James A. Landay, Topiary: a tool for prototyping location-enhanced applications, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029671]
• 24: T. Matthews, S. Carter, J. Fong, C. Pai, and J. Mankoff. Scribe4me: Evaluating a mobile sound translation tool for the deaf. In Ubicomp'06, 159--176, 2006.
• 25: Allistair Morrison , Paul Tennent , Matthew Chalmers, Coordinated Visualisation of Video and System Log Data, Proceedings of the Fourth International Conference on Coordinated & Multiple Views in Exploratory Visualization, p.91-102, July 04-04, 2006 [doi>10.1109/CMV.2006.5]
• 26: Nancy A. Van House, Interview viz: visualization-assisted photo elicitation, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125720]
• 27: Alexandra Weilenmann, Negotiating Use: Making Sense of Mobile Technology, Personal and Ubiquitous Computing, v.5 n.2, p.137-145, July 2001 [doi>10.1007/PL00000015]
• 28: D. Zhang and B. Adipat. Challenges, methodologies, and issues in the usability testing of mobile applications. IJHCI, 18(3):293--308, 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Experimentation, Human Factors

Keywords:
Wizard of Oz, diary sudies, experience sampling, mobile devices, rapid prototyping