Voice-mail diary studies for naturalistic data capture under mobile conditions

ABSTRACT

Mobile technology requires new methods for studying its use under realistic conditions "in the field." Reflexively, mobile technology also creates new opportunities for data collection while participants are remotely located. We report on our experiences with a variation on the paper-based diary study technique, which we extend by using voice-mail paired with mobile and landline telephony to more easily collect data in natural situations. We discuss lessons learned from experiences with voice-mail diary studies in two investigations of different scope. We also present suggestions for tailoring the technique to different research objectives, garnering high subject participation, and configuring the voice-mail system for data collection.

REFERENCES

• 1: Annette Adler , Anuj Gujar , Beverly L. Harrison , Kenton O'Hara , Abigail Sellen, A diary study of work-related reading: design implications for digital reading devices, Proceedings of the SIGCHI conference on Human factors in computing systems, p.241-248, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274679]
• 2: Barry A. T. Brown , Abigail J. Sellen , Kenton P. O'Hara, A diary study of information capture in working life, Proceedings of the SIGCHI conference on Human factors in computing systems, p.438-445, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332472]
• 3: Carayon, P. and Hajnal, C. (1993). "A Diary Study of Computer Use and Worker Stress: Preliminary Results VI. Longitudinal Studies," Proceedings of the Fifth International Conference on Human-Computer Interaction, p. 715--720.
• 4: Chin, J. P., Herring, R. D. and Familant, M. E. (1992) "A Usability and Diary Study Assessing the Effectiveness of Call Acceptance Lists," Proceedings of the Human Factors Society 36th Annual Meeting, v.1 p. 216--220
• 5: Csikszentmihalyi, M., Larson, R., & Prescott, S. (1977). The ecology of adolescent activity and experience. Journal of Youth and Adolescence, v. 6(3), p. 281-94.
• 6: Csikszentmihalyi, M., Rathunde, K. and Whalen, S. (1993). Talented Teenagers: The Roots of Success and Failure. New York: Cambridge University Press.
• 7: Margery Eldridge , William Newman, Agenda benders: modelling the disruptions caused by technology failures in the workplace, Conference companion on Human factors in computing systems: common ground, p.219-220, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/257089.257290]
• 8: Grinter, R. and Eldridge, M. (2001). "y do tngrs luv 2 txt msg?" Proceedings of 7th European Conference on Computer Supported Cooperative Work (ECSCW '01), Bonn, Germany, p. 219--238.
• 9: Jurek Kirakowski , M. Corbett, Effective Methodology for the Study of HCI, Elsevier Science Inc., New York, NY, 1990
• 10: Larson, R. & Csikszentmihalyi, M. (1983). The Experience Sampling Method. In H. T. Reis (Ed.), Naturalistic approaches to studying social interaction: New Directions for Methodology of Social and Behavioral Science. San Francisco, CA: Jossey-Bass.
• 11: Marilyn Salzman , Leysia Palen , Richard Harper, Mobile communications: understanding users, adoption, and design, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634343]
• 12: William Newman , Margery Eldridge , Richard Harper, Modelling last-minute authoring: does technology add value or encourage tinkering?, Conference companion on Human factors in computing systems: common ground, p.221-222, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/257089.257291]
• 13: Norman, D. A. (1981). Categorization of action slips. Psychology Review, v. 88(1), p. 1--15.
• 14: Kenton O'Hara , Mark Perry , Abigail Sellen , Barry Brown, Exploring the relationship between mobile phone and document activity during business travel, Wireless world: social and interactional aspects of the mobile age, Springer-Verlag New York, Inc., New York, NY, 2001
• 15: Kenton O'Hara , Mark Perry, Shopping anytime anywhere, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634271]
• 16: Leysia Palen , Marilyn Salzman , Ed Youngs, Going wireless: behavior & practice of new mobile phone users, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.201-210, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358991]
• 17: Leysia Palen , Marilyn Salzman, Beyond the handset: designing for wireless communications usability, ACM Transactions on Computer-Human Interaction (TOCHI), v.9 n.2, p.125-151, June 2002 [doi>10.1145/513665.513669]
• 18: John Rieman, The diary study: a workplace-oriented research tool to guide laboratory efforts, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169255]
• 19: Robinson, R. (1996). "Panel The Participatory Design of Work Space," Harrison, S. (Panel Organizer), Proceedings of the 1996 Conference on Participatory Design, Cambridge, MA, p. 161--162.
• 20: Sellen, A.J. (1994). Detection of everyday errors. Applied Psychology: An International Review (Special issue on error detection), v. 43(4), p. 475--498.
• 21: Abigail Sellen , Richard Harper, Paper as an analytic resource for the design of new technologies, Proceedings of the SIGCHI conference on Human factors in computing systems, p.319-326, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258780]
• 22: The Sonic Memorial Project: A Nationwide Public Radio Collaboration (Launched October 2001), http://www.sonicmemorial.org/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.1 Systems and Information Theory
          Subjects: Information theory

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.1 Systems and Information Theory
          Subjects: Value of information
      H.1.2 User/Machine Systems
          Subjects: Human information processing; Human factors

General Terms:
Human Factors, Theory

Keywords:
CSCW, HCI, diary study, mobile computing, mobility, naturalistic study, phones, usability, voice-mail