The diary study: a workplace-oriented research tool to guide laboratory efforts

ABSTRACT

Methods for studying user behavior in HCI can be informally divided into two approaches: experimental psychology in the laboratory and observations in the workplace. The first approach has been faulted for providing results that have little effect on system usability, while the second can often be accused of yielding primarily anecdotal data that do not support general conclusions. This paper describes two similar approaches in another field, the study of animal behavior, and shows how they produce complementary results. To support similar complementary interactions between research approaches in the HCI field, the paper describes the diary study technique, a tool for research in the workplace that achieves a relatively high standard of objectivity. A diary study is reported that focuses on exploratory learning.

REFERENCES

• 1: Brain, P.F. Ethology and experimental psychology: from confrontation to parmership. In Ethoexperimental Approaches to the Study of Behavior, R.J. Blanchard, P.F. Brain, D.C. Blanchard, and S. Parmigiani, Eds., Kluwer, Dordrecht, The Netherlands, 1989, pp. 19-27.
• 2: Carroll, J.M., Mack, R.L., Lewis, C.H., Grischkowsky, N.L., and Robertson, S.P. Exploring a word processor. Human Computer Interaction I (1985), 283-307.
• 3: Ericsson, K. Anders, Tesch-R~imer, C., and Krampe, R.T. The role of practice and motivation in the acquisition of expert-level performance in real life: An empirical evaluation of a theoretical framework. In Encouraging the Development of Exceptional Skills and Talents, M.J.A. Howe, Ed., The British Psychological Society, Leicester, 1990, pp. 109-130.
• 4: Fantino, E., and Abarca, N. Choice, optimal foraging, and the delay-reduction hypothesis. Behavioral and Brain Sciences 8 (1985), 315-330.
• 5: Floyd, C., Wolf-Michael, M, Reisin, F.-M., Schmidt, G., and Wolf, G. Out of Scandinavia: Alternative approaches to software design and system development. Human-Computer Interaction 4 (1989), 253-350.
• 6: John D. Gould , Stephen J. Boies , Clayton Lewis, Making usable, useful, productivity-enhancing computer applications, Communications of the ACM, v.34 n.1, p.74-85, Jan. 1991 [doi>10.1145/99977.99993]
• 7: Houston, A., Kacelnik, A., and McNamara, J. Some learning rules for acquiring information. In Functional Ontogony, David McFarland, Ed., Pitman, London, 1982, pp. 140-190.
• 8: Juster, F.T., and Stafford, F.P. (Eds.) Time, Goods and Well-being. Institute for Social Research, The University of Michigan, Ann Arbor, Mich., 1985.
• 9: Kamil, A.C., and Balda, R.P. Cache recovery and spatial memory in Clark's Nutcrackers. J. Exp. Psych., Animal Behavior Processes 11 (1985), 95-111.
• 10: Landauer, T.K., Research methods in human computer interaction. In Handbook of Human-Computer Interaction, M. Helander, Ed., Elsevier Science, Amsterdam, 1988, pp. 905-928.
• 11: Lewis, C. Using thinking aloud protocols to study the "cognitive interface." Research Report RC 9265, IBM Thomas J. Watson Research Center, Yorktown Heights, N.Y., 1982.
• 12: Miller, D. B. Methodological issues in the ecological study of learning. In Issues in the Ecological Study of Learning, T.D. Johnston and A.T. Pietrewicz, Eds., Lawrence Erlbaum, Hillsdale, N.J., 1985, pp. 73-95.
• 13: Jeff Shrager , David Klahr, Instructionless learning about a complex device: the paradigm and observations, International Journal of Man-Machine Studies, v.25 n.2, p.153-189, Aug. 1986 [doi>10.1016/S0020-7373(86)80075-X]
• 14: Suchman, L. A. Plans and Situated Actions. Cambridge, England: Cambridge University Press, 1987.
• 15: Tomback, D.F. Foraging strategies of Clark's Nutcracker. Living Bird 16 (1978), 123-161.
• 16: Vander Wall, S.B. An experimental analysis of cache recovery in Clark's Nutcracker. Animal Behavior 30 (1982), 84-94.
• 17: Vander Wall, S.B., and Balda, R.P. Coadaptations of the Clark's Nutcracker and the piflion pine for efficient seexl harvest and dispersal. Ecological Monographs 47 (1977), 89-111.
• 18: Dennis Wixon , Karen Holtzblatt , Stephen Knox, Contextual design: an emergent view of system design, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.329-336, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97304]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Training

General Terms:
Design, Human Factors, Management

Keywords:
diary studies, exploratory learning, methodologies, participatory design, situated cognition