Investigating the technology-work relationship: a critical comparison of three qualitative field methods

ABSTRACT

Researchers today are increasingly attempting to understand the relationship between technology and work through field methods. Surveying field methods commonly used by researchers to observe such interactions, I critically discuss the assumptions underpinning three methods (ethnography, participatory design, and contextual inquiry) and the strengths and weaknesses of each method. Comparing ways of looking at human-computer interaction across four categories (i.e., theoretical bases, data collection methods, data analysis methods, and design approaches), I provide guidelines for researchers who are considering ways to examine human interaction and work with computer technologies.

REFERENCES

• 1: Gail Bader , James M. Nyce, When only the self is real: theory and practice in the development community, ACM SIGDOC Asterisk Journal of Computer Documentation, v.22 n.1, February 1998 [doi>10.1145/571773.571776]
• 2: Hugh Beyer , Karen Holtzblatt, Contextual design: defining customer-centered systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 3: Blomberg, J. "Ethnography: Aligning Field Studies of Work and System Design." In: A. F. Monk and G. N. Gilbert (Eds.), Perspectives on HCI: Diverse Approaches. New York: Harcourt Brace & Company. 175-198. 1995.
• 4: Blomberg, J., J. Giacomi, A. Mosher, and P. Swenton-Wall. "Ethnographic Field Methods and Their Relation to Design." In: D. Schuler and A. Namioka (Eds.), Participatory design: Principles and practices. Hillsdale, N J: Lawrence Erlbaum Associates. 1993.
• 5: Susanne Bdker, Through the Interface: A Human Activity Approach to User Interface Design, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1991
• 6: Susanne Bødker, Applying activity theory to video analysis: how to make sense of video data in human-computer interaction, Context and consciousness: activity theory and human-computer interaction, Massachusetts Institute of Technology, Cambridge, MA, 1995
• 7: Bodker, S. "Creating Conditions for Participation: Conflicts and Resources in Systems Development." Human-Computerlnteraction. 11: 215-236, 1996b.
• 8: Bodker, S., and K. Gronbaek: "Users and Designers in Mutual Activity: An Analysis of Cooperative Activities in Systems Design." In: Y. Engestr6m and D. Middleton (Eds.), Cognition and Communication at Work. New York: Cambridge University Press. 130-158. 1996.
• 9: Graham Button , Paul Dourish, Technomethodology: paradoxes and possibilities, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.19-26, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238394]
• 10: Cintron, R. "Wearing a Pith Helmet at a Sly Angle: or, Can Writing Researchers Do Ethnography in a Postmodern Era?" Written Communication. 10:371-412, 1993.
• 11: Doheny-Farina, S., and L. Odell. "Ethnographic Research on Writing: Assumptions and Methodology." In: L. Odell and D. Goswami (Eds.), Writing in Non-academic Settings. New York: Guilford Press. 503-535. 1985.
• 12: Dorazio, P., and J. Stovall. "Research in Context: Ethnographic Usability." Journal of Technical Writing and Communication. 27: 57-67, 1997.
• 13: Ehn, P. "Scandinavian Design: On Participation and Skill." In: D. Schuler and A. Namioka (Eds.), Participatory Design: Principles and Practices. Hillsdale, New Jersey: Lawrence Erlbaum Associates. 41-78. 1993.
• 14: John M. Ford , Larry E. Wood, An overview of ethnography and system design, Field methods casebook for software design, John Wiley & Sons, Inc., New York, NY, 1996
• 15: Joan Greenbaum , Morten Kyng, Design at work: cooperative design of computer systems, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1992
• 16: Hackos, J. T., M. Hammar, and A. Elser. "Customer Partnering: Data Gathering for Complex On-Line Documentation." 1EEE Transactions on Professional Communication. 40: 102-110, 1997.
• 17: Karen Holtzblatt , Hugh Beyer, Making customer-centered design work for teams, Communications of the ACM, v.36 n.10, p.92-103, Oct. 1993 [doi>10.1145/163430.164050]
• 18: Karen Holtzblatt , Hugh Beyer, Contextual design: principles and practice, Field methods casebook for software design, John Wiley & Sons, Inc., New York, NY, 1996
• 19: Holtzblatt, K., and S. Jones. "Contextual Inquiry: A Participatory Technique for System Design." In: D. Schuler and A. Namioka (Eds.), Participatory Design: Principles and Practices. Hillsdale, NJ: Lawrence Erlbaum Associates. 1993.
• 20: Morten Kyng , Lars Mathiassen, Computers and design in context, MIT Press, Cambridge, MA, 1997
• 21: Mirel, B. ""Applied Constructivism" for User Documentation." Journal of Business and Technical Communication. 12: 7-49, 1998.
• 22: Anders Mørch, Three levels of end-user tailoring: customization, integration, and extension, Computers and design in context, MIT Press, Cambridge, MA, 1997
• 23: Muller, M. "PICTIVE: Democratizing the Dynamics of the Design Session." In: D. Schuler and A. Namioka (Eds.), Participatory Design: Principles and Practices. Hillsdale, New Jersey: Lawrence Erlbaum Associates. 211. 1993.
• 24: Michael J. Muller , Sarah Kuhn, Participatory design, Communications of the ACM, v.36 n.6, p.24-28, June 1993 [doi>10.1145/153571.255960]
• 25: Aki Helen Namioka , Christopher Rao, Introduction to participatory design, Field methods casebook for software design, John Wiley & Sons, Inc., New York, NY, 1996
• 26: Bonnie A. Nardi, A small matter of programming: perspectives on end user computing, MIT Press, Cambridge, MA, 1993
• 27: Bonnie A. Nardi , Vicki L. O'Day, Information ecologies: using technology with heart, MIT Press, Cambridge, MA, 1999
• 28: James Pycock , Kevin Palfreyman , Jen Allanson , Graham Button, Representing fieldwork and articulating requirements through VR, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.383-392, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289513]
• 29: Judith Ramey , Alan H. Rowberg , Carol Robinson, Adaptation of an ethnographic method for investigation of the task domain in diagnostic radiology, Field methods casebook for software design, John Wiley & Sons, Inc., New York, NY, 1996
• 30: Mary Elizabeth Raven , Alicia Flanders, Using contextual inquiry to learn about your audiences, ACM SIGDOC Asterisk Journal of Computer Documentation, v.20 n.1, p.1-13, Feb. 1996 [doi>10.1145/227614.227615]
• 31: Douglas Schuler , Aki Namioka, Participatory Design: Principles and Practices, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1993
• 32: Lucy A. Suchman, Plans and situated actions: the problem of human-machine communication, Cambridge University Press, New York, NY, 1987
• 33: Tamara Sumner , Markus Stolze, Evolution, not revolution: participatory design in the toolbelt era, Computers and design in context, MIT Press, Cambridge, MA, 1997
• 34: Dennis Wixon , Judith Ramey, Field methods casebook for software design, John Wiley & Sons, Inc., New York, NY, 1996
• 35: Larry E. Wood, The ethnographic interview in user-centered work/task analysis, Field methods casebook for software design, John Wiley & Sons, Inc., New York, NY, 1996
• 36: Shoshana Zuboff, In the age of the smart machine: the future of work and power, Basic Books, Inc., New York, NY, 1988