A methodological leg to stand on: lessons learned using grounded theory to study software development

ABSTRACT

We are engaged in a qualitative research project to understand how people manage the process of software development. This study uses grounded theory as its method of inquiry and we have learned much about what is and what is not a grounded theory. We, like many researchers have claimed to follow grounded theory methods and even to have produced a grounded theory. In reality, we often only borrow a few grounded theory practices to categorize our data. This paper presents lessons learned about using grounded theory so that both researchers and reviewers can critically evaluate investigators' claims to be producing grounded theory.

REFERENCES

• 1: A. Cockburn, "People and Methodologies in Software Development," in Faculty of Mathematics and Natural Sciences. vol. Doctor Philosophiae Oslo: University of Oslo, 2003.
• 2: AgileAlliance, "Manifesto for Agile Software Development," 2001.
• 3: Barbara A. Kitchenham , Shari Lawrence Pfleeger , Lesley M. Pickard , Peter W. Jones , David C. Hoaglin , Khaled El Emam , Jarrett Rosenberg, Preliminary guidelines for empirical research in software engineering, IEEE Transactions on Software Engineering, v.28 n.8, p.721-734, August 2002 [doi>10.1109/TSE.2002.1027796]
• 4: Carmen Zannier , Grigori Melnik , Frank Maurer, On the success of empirical studies in the international conference on software engineering, Proceedings of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China [doi>10.1145/1134285.1134333]
• 5: Dewayne E. Perry , Adam A. Porter , Lawrence G. Votta, Empirical studies of software engineering: a roadmap, Proceedings of the Conference on The Future of Software Engineering, p.345-355, June 04-11, 2000, Limerick, Ireland [doi>10.1145/336512.336586]
• 6: Carolyn B. Seaman, Qualitative Methods in Empirical Studies of Software Engineering, IEEE Transactions on Software Engineering, v.25 n.4, p.557-572, July 1999 [doi>10.1109/32.799955]
• 7: Mary Shaw, Writing good software engineering research papers: minitutorial, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon
• 8: Robert L. Glass , Iris Vessey , V. Ramesh, RESRES: The story behind the paper "Research in software engineering: An analysis of the literature", Information and Software Technology, v.51 n.1, p.68-70, January, 2009 [doi>10.1016/j.infsof.2008.09.015]
• 9: J. W. Creswell, Qualitative Inquiry and Research Design: Choosing Among the Five Traditions. London: Sage Publications, 1997.
• 10: B. G. Glaser and A. Strauss, The Discovery of Grounded Theory: Strategies for Qualitative Research. Chicago, Illinois: Aldine, 1967.
• 11: A. Strauss and J. Corbin, Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Second Edition: Sage Publications 1998.
• 12: K. Charmaz, Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis Thousand Oaks: Sage, 2006.
• 13: W. J. Orlikowski, "CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development," MIS Quarterly, vol. 17, pp. 309--340, 09 1993.
• 14: Maryam N. Razavi , Lee Iverson, A grounded theory of information sharing behavior in a personal learning space, Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, November 04-08, 2006, Banff, Alberta, Canada [doi>10.1145/1180875.1180946]
• 15: B. H. Hansen and K. Kautz, "Grounded Theory Applied - Studying Information Systems Development Methodologies in Practice," 2005, pp. 264b--264b.
• 16: G. Coleman and R. O'Conner, Software Process In Practice: A Grounded Theory of the Irish Software Industry vol. 4257/2006: Springer Berlin, 2006.
• 17: R. Baskerville and J. Pries-Heje, "Short cycle time systems development," Information Systems Journal, vol. 14, pp. 237--264, 2004.
• 18: Elizabeth Whitworth , Robert Biddle, The Social Nature of Agile Teams, Proceedings of the AGILE 2007, p.26-36, August 13-17, 2007 [doi>10.1109/AGILE.2007.60]
• 19: G. Melnik, "Empirical Analysis of Executable Test Driven Development," in Computer Science. vol. Doctor of Philosophy Calgary: University of Calgary, 2007.
• 20: Donald E. Harter , Mayuram S. Krishnan , Sandra A. Slaughter, Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development, Management Science, v.46 n.4, p.451-466, April 2000 [doi>10.1287/mnsc.46.4.451.12056]
• 21: M. S. Krishnan , C. H. Kriebel , Sunder Kekre , Tridas Mukhopadhyay, An Empirical Analysis of Productivity and Quality in Software Products, Management Science, v.46 n.6, p.745-759, June 2000 [doi>10.1287/mnsc.46.6.745.11941]
• 22: Michael Diaz , Joseph Sligo, How Software Process Improvement Helped Motorola, IEEE Software, v.14 n.5, p.75-81, September 1997 [doi>10.1109/52.605934]
• 23: Capers Jones, Software assessments, benchmarks, and best practices, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2000
• 24: Brian Fitzgerald, An empirical investigation into the adoption of systems development methodologies, Information and Management, v.34 n.6, p.317-328, Dec. 21, 1998 [doi>10.1016/S0378-7206(98)00072-X]
• 25: T. Dyba, N. B. Moe, and E. Arisholm, "Measuring software methodology usage: challenges of conceptualization and operationalization," 2005, p. 11 pp.
• 26: Y. Dubinsky and P. Abrahamsson, "Inaugural International Research-in-Progress Workshop on Agile Software Engineering (RWASE '07)," 2007.
• 27: P. H. Becker, "Common Pitfalls in Published Grounded Theory Research," Qual Health Res, vol. 3, pp. 254--260, May 1, 1993 1993.
• 28: B. G. Glaser, Doing Grounded Theory: Issues and Discussions. Mill Valley, California: Sociology Press, 1998.
• 29: R. S. Schreiber and P. N. Stern, Using Grounded Theory in Nursing. New York: Springer Publishing Company, 2001.
• 30: B. G. Glaser, Theoretical Sensitivity. Mill Valley, California: Sociology Press, 1978.
• 31: B. G. Glaser, Emergence vs Forcing: Basics of Grounded Theory Analysis. Mill Valley, California: Sociology Press, 1992.
• 32: K. M. Eisenhardt, "Building Theories from Case Study Research," The Academy of Management Review, vol. 14, pp. 532--550, 10 1989.
• 33: A. M. McCallin, "Designing a grounded theory study: some practicalities," Nursing in Critical Care, vol. 8, pp. 203--208, 2003.
• 34: B. G. Glaser and A. Strauss, Awareness of Dying. Chicago: Adline 1965.
• 35: E. Whitworth, "Agile Experience: Communication and Collaboration in Agile Software Development Teams," in Psychology. vol. Master of Arts Ottawa: Carleton University, 2006.
• 36: B. G. Glaser, "The Constant Comparative Method of Qualitative Analysis," Social Problems, vol. 12, pp. 436--445, Spring 1965.
• 37: D. Silverman, "The Quality of Qualitative Health Research: The Open-ended Interview and its Alternatives," Social Sciences in Health, vol. 4, pp. 104--118, 1998.
• 38: H. Blumer, Symbolic Interactionism: Perspective and Method: University of California Press, 1969.
• 39: M. Q. Patton, Qualitative Evaluation and Research Methods 2nd ed. Newbury Park, CA: Sage Publications, 1990.
• 40: Cleidson R. B. de Souza , David Redmiles , Li-Te Cheng , David Millen , John Patterson, How a good software practice thwarts collaboration: the multiple roles of APIs in software development, ACM SIGSOFT Software Engineering Notes, v.29 n.6, November 2004
• 41: J. Morse, "Situating Grounded Theory Within Qualitative Inquiry," in Using Grounded Theory in Nursing, R. S. Schreiber and P. N. Stern, Eds. New York: Springer Publishing Company, 2001.
• 42: Y.-H. Jeon, "The application of grounded theory and symbolic interactionism," Scandinavian Journal of Caring Sciences, vol. 18, pp. 249--256, 2004.
• 43: J. Corbin and A. Strauss, "Grounded Theory Research: Procedures, Canons, and Evaluative Criteria," Qualitative Sociology, vol. 13, p. 19, 1990.
• 44: J. Milliken and R. S. Schreiber, "Can You "Do" Grounded Theory Without Symbolic Interactionism?," in Using Grounded Theory in Nursing, R. S. Schreiber and P. N. Stern, Eds. New York: Springer Publishing Company, 2001.
• 45: B. G. Glaser and J. Holton, "Remodeling Grounded Theory," in Forum Qualitative Sozialforschung / Forum: Qualitative Social Research in Nursing & Health. vol. 5, 2004.
• 46: H. S. Wilson and S. A. Hutchinson, "Methodologic Mistakes in Grounded Theory," Nursing Research, vol. 45, pp. 122--124, 1996.
• 47: R. Suddaby, "From the Editors: What Grounded Theory Is Not," Academy of Management Journal, vol. 49, pp. 633--642, 2006.
• 48: W. A. Hall, "The experience of women returning to work following the birth of their first child," Midwifery, vol. 3, pp. 187--195, 1987.
• 49: W. A. Hall and P. Callery, "Enhancing the Rigor of Grounded Theory: Incorporating Reflexivity and Relationality," Qual Health Res, vol. 11, pp. 257--272, March 1, 2001 2001.
• 50: A. M. McCallin, "Pluralistic Dialoging: A Theory of Interdiscplinary Teamwworking," in Grounded Theory Review. vol. 4, 2004.
• 51: M. Sandelowski, "Whatever happened to qualitative description?," Research in Nursing & Health, vol. 23, pp. 334--340, 2000.
• 52: M. T. K. Tan and W. Hall, "Beyond Theoretical and Methodological Pluralism in Interpretive IS Research: The Example of Symbolic Interactionist Ethnography," Communications of the Association for Information Systems, vol. 19, pp. 589--610, 2007.
• 53: J. Q. Benoliel, "Grounded Theory and Nursing Knowledge," Qual Health Res, vol. 6, pp. 406--428, August 1, 1996 1996.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management
          Subjects: Software development

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Evaluation/methodology

General Terms:
Experimentation