Realising evidence-based software engineering a report from the workshop held at ICSE 2005

ABSTRACT

Context: The workshop was held to explore the potential for adapting the ideas of evidence-based practices as used in medicine and other disciplines for use in software engineering.Objectives: To devise ways of developing suitable evidence-based practices and procedures, especially the use of structured literature reviews, and introducing these into software engineering research and practice.Method: Three sessions were dedicated to a mix of presentations based on position papers and interactive discussion, while the fourth focused upon the key issues as decided by the participants.Results: An initial scoping of the major issues, identification of useful parallels, and some plans for future development of an evidence-based software engineering community.Conclusions: While there are substantial challenges to introducing evidence-based practices, there are useful experiences to be drawn from a variety of other domains.

REFERENCES

• 1: Ackoff R. L. From Data to Wisdom, J of Applied Systems Analysis, 16, 1989, 3--9.
• 2: F. P. Brooks, Grasping reality through illusion—interactive graphics serving science, Proceedings of the SIGCHI conference on Human factors in computing systems, p.1-11, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57168]
• 3: Marcus Ciolkowski , Jürgen Münch, Accumulation and presentation of empirical evidence: problems and challenges, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-3, May 17-17, 2005, St. Louis, Missouri
• 4: Glass R. L, Vessey I. and Ramesh V. Research in software engineering: an analysis of the literature. Information & Software Technology, 44, 2002, 491--506.
• 5: Robert L. Glass , V. Ramesh , Iris Vessey, An analysis of research in computing disciplines, Communications of the ACM, v.47 n.6, p.89-94, June 2004 [doi>10.1145/990680.990686]
• 6: Bonnie E. John, Evidence-based practice in human-computer interaction and evidence maps, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 7: Barbara A. Kitchenham , Tore Dyba , Magne Jorgensen, Evidence-Based Software Engineering, Proceedings of the 26th International Conference on Software Engineering, p.273-281, May 23-28, 2004
• 8: Barbara Kitchenham , David Budgen , Pearl Brereton , Step Hen Linkman, Realising evidence-based software engineering, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-3, May 17-17, 2005, St. Louis, Missouri
• 9: WenQian Liu , Charles L. Chen , Vidya Lakshminarayanan , Dewayne E. Perry, A design for evidence - based soft research, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-7, May 17-17, 2005, St. Louis, Missouri
• 10: Austen Rainer , Dorota Jagielska , Tracy Hall, Software engineering practice versus evidence-based software engineering research, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 11: Judith Segal , Antony Grinyer , Helen Sharp, The type of evidence produced by empirical software engineers, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-4, May 17-17, 2005, St. Louis, Missouri
• 12: Rob Weaver , Georgios Despotou , Tim Kelly , John McDermid, Combining software evidence: arguments and assurance, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-7, May 17-17, 2005, St. Louis, Missouri
• 13: Laurie Williams , Lucas Layman , Pekka Abrahamsson, On establishing the essential components of a technology-dependent framework: a strawman framework for industrial case study-based research, Proceedings of the 2005 workshop on Realising evidence-based software engineering, p.1-5, May 17-17, 2005, St. Louis, Missouri

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.0 General

General Terms:
Experimentation, Measurement

Keywords:
evidence