A case study of open source software development: the Apache server

ABSTRACT

According to its proponents, open source style software development has the capacity to compete successfully, and perhaps in many cases displace, traditional commercial development methods. In order to begin investigating such claims, we examine the development process of a major open source application, the Apache web server. By using email archives of source code change history and problem reports we quantify aspects of developer participation, core team size, code ownership, productivity, defect density, and problem resolution interval for this OSS project. This analysis reveals a unique process, which performs well on important measures. We conclude that hybrid forms of development that borrow the most effective techniques from both the OSS and commercial worlds may lead to high performance software processes.

REFERENCES

• 1: Apache guidelines, at <http://dev.apache.org/guidelines.html>.
• 2: V. R. Basili and D. M. Weiss, "A Methodology for Collecting Valid Software Engineering Data," IEEE Transactions on Software Engineering, vol. 10, no. 6, 1984, pp. 728-738.
• 3: T. Bollinger, R.0 Nelson, K. M. Self, and S. J. Turnbull, "Open- Source Methods: Peering Through the Clutter," IEEE Software, vol. July/August, no. 4, 1999, pp. 8-11.
• 4: A. Carleton, et al., "Software Measurement for DoD Systems: Recommendations for Initial Core Measures," Software Engineering Institute, CMU/SEI-92-TR-19, 1992.
• 5: Bill Curtis , Herb Krasner , Neil Iscoe, A field study of the software design process for large systems, Communications of the ACM, v.31 n.11, p.1268-1287, Nov. 1988 [doi>10.1145/50087.50089]
• 6: Chris DiBona , Sam Ockman , Mark Stone, Open Sources: Voices from the Open Source Revolution, O'Reilly & Associates, Inc., Sebastopol, CA, 1999
• 7: N. Fenton, Software Measurement: A Necessary Scientific Basis, IEEE Transactions on Software Engineering, v.20 n.3, p.199-206, March 1994 [doi>10.1109/32.268921]
• 8: Roy T. Fielding, Shared leadership in the Apache project, Communications of the ACM, v.42 n.4, p.42-43, April 1999 [doi>10.1145/299157.299167]
• 9: James D. Herbsleb , Rebecca E. Grinter, Splitting the organization and integrating the code: Conway's law revisited, Proceedings of the 21st international conference on Software engineering, p.85-95, May 16-22, 1999, Los Angeles, California, United States [doi>10.1145/302405.302455]
• 10: M. Krochmal, "Linux Interest Expanding," in TechWeb, at <http://www.techweb.com/wire/story/TWB19990521S0021>, 1999.
• 11: B. Littlewood , D. R. Miller, Conceptual Modeling of Coincident Failures in Multiversion Software, IEEE Transactions on Software Engineering, v.15 n.12, p.1596-1614, December 1989 [doi>10.1109/32.58771]
• 12: Steve McConnell, After the Gold Rush, IEEE Software, v.16 n.1, p.6-8, January 1999
• 13: Netcraft Survey, at <http://www.netcraft.com/survey>.
• 14: B. Perens, "The Open Source Definition," in Open Sources: Voices from the Open Source Revolution, C. DiBona, S. Ockman, and M. Stone, Eds. Sebastopol, CA: O'Reilly, 1999, pp. 171-188.
• 15: Eric S. Raymond , Tim O'Reilly, The Cathedral and the Bazaar, O'Reilly & Associates, Inc., Sebastopol, CA, 1999
• 16: P. Vixie, "Software Engineering," in Open Sources: Voices from the Open Source Revolution, C. DiBona, S. Ockman, and M. Stone, Eds. Sebastopol, CA: O'Reilly, 1999, pp. 91-100.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management
          Subjects: Software development

Additional Classification:
  C. Computer Systems Organization
  C.5 COMPUTER SYSTEM IMPLEMENTATION

  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.11 Software Architectures
            Subjects: Patterns (e.g., client/server, pipeline, blackboard)

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management
          Subjects: Software process

General Terms:
Design, Management, Measurement, Performance, Theory

Keywords:
code ownership, defect density, open source, repair interval, software process