A tale of four kernels

ABSTRACT

The FreeBSD, GNU/Linux, Solaris, and Windows operating systems have kernels that provide comparable facilities. Interestingly, their code bases share almost no common parts, while their development processes vary dramatically. We analyze the source code of the four systems by collecting metrics in the areas of file organization, code structure, code style, the use of the C preprocessor, and data organization. The aggregate results indicate that across various areas and many different metrics, four systems developed using wildly different processes score comparably. This allows us to posit that the structure and internal quality attributes of a working, non-trivial software artifact will represent first and foremost the engineering requirements of its construction, with the influence of process being marginal, if any.

REFERENCES

• 1: L. W. Cannon et al. Recommended C style and coding standards. Available online (February 2008) http://sunland.gsfc.nasa.gov/info/cstyle.html.
• 2: S. N. Cant, D. R. Jeffery, and B. L. Henderson-Sellers. A conceptual model of cognitive complexity of elements of the programming process. Information and Software Technology, 37(7):351--362, June 1995.
• 3: A. Capiluppi and G. Robles, editors. FLOSS ?07: Proceedings of the First International Workshop on Emerging Trends in FLOSS Research and Development. IEEE Computer Society, May 2007.
• 4: Don Coleman , Dan Ash , Bruce Lowther , Paul Oman, Using Metrics to Evaluate Software System Maintainability, Computer, v.27 n.8, p.44-49, August 1994 [doi>10.1109/2.303623]
• 5: M. A. Cusumano and R. W. Selby. Microsoft Secrets. The Free Press, New York, 1995.
• 6: M. A. Cusumano and R. W. Selby. Microsoft Secrets. The Free Press, New York, 1995.
• 7: J. Feller, editor. 5-WOSSE: Proceedings of the Fifth Workshop on Open Source Software Engineering. ACM Press, 2005.
• 8: Joseph Feller , Brian Fitzgerald, Understanding open source software development, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2002
• 9: Joseph Feller , Brian Fitzgerald , Scott A. Hissam , Karim R. Lakhani, Perspectives on Free and Open Source Software, The MIT Press, 2005
• 10: B. Fitzgerald and J. Feller. A further investigation of open source software: Community, co-ordination, code quality and security issues. Information Systems Journal, 12(1):3--5, 2002.
• 11: The FreeBSD Project. Style?Kernel Source File Style Guide, Dec. 1995. FreeBSD Kernel Developer?s Manual: style(9). Available online http://www.freebsd.org/docs.html (January 2006).
• 12: Geoffrey K. Gill , Chris F. Kemerer, Cyclomatic Complexity Density and Software Maintenance Productivity, IEEE Transactions on Software Engineering, v.17 n.12, p.1284-1288, December 1991 [doi>10.1109/32.106988]
• 13: Robert L. Glass, Of Open Source, Linux ... and Hype, IEEE Software, v.16 n.1, p.128-127, January 1999
• 14: Maurice H. Halstead, Elements of Software Science (Operating and programming systems series), Elsevier Science Inc., New York, NY, 1977
• 15: Samuel P. Harbison , Guy L. Steele, Jr., C: a reference manual (3rd ed.), Prentice-Hall, Inc., Upper Saddle River, NJ, 1991
• 16: S. Henry , D. Kafura, Software Structure Metrics Based on Information Flow, IEEE Transactions on Software Engineering, v.7 n.5, p.510-518, September 1981 [doi>10.1109/TSE.1981.231113]
• 17: Jaap-Henk Hoepman , Bart Jacobs, Increased security through open source, Communications of the ACM, v.50 n.1, p.79-83, January 2007 [doi>10.1145/1188913.1188921]
• 18: Daniel M. Hoffman , David M. Weiss, Software fundamentals: collected papers by David L. Parnas, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2001
• 19: Clemente Izurieta , James Bieman, The evolution of FreeBSD and linux, Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering, September 21-22, 2006, Rio de Janeiro, Brazil [doi>10.1145/1159733.1159765]
• 20: Brian W. Kernighan , P. J. Plauger, The Elements of Programming Style, McGraw-Hill, Inc., New York, NY, 1982
• 21: Brian W. Kernighan , P. J. Plauger, The Elements of Programming Style, McGraw-Hill, Inc., New York, NY, 1982
• 22: Zhenmin Li , Shan Lu , Suvda Myagmar , Yuanyuan Zhou, CP-Miner: Finding Copy-Paste and Related Bugs in Large-Scale Software Code, IEEE Transactions on Software Engineering, v.32 n.3, p.176-192, March 2006 [doi>10.1109/TSE.2006.28]
• 23: T. J. McCabe, A Complexity Measure, IEEE Transactions on Software Engineering, v.2 n.4, p.308-320, July 1976 [doi>10.1109/TSE.1976.233837]
• 24: T. J. McCabe, A Complexity Measure, IEEE Transactions on Software Engineering, v.2 n.4, p.308-320, July 1976 [doi>10.1109/TSE.1976.233837]
• 25: D. L. Parnas, On the criteria to be used in decomposing systems into modules, Communications of the ACM, v.15 n.12, p.1053-1058, Dec. 1972 [doi>10.1145/361598.361623]
• 26: James W. Paulson , Giancarlo Succi , Armin Eberlein, An Empirical Study of Open-Source and Closed-Source Software Products, IEEE Transactions on Software Engineering, v.30 n.4, p.246-256, April 2004 [doi>10.1109/TSE.2004.1274044]
• 27: Andreas Polze , Dave Probert, Teaching operating systems: the windows case, Proceedings of the 37th SIGCSE technical symposium on Computer science education, March 03-05, 2006, Houston, Texas, USA
• 28: P. C. Rigby and D. M. German. A preliminary examination of code review processes in open source projects. Technical Report DCS-305-IR, University of Victoria, January 2006.
• 29: Peter H. Salus, A quarter century of UNIX, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1994
• 30: Ioannis Samoladas , Ioannis Stamelos , Lefteris Angelis , Apostolos Oikonomou, Open source software development should strive for even greater code maintainability, Communications of the ACM, v.47 n.10, p.83-87, October 2004 [doi>10.1145/1022594.1022598]
• 31: H. A. Small, editor. Form and Function: Remarks on Art by Horatio Greenough. University of California Press, Berkeley and Los Angeles, 1947.
• 32: S. K. Sowe, I. G. Stamelos, and I. Samoladas, editors. Emerging Free and Open Source Software Practices. IGI Publishing, Hershey, PA, 2007.
• 33: Diomidis Spinellis, Global Analysis and Transformations in Preprocessed Languages, IEEE Transactions on Software Engineering, v.29 n.11, p.1019-1030, November 2003 [doi>10.1109/TSE.2003.1245303]
• 34: Diomidis Spinellis, Global Analysis and Transformations in Preprocessed Languages, IEEE Transactions on Software Engineering, v.29 n.11, p.1019-1030, November 2003 [doi>10.1109/TSE.2003.1245303]
• 35: Diomidis Spinellis, Code Quality: The Open Source Perspective (Effective Software Development Series), Addison-Wesley Professional, 2006
• 36: Diomidis Spinellis , Clemens Szyperski, Guest Editors' Introduction: How Is Open Source Affecting Software Development?, IEEE Software, v.21 n.1, p.28-33, January 2004 [doi>10.1109/MS.2004.1259204]
• 37: R. Stallman et al. GNU coding standards. Available online http://www.gnu.org/prep/standards/ (January 2006), Dec. 2005.
• 38: I. Stamelos, L. Angelis, A. Oikonomou, and G. L. Bleris. Code quality analysis in open source software development. Information Systems Journal, 12(1):43--60, 2002.
• 39: Andrew S. Tanenbaum, Operating systems: design and implementation, Prentice-Hall, Inc., Upper Saddle River, NJ, 1987
• 40: Linus Torvalds , David Diamond, Just for Fun: The Story of an Accidental Revolutionary, HarperInformation, 2001
• 41: Georg von Krogh , Eric von Hippel, The Promise of Research on Open Source Software, Management Science, v.52 n.7, p.975-983, July 2006 [doi>10.1287/mnsc.1060.0560]
• 42: Liguo Yu , Stephen R. Schach , Kai Chen , Gillian Z. Heller , Jeff Offutt, Maintainability of the kernels of open-source operating systems: a comparison of linux with FreeBSD, NetBSD, and OpenBSD, Journal of Systems and Software, v.79 n.6, p.807-815, June 2006 [doi>10.1016/j.jss.2005.08.014]
• 43: Liguo Yu , Stephen R. Schach , Kai Chen , Jeff Offutt, Categorization of Common Coupling and Its Application to the Maintainability of the Linux Kernel, IEEE Transactions on Software Engineering, v.30 n.10, p.694-706, October 2004 [doi>10.1109/TSE.2004.58]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.9 Management
          Subjects: Software process models (e.g., CMM, ISO, PSP)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Product metrics

General Terms:
Measurement

Keywords:
comparison, freebsd, linux, open source, opensolaris, proprietary software, wrk