Can developer-module networks predict failures?

ABSTRACT

Software teams should follow a well defined goal and keep their work focused. Work fragmentation is bad for efficiency and quality. In this paper we empirically investigate the relationship between the fragmentation of developer contributions and the number of post-release failures. Our approach is to represent developer contributions with a developer-module network that we call contribution network. We use network centrality measures to measure the degree of fragmentation of developer contributions. Fragmentation is determined by the centrality of software modules in the contribution network. Our claim is that central software modules are more likely to be failure-prone than modules located in surrounding areas of the network. We analyze this hypothesis by exploring the network centrality of Microsoft Windows Vista binaries using several network centrality measures as well as linear and logistic regression analysis. In particular, we investigate which centrality measures are significant to predict the probability and number of post-release failures. Results of our experiments show that central modules are more failure-prone than modules located in surrounding areas of the network. Results further confirm that number of authors and number of commits are significant predictors for the probability of post-release failures. For predicting the number of post-release failures the closeness centrality measure is most significant.

REFERENCES

• 1: Victor R. Basili , Lionel C. Briand , Walcélio L. Melo, A Validation of Object-Oriented Design Metrics as Quality Indicators, IEEE Transactions on Software Engineering, v.22 n.10, p.751-761, October 1996 [doi>10.1109/32.544352]
• 2: Victor R. Basili , Forrest Shull , Filippo Lanubile, Building Knowledge through Families of Experiments, IEEE Transactions on Software Engineering, v.25 n.4, p.456-473, July 1999 [doi>10.1109/32.799939]
• 3: Abraham Bernstein , Jayalath Ekanayake , Martin Pinzger, Improving defect prediction using temporal features and non linear models, Ninth international workshop on Principles of software evolution: in conjunction with the 6th ESEC/FSE joint meeting, September 03-04, 2007, Dubrovnik, Croatia [doi>10.1145/1294948.1294953]
• 4: Christian Bird , Alex Gourley , Prem Devanbu , Anand Swaminathan , Greta Hsu, Open Borders? Immigration in Open Source Projects, Proceedings of the Fourth International Workshop on Mining Software Repositories, p.6, May 20-26, 2007 [doi>10.1109/MSR.2007.23]
• 5: P. Bonacich. Power and Centrality: A family of Measures. American Journal of Sociology 92, pp. 1170--1182, 1987.
• 6: S. P. Borgatti, M. G. Everett, and L. C. Freeman. Ucinet for Windows: Software for Social Network Analysis. Analytic Technologies, Harvard, MA, 2002.
• 7: Alistair Cockburn, Agile software development, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2002
• 8: Tom DeMarco , Timothy Lister, Peopleware (2nd ed.): productive projects and teams, Dorset House Publishing Co., Inc., New York, NY, 1999
• 9: Norman E. Fenton , Niclas Ohlsson, Quantitative Analysis of Faults and Failures in a Complex Software System, IEEE Transactions on Software Engineering, v.26 n.8, p.797-814, August 2000 [doi>10.1109/32.879815]
• 10: Nicolas Ducheneaut, Socialization in an Open Source Software Community: A Socio-Technical Analysis, Computer Supported Cooperative Work, v.14 n.4, p.323-368, August 2005 [doi>10.1007/s10606-005-9000-1]
• 11: Norman Fenton , Shari Lawrence Pfleeger, Software metrics (2nd ed.): a rigorous and practical approach, PWS Publishing Co., Boston, MA, 1997
• 12: Norman E. Fenton , Martin Neil, A Critique of Software Defect Prediction Models, IEEE Transactions on Software Engineering, v.25 n.5, p.675-689, September 1999 [doi>10.1109/32.815326]
• 13: L. C. Freeman. Centrality in social networks: Conceptual clarification. Social Networks, 1(3), pp. 215--239, 1979.
• 14: R. A. Ghosh. Clustering and dependencies in free/open source software development: Methodology and tools. First Monday, 8(4), 2003.
• 15: Todd L. Graves , Alan F. Karr , J. S. Marron , Harvey Siy, Predicting Fault Incidence Using Software Change History, IEEE Transactions on Software Engineering, v.26 n.7, p.653-661, July 2000 [doi>10.1109/32.859533]
• 16: D. M. Green and J. M. Swets. Signal detection theory and psychophysics. John Wiley & Sons, Inc. New York, 1966.
• 17: R. A. Hanneman and M. Riddle. Introduction to social network methods. University of California, Riverside, California, 2005.
• 18: James D. Herbsleb , Audris Mockus, An Empirical Study of Speed and Communication in Globally Distributed Software Development, IEEE Transactions on Software Engineering, v.29 n.6, p.481-494, June 2003 [doi>10.1109/TSE.2003.1205177]
• 19: J. Howison, K. Inoue, and K. Crowston. Social Dynamics of Free and Open Source Team Communication. In Proceedings of the International Conference on Open Source Software (OSS), pp. 319--330, 2006.
• 20: Shih-Kun Huang , Kang-min Liu, Mining version histories to verify the learning process of Legitimate Peripheral Participants, Proceedings of the 2005 international workshop on Mining software repositories, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 21: Watts Humphrey, Tsp(sm)-coaching development teams, Addison-Wesley Professional, 2006
• 22: J. E. Jackson. A User's Guide to Principal Components. John Wiley & Sons, Inc., New York, 1991.
• 23: Sunghun Kim , Thomas Zimmermann , E. James Whitehead Jr. , Andreas Zeller, Predicting Faults from Cached History, Proceedings of the 29th international conference on Software Engineering, p.489-498, May 20-26, 2007 [doi>10.1109/ICSE.2007.66]
• 24: Patrick Knab , Martin Pinzger , Abraham Bernstein, Predicting defect densities in source code files with decision tree learners, Proceedings of the 2006 international workshop on Mining software repositories, May 22-23, 2006, Shanghai, China [doi>10.1145/1137983.1138012]
• 25: Taghi M. Khoshgoftaar , Edward B. Allen , Robert Halstead , Gary P. Trio , Ronald M. Flass, Using Process History to Predict Software Quality, Computer, v.31 n.4, p.66-72, April 1998 [doi>10.1109/2.666844]
• 26: L. Lopez-Fernandez, G. Robles, and J. M. Gonzalez-Barahona. Applying Social Network Analysis to the Information in CVS Repositories. In Proceedings of the International Workshop on Mining Software Repositories (MSR), pp. 101--105, 2004.
• 27: Tim Menzies , Jeremy Greenwald , Art Frank, Data Mining Static Code Attributes to Learn Defect Predictors, IEEE Transactions on Software Engineering, v.33 n.1, p.2-13, January 2007 [doi>10.1109/TSE.2007.10]
• 28: A. Mockus and D. M. Weiss: Predicting risk of software changes. Bell Labs Technical Journal, 5(2), pp. 169--180, 2000.
• 29: Raimund Moser , Witold Pedrycz , Giancarlo Succi, A comparative analysis of the efficiency of change metrics and static code attributes for defect prediction, Proceedings of the 30th international conference on Software engineering, May 10-18, 2008, Leipzig, Germany [doi>10.1145/1368088.1368114]
• 30: John C. Munson , Taghi M. Khoshgoftaar, The Detection of Fault-Prone Programs, IEEE Transactions on Software Engineering, v.18 n.5, p.423-433, May 1992 [doi>10.1109/32.135775]
• 31: J. C. Munson , S. G. Elbaum, Code Churn: A Measure for Estimating the Impact of Code Change, Proceedings of the International Conference on Software Maintenance, p.24, March 16-19, 1998
• 32: Nachiappan Nagappan , Thomas Ball , Andreas Zeller, Mining metrics to predict component failures, Proceedings of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China [doi>10.1145/1134285.1134349]
• 33: Nachiappan Nagappan , Thomas Ball, Use of relative code churn measures to predict system defect density, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062514]
• 34: Nachiappan Nagappan , Brendan Murphy , Victor Basili, The influence of organizational structure on software quality: an empirical case study, Proceedings of the 30th international conference on Software engineering, May 10-18, 2008, Leipzig, Germany [doi>10.1145/1368088.1368160]
• 35: Masao Ohira , Naoki Ohsugi , Tetsuya Ohoka , Ken-ichi Matsumoto, Accelerating cross-project knowledge collaboration using collaborative filtering and social networks, Proceedings of the 2005 international workshop on Mining software repositories, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 36: Thomas J. Ostrand , Elaine J. Weyuker , Robert M. Bell, Predicting the Location and Number of Faults in Large Software Systems, IEEE Transactions on Software Engineering, v.31 n.4, p.340-355, April 2005 [doi>10.1109/TSE.2005.49]
• 37: J. Ratzinger, M. Pinzger, and H. C. Gall. EQ-Mine: Predicting short-term defects for software evolution. In Proceedings of the Fundamental Approaches to Software Engineering (FASE), pp. 12--26, LNCS, Springer, 2007.
• 38: Warren Sack, Conversation Map: An Interface for Very Large-Scale Conversations, Journal of Management Information Systems, v.17 n.3, p.73-92, Number 3/Winter 2000/01
• 39: Warren Sack , Françoise Détienne , Nicolas Ducheneaut , Jean-Marie Burkhardt , Dilan Mahendran , Flore Barcellini, A Methodological Framework for Socio-Cognitive Analyses of Collaborative Design of Open Source Software, Computer Supported Cooperative Work, v.15 n.2-3, p.229-250, June 2006 [doi>10.1007/s10606-006-9020-5]
• 40: S. Wasserman and K. Faust. Social Network Analysis: Methods and Applications. Cambridge University Press, New York, 1994.
• 41: Elaine J. Weyuker , Thomas J. Ostrand , Robert M. Bell, Using Developer Information as a Factor for Fault Prediction, Proceedings of the Third International Workshop on Predictor Models in Software Engineering, p.8, May 20-26, 2007 [doi>10.1109/PROMISE.2007.14]
• 42: Jin Xu , Yongqin Gao , Scott Christley , Gregory Madey, A Topological Analysis of the Open Souce Software Development Community, Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05) - Track 7, p.198.1, January 03-06, 2005 [doi>10.1109/HICSS.2005.57]
• 43: Thomas Zimmermann , Nachiappan Nagappan, Predicting defects using network analysis on dependency graphs, Proceedings of the 30th international conference on Software engineering, May 10-18, 2008, Leipzig, Germany [doi>10.1145/1368088.1368161]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Complexity measures

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Product metrics; Performance measures; Process metrics

General Terms:
Experimentation, Management, Measurement, Reliability

Keywords:
developer contribution network, failure prediction, network centrality measures, social network analysis