Learning from bug-introducing changes to prevent fault prone code

ABSTRACT

A version control system, such as CVS/SVN, can provide the history of software changes performed during the evolution of a software project. Among all the changes performed there are some which cause the introduction of bugs, often resolved later with other changes.

In this paper we use a technique to identify bug-introducing changes to train a model that can be used to predict if a new change may introduces or not a bug. We represent software changes as elements of a n-dimensional vector space of terms coordinates extracted from source code snapshots.

The evaluation of various learning algorithms on a set of open source projects looks very promising, in particular for KNN (K-Nearest Neighbor algorithm) where a significant tradeoff between precision and recall has been obtained.

REFERENCES

• 1: David W. Aha , Dennis Kibler , Marc K. Albert, Instance-Based Learning Algorithms, Machine Learning, v.6 n.1, p.37-66, Jan. 1991 [doi>10.1023/A:1022689900470]
• 2: Giuliano Antoniol , Gerardo Canfora , Gerardo Casazza , Andrea De Lucia , Ettore Merlo, Recovering Traceability Links between Code and Documentation, IEEE Transactions on Software Engineering, v.28 n.10, p.970-983, October 2002 [doi>10.1109/TSE.2002.1041053]
• 3: Giuliano Antoniol , Massimiliano Di Penta , Ettore Merlo, An Automatic Approach to identify Class Evolution Discontinuities, Proceedings of the Principles of Software Evolution, 7th International Workshop, p.31-40, September 06-07, 2004 [doi>10.1109/IWPSE.2004.4]
• 4: Victor R. Basili , Lionel C. Briand , Walcélio L. Melo, A Validation of Object-Oriented Design Metrics as Quality Indicators, IEEE Transactions on Software Engineering, v.22 n.10, p.751-761, October 1996 [doi>10.1109/32.544352]
• 5: Thomas J. Ostrand , Elaine J. Weyuker , Robert M. Bell, Predicting the Location and Number of Faults in Large Software Systems, IEEE Transactions on Software Engineering, v.31 n.4, p.340-355, April 2005 [doi>10.1109/TSE.2005.49]
• 6: Salah Bouktif , Yann-Gael Gueheneuc , Giuliano Antoniol, Extracting Change-patterns from CVS Repositories, Proceedings of the 13th Working Conference on Reverse Engineering, p.221-230, October 23-27, 2006 [doi>10.1109/WCRE.2006.27]
• 7: Gerardo Canfora , Luigi Cerulo , Massimiliano Di Penta, Identifying Changed Source Code Lines from Version Repositories, Proceedings of the 29th International Conference on Software Engineering Workshops, p.14, May 20-26, 2007 [doi>10.1109/ICSEW.2007.117]
• 8: Corinna Cortes , Vladimir Vapnik, Support-Vector Networks, Machine Learning, v.20 n.3, p.273-297, Sept. 1995 [doi>10.1023/A:1022627411411]
• 9: Harald Gall , Mehdi Jazayeri , Jacek Krajewski, CVS Release History Data for Detecting Logical Couplings, Proceedings of the 6th International Workshop on Principles of Software Evolution, p.13, September 01-02, 2003
• 10: Todd L. Graves , Alan F. Karr , J. S. Marron , Harvey Siy, Predicting Fault Incidence Using Software Change History, IEEE Transactions on Software Engineering, v.26 n.7, p.653-661, July 2000 [doi>10.1109/32.859533]
• 11: Tibor Gyimothy , Rudolf Ferenc , Istvan Siket, Empirical Validation of Object-Oriented Metrics on Open Source Software for Fault Prediction, IEEE Transactions on Software Engineering, v.31 n.10, p.897-910, October 2005 [doi>10.1109/TSE.2005.112]
• 12: Taghi M. Khoshgoftaar , Edward B. Allen, Ordering Fault-Prone Software Modules, Software Quality Control, v.11 n.1, p.19-37, May 2003 [doi>10.1023/A:1023632027907]
• 13: Sunghun Kim , Kai Pan , E. E. James Whitehead, Jr., Memories of bug fixes, Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering, November 05-11, 2006, Portland, Oregon, USA [doi>10.1145/1181775.1181781]
• 14: Sunghun Kim , Thomas Zimmermann , Kai Pan , E. James Jr. Whitehead, Automatic Identification of Bug-Introducing Changes, Proceedings of the 21st IEEE/ACM International Conference on Automated Software Engineering, p.81-90, September 18-22, 2006 [doi>10.1109/ASE.2006.23]
• 15: Sunghun Kim , Thomas Zimmermann , E. James Whitehead Jr. , Andreas Zeller, Predicting Faults from Cached History, Proceedings of the 29th international conference on Software Engineering, p.489-498, May 20-26, 2007 [doi>10.1109/ICSE.2007.66]
• 16: Niels Landwehr , Mark Hall , Eibe Frank, Logistic Model Trees, Machine Learning, v.59 n.1-2, p.161-205, May 2005 [doi>10.1007/s10994-005-0466-3]
• 17: Benjamin Livshits , Thomas Zimmermann, DynaMine: finding common error patterns by mining software revision histories, ACM SIGSOFT Software Engineering Notes, v.30 n.5, September 2005
• 18: Osamu Mizuno , Shiro Ikami , Shuya Nakaichi , Tohru Kikuno, Spam Filter Based Approach for Finding Fault-Prone Software Modules, Proceedings of the 29th International Conference on Software Engineering Workshops, p.4, May 20-26, 2007 [doi>10.1109/ICSEW.2007.193]
• 19: Audris Mockus , Lawrence G. Votta, Identifying Reasons for Software Changes Using Historic Databases, Proceedings of the International Conference on Software Maintenance (ICSM'00), p.120, October 11-14, 2000
• 20: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 21: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 22: Jacek Śliwerski , Thomas Zimmermann , Andreas Zeller, HATARI: raising risk awareness, Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering, September 05-09, 2005, Lisbon, Portugal
• 23: Jacek Śliwerski , Thomas Zimmermann , Andreas Zeller, When do changes induce fixes?, Proceedings of the 2005 international workshop on Mining software repositories, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 24: M. Stone. Cross-validatory choice and assesment of statistical predictions (with discussion). Journal of the Royal Statistical Society B, 36:111--147, 1974.
• 25: Geoffrey I. Webb, MultiBoosting: A Technique for Combining Boosting and Wagging, Machine Learning, v.40 n.2, p.159-196, Aug. 2000 [doi>10.1023/A:1007659514849]
• 26: Ian H. Witten , Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005
• 27: R. K. Yin. Case Study Research: Design and Methods - Third Edition. SAGE Publications, London, 2002.
• 28: Andreas Zeller, The Future of Programming Environments: Integration, Synergy, and Assistance, 2007 Future of Software Engineering, p.316-325, May 23-25, 2007 [doi>10.1109/FOSE.2007.31]
• 29: Thomas Zimmermann , Peter Weisgerber , Stephan Diehl , Andreas Zeller, Mining Version Histories to Guide Software Changes, Proceedings of the 26th International Conference on Software Engineering, p.563-572, May 23-28, 2004

INDEX TERMS

Keywords:
bug prediction, mining software repositories, software evolution