Classification of source code archives

ABSTRACT

The World Wide Web contains a number of source code archives. Programs are usually classified into various categories within the archive by hand. We report on experiments for automatic classification of source code into these categories. We examined a number of factors that affect classification accuracy. Weighting features by expected entropy loss makes a significant improvement in classification accuracy. We show a Support Vector Machine can be trained to classify source code with a high degree of accuracy. We feel these results show promise for software reuse.

REFERENCES

• 1: Abramson N. Information Theory and Coding, McGraw-Hill, New York, 1963.
• 2: Kristin P. Bennett , Colin Campbell, Support vector machines: hype or hallelujah?, ACM SIGKDD Explorations Newsletter, v.2 n.2, p.1-13, Dec. 2000 [doi>10.1145/380995.380999]
• 3: Chang C and Lin C. LIBSVM: A library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
• 4: Chen A, Lee Y K, Yao A Y, and Michail A. Code search based on CVS comments: A preliminary evaluation (Technical Report 0106). School of Computer Science and Eng., University of New South Wales, Australia, 2001.
• 5: Dumais S T. Using SVMs for text categorization. IEEE Intelligent Systems Magazine, Trends and Controversies, Vol. 13(4), 21--23, 1998.
• 6: Thorsten Joachims, Text Categorization with Suport Vector Machines: Learning with Many Relevant Features, Proceedings of the 10th European Conference on Machine Learning, p.137-142, April 21-23, 1998
• 7: Charles W. Krueger, Software reuse, ACM Computing Surveys (CSUR), v.24 n.2, p.131-183, June 1992 [doi>10.1145/130844.130856]
• 8: Merkl D. Content-based software classification by self-organization. In Proceedings of the IEEE International Conference on Neural Networks, 1086--1091, 1995.
• 9: Mary Beth Rosson , John M. Carroll, The reuse of uses in Smalltalk programming, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.3, p.219-253, Sept. 1996 [doi>10.1145/234526.234530]
• 10: Eric J. Stierna , Neil C. Rowe, Applying information-retrieval methods to software reuse: a case study, Information Processing and Management: an International Journal, v.39 n.1, p.67-74, January 2003 [doi>10.1016/S0306-4573(02)00025-0]
• 11: Secil Ugurel , Robert Krovetz , C. Lee Giles, What's the code?: automatic classification of source code archives, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775141]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE

General Terms:
Algorithms, Experimentation, Languages

Keywords:
SVM, classification, software reuse, source code archive