Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

The suggestions made by current IDE's code completion features are based exclusively on static type system of the programming language. As a result, often proposals are made which are irrelevant for a particular working context. Also, these suggestions are ordered alphabetically rather than by their relevance in a particular context. In this paper, we present intelligent code completion systems that learn from existing code repositories. We have implemented three such systems, each using the information contained in repositories in a different way. We perform a large-scale quantitative evaluation of these systems, integrate the best performing one into Eclipse, and evaluate the latter also by a user study. Our experiments give evidence that intelligent code completion systems which learn from examples significantly outperform mainstream code completion systems in terms of the relevance of their suggestions and thus have the potential to enhance developers' productivity.

REFERENCES

• 1: Overview of the Third Text REtrieval Conference (TREC-3), Gaithersburg, MD, USA, 1990. NIST.
• 2: Rakesh Agrawal , Tomasz Imieliński , Arun Swami, Mining association rules between sets of items in large databases, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.207-216, May 25-28, 1993, Washington, D.C., United States [doi>10.1145/170035.170072]
• 3: Kent Beck , Ralph E. Johnson, Patterns Generate Architectures, Proceedings of the 8th European Conference on Object-Oriented Programming, p.139-149, July 04-08, 1994
• 4: Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics), Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 5: Marcel Bruch , Thorsten Schäfer , Mira Mezini, FrUiT: IDE support for framework understanding, Proceedings of the 2006 OOPSLA workshop on eclipse technology eXchange, p.55-59, October 22-23, 2006, Portland, Oregon [doi>10.1145/1188835.1188847]
• 6: Marcel Bruch , Thorsten Schäfer , Mira Mezini, On evaluating recommender systems for API usages, Proceedings of the 2008 international workshop on Recommendation systems for software engineering, November 09-09, 2008, Atlanta, Georgia [doi>10.1145/1454247.1454254]
• 7: Greg Butler , Rudolf K. Keller , Hafedh Mili, A framework for framework documentation, ACM Computing Surveys (CSUR), v.32 n.1es, March 2000 [doi>10.1145/351936.351951]
• 8: T. Cover and P. Hart. Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 1967.
• 9: Eclipse Foundation. SWT: The standard widget toolkit. http://www.eclipse.org/swt/, 2006.
• 10: W B Frakes , B A Nejmeh, Software reuse through information retrieval, ACM SIGIR Forum, v.21 n.1-2, p.30-36, Sept.-March 1986-1987 [doi>10.1145/24634.24636]
• 11: D. Gangopadhyay and S. Mitra. Design by framework completion. Automated Software Eng., 3(3/4):219--237, 1996.
• 12: Google code search. http://www.google.com/codesearch.
• 13: Rosco Hill , Joe Rideout, Automatic Method Completion, Proceedings of the 19th IEEE international conference on Automated software engineering, p.228-235, September 20-24, 2004 [doi>10.1109/ASE.2004.19]
• 14: Reid Holmes , Gail C. Murphy, Using structural context to recommend source code examples, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062491]
• 15: Ralph E. Johnson, Documenting frameworks using patterns, conference proceedings on Object-oriented programming systems, languages, and applications, p.63-76, October 18-22, 1992, Vancouver, British Columbia, Canada [doi>10.1145/141936.141943]
• 16: Mik Kersten , Gail C. Murphy, Using task context to improve programmer productivity, Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering, November 05-11, 2006, Portland, Oregon, USA [doi>10.1145/1181775.1181777]
• 17: Koders. http://www.koders.com.
• 18: Ron Kohavi, A study of cross-validation and bootstrap for accuracy estimation and model selection, Proceedings of the 14th international joint conference on Artificial intelligence, p.1137-1143, August 20-25, 1995, Montreal, Quebec, Canada
• 19: David Mandelin , Lin Xu , Rastislav Bodík , Doug Kimelman, Jungloid mining: helping to navigate the API jungle, Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation, June 12-15, 2005, Chicago, IL, USA [doi>10.1145/1065010.1065018]
• 20: Amir Michail, Data mining library reuse patterns using generalized association rules, Proceedings of the 22nd international conference on Software engineering, p.167-176, June 04-11, 2000, Limerick, Ireland [doi>10.1145/337180.337200]
• 21: Gail C. Murphy , Mik Kersten , Leah Findlater, How Are Java Software Developers Using the Eclipse IDE?, IEEE Software, v.23 n.4, p.76-83, July 2006 [doi>10.1109/MS.2006.105]
• 22: R. Robbes , M. Lanza, How Program History Can Improve Code Completion, Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering, p.317-326, September 15-19, 2008 [doi>10.1109/ASE.2008.42]
• 23: Naiyana Sahavechaphan , Kajal Claypool, XSnippet: mining For sample code, Proceedings of the 21st annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications, October 22-26, 2006, Portland, Oregon, USA [doi>10.1145/1167473.1167508]
• 24: Thorsten Schafer , Michael Eichberg , Michael Haupt , Mira Mezini, The SEXTANT Software Exploration Tool, IEEE Transactions on Software Engineering, v.32 n.9, p.753-768, September 2006 [doi>10.1109/TSE.2006.94]
• 25: Suresh Thummalapenta , Tao Xie, Parseweb: a programmer assistant for reusing open source code on the web, Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, November 05-09, 2007, Atlanta, Georgia, USA [doi>10.1145/1321631.1321663]
• 26: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 27: Yunwen Ye , Gerhard Fischer , Brent Reeves, Integrating active information delivery and reuse repository systems, Proceedings of the 8th ACM SIGSOFT international symposium on Foundations of software engineering: twenty-first century applications, p.60-68, November 06-10, 2000, San Diego, California, United States [doi>10.1145/355045.355053]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.6 Programming Environments
          Subjects: Integrated environments

General Terms:
Algorithms, Documentation

Keywords:
code completion, code recommender, content assist, integrated development environment