Case study: supplementing program analysis with natural language analysis to improve a reverse engineering task

ABSTRACT

Software maintainers often use reverse engineering tools to aid in the extremely difficult task of understanding unfamiliar code, especially within large, complex software systems. While traditional program analysis can provide detailed information for reverse engineering, often this information is not sufficient to assist the user with high-level program understanding tasks. To bridge the gap between current reverse engineering tools and the high-level questions that software maintainers want answered, we propose supplementing traditional program analysis with natural language analysis of program source code. This paper presents a case study where we have augmented an existing reverse engineering tool, an aspect miner, to complement the existing traditional program analysis-based miner with natural language analysis of method names, class names, and comments. Our quantitative and qualitative results strongly suggest that supplementing traditional program analysis with natural language analysis is a promising approach to raising the level of effectiveness of reverse engineering tools.

REFERENCES

• 1: Silvia Breu , Jens Krinke, Aspect Mining Using Event Traces, Proceedings of the 19th IEEE international conference on Automated software engineering, p.310-315, September 20-24, 2004 [doi>10.1109/ASE.2004.12]
• 2: Magiel Bruntink , Arie van Deursen , Tom Tourwe , Remco van Engelen, An Evaluation of Clone Detection Techniques for Identifying Crosscutting Concerns, Proceedings of the 20th IEEE International Conference on Software Maintenance, p.200-209, September 11-14, 2004
• 3: Gerardo Canfora , Luigi Cerulo , Massimiliano Di Penta, On the Use of Line Co-change for Identifying Crosscutting Concern Code, Proceedings of the 22nd IEEE International Conference on Software Maintenance, p.213-222, September 24-27, 2006 [doi>10.1109/ICSM.2006.43]
• 4: Bruno Caprile , Paolo Tonella, Nomen Est Omen: Analyzing the Language of Function Identifiers, Proceedings of the Sixth Working Conference on Reverse Engineering, p.112, October 06-08, 1999
• 5: M. Ceccato , M. Marin , K. Mens , L. Moonen , P. Tonella , T. Tourwe, A Qualitative Comparison of Three Aspect Mining Techniques, Proceedings of the 13th International Workshop on Program Comprehension, p.13-22, May 15-16, 2005 [doi>10.1109/WPC.2005.2]
• 6: Elliot J. Chikofsky , James H. Cross II, Reverse Engineering and Design Recovery: A Taxonomy, IEEE Software, v.7 n.1, p.13-17, January 1990 [doi>10.1109/52.43044]
• 7: Refactoring: improving the design of existing code, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 8: E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design Patterns. Addison-Wesley, 1995.
• 9: James Gosling , Bill Joy , Guy L. Steele, The Java Language Specification, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1996
• 10: Jan Hannemann , Gregor Kiczales, Design pattern implementation in Java and aspectJ, Proceedings of the 17th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, November 04-08, 2002, Seattle, Washington, USA
• 11: Gregor Kiczales , Erik Hilsdale , Jim Hugunin , Mik Kersten , Jeffrey Palm , William G. Griswold, An Overview of AspectJ, Proceedings of the 15th European Conference on Object-Oriented Programming, p.327-353, June 18-22, 2001
• 12: Ramnivas Laddad, AspectJ in Action: Practical Aspect-Oriented Programming, Manning Publications Co., Greenwich, CT, 2003
• 13: M. M. Lehman , L. A. Belady, Program evolution: processes of software change, Academic Press Professional, Inc., San Diego, CA, 1985
• 14: Ben Liblit, Andrew Begel, and Eve Sweeser. Cognitive perspectives on the role of naming in computer programs. In Annual Psychology of Programming Workshop, Sussex, United Kingdom, 2006.
• 15: Andrian Marcus , Vaclav Rajlich, Identifications of Concepts, Features, and Concerns in Source Code, Proceedings of the 21st IEEE International Conference on Software Maintenance (ICSM'05), p.718, September 25-30, 2005 [doi>10.1109/ICSM.2005.50]
• 16: Marius Marin , Leon Moonen , Arie van Deursen, A common framework for aspect mining based on crosscutting concern sorts, Proceedings of the 13th Working Conference on Reverse Engineering (WCRE 2006), p.29-38, October 23-27, 2006 [doi>10.1109/WCRE.2006.6]
• 17: Marius Marin , Arie van Deursen , Leon Moonen, Identifying Aspects Using Fan-In Analysis, Proceedings of the 11th Working Conference on Reverse Engineering (WCRE'04), p.132-141, November 08-12, 2004
• 18: Hausi A. Müller , Jens H. Jahnke , Dennis B. Smith , Margaret-Anne Storey , Scott R. Tilley , Kenny Wong, Reverse engineering: a roadmap, Proceedings of the Conference on The Future of Software Engineering, p.47-60, June 04-11, 2000, Limerick, Ireland [doi>10.1145/336512.336526]
• 19: David Shepherd , Zachary P. Fry , Emily Hill , Lori Pollock , K. Vijay-Shanker, Using natural language program analysis to locate and understand action-oriented concerns, Proceedings of the 6th international conference on Aspect-oriented software development, March 12-16, 2007, Vancouver, British Columbia, Canada [doi>10.1145/1218563.1218587]
• 20: David Shepherd , Jeffrey Palm , Lori Pollock , Mark Chu-Carroll, Timna: a framework for automatically combining aspect mining analyses, Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering, November 07-11, 2005, Long Beach, CA, USA [doi>10.1145/1101908.1101937]
• 21: David Shepherd, Lori Pollock, and Emily Gibson. Design and evaluation of an automated aspect mining tool. In International Conference on Software Engineering Research and Practice, 2004.
• 22: David Shepherd , Lori Pollock , K. Vijay-Shanker, Towards supporting on-demand virtual remodularization using program graphs, Proceedings of the 5th international conference on Aspect-oriented software development, March 20-24, 2006, Bonn, Germany [doi>10.1145/1119655.1119660]
• 23: Jonathan Sillito , Gail C. Murphy , Kris De Volder, Questions programmers ask during software evolution tasks, Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering, November 05-11, 2006, Portland, Oregon, USA [doi>10.1145/1181775.1181779]
• 24: Peri Tarr , Harold Ossher , William Harrison , Stanley M. Sutton, Jr., N degrees of separation: multi-dimensional separation of concerns, Proceedings of the 21st international conference on Software engineering, p.107-119, May 16-22, 1999, Los Angeles, California, United States [doi>10.1145/302405.302457]
• 25: Paolo Tonella , Mariano Ceccato, Aspect Mining through the Formal Concept Analysis of Execution Traces, Proceedings of the 11th Working Conference on Reverse Engineering (WCRE'04), p.112-121, November 08-12, 2004
• 26: Ian H. Witten , Eibe Frank, Data mining: practical machine learning tools and techniques with Java implementations, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.7 Distribution, Maintenance, and Enhancement
          Subjects: Restructuring, reverse engineering, and reengineering

General Terms:
Algorithms, Languages, Reliability

Keywords:
aspect mining, natural language, program analysis