Dynamic analysis of Ada programs for comprehension and quality measurement

ABSTRACT

During maintenance and particularly during corrective and perfective tasks, systems tend to exhibit a weight gain. As a result, their quality tends to degrade. Software comprehension is vital in order to assess system quality. In this paper, we aim at deploying dynamic analysis of Ada programs for obtaining comprehension, and applying measurements to assess their quality. Program instrumentation is performed non-intrusively by AspectAda, an aspect-oriented extension to Ada which we discussed in earlier work. Events which are required for this analysis are captured as execution traces. We have defined a relational database schema to save execution traces, and a set of queries to obtain measures of quality metrics. New Ada-specific metrics are introduced and existing metrics have been adopted from the literature. Automation is also provided as a proof of concept through a prototypical tool which provides information on the run-time behavior of the system, performs measurements and provides visualization of the run-time behavior of the system through a call graph. An open source Ada program is used as a case study to demonstrate our approach.

REFERENCES

• 1: Edward B. Allen , Taghi M. Khoshgoftaar, Measuring Coupling and Cohesion: An Information-Theory Approach, Proceedings of the 6th International Symposium on Software Metrics, p.119, November 04-06, 1999
• 2: Ada Static Analysis Tool. http://www.adastat.com/
• 3: Erik Arisholm, Dynamic Coupling Measures for Object-Oriented Software, Proceedings of the 8th International Symposium on Software Metrics, p.33, June 04-07, 2002
• 4: Edward V. Berard, Essays on object-oriented software engineering (vol. 1), Prentice-Hall, Inc., Upper Saddle River, NJ, 1993
• 5: James M. Bieman , Byung-Kyoo Kang, Cohesion and reuse in an object-oriented system, ACM SIGSOFT Software Engineering Notes, v.20 n.SI, p.259-262, Aug. 1995
• 6: Lionel C. Briand , John W. Daly , Juergen Wuest, A Unified Framework for Cohesion Measurement, Proceedings of the 4th International Symposium on Software Metrics, p.43, November 05-07, 1997
• 7: Lionel C. Briand , John W. Daly , Jürgen K. Wüst, A Unified Framework for Coupling Measurement in Object-Oriented Systems, IEEE Transactions on Software Engineering, v.25 n.1, p.91-121, January 1999 [doi>10.1109/32.748920]
• 8: Lionel C. Briand , Sandro Morasca , Victor R. Basili, Measuring and Assessing Maintainability at the End of High Level Design, Proceedings of the Conference on Software Maintenance, p.88-97, September 01, 1993
• 9: Lionel C. Briand , Sandro Morasca , Victor R. Basili, Property-Based Software Engineering Measurement, IEEE Transactions on Software Engineering, v.22 n.1, p.68-86, January 1996 [doi>10.1109/32.481535]
• 10: Heung Seok Chae , Yong Rae Kwon , Doo- Hwan Bae, A cohesion measure for object-oriented classes, Software—Practice & Experience, v.30 n.12, p.1405-1431, Oct. 2000 [doi>10.1002/1097-024X(200010)30:12<1405::AID-SPE330>3.0.CO;2-3]
• 11: Jerome R. Cherniack , Harpal S. Dhama , Jeanne F. Fandozzi, Tool for Computing Cohesion and Coupling in Ada Programs: DIANA Dependent Part, Proceedings of the 12th Ada-Europe International Conference, p.180-196, June 14-18, 1993
• 12: S. R. Chidamber , C. F. Kemerer, A Metrics Suite for Object Oriented Design, IEEE Transactions on Software Engineering, v.20 n.6, p.476-493, June 1994 [doi>10.1109/32.295895]
• 13: E. S. Cho , C. J. Kim , S. D. Kim , S. Y. Rhew, Static and Dynamic Metrics for Effective Object Clustering, Proceedings of the Fifth Asia Pacific Software Engineering Conference, p.78, December 02-04, 1998
• 14: M. Deters and R. K. Cytron. Introduction of program instrumentation using aspects. In Proceedings of the OOPSLA Workshop on Advanced Separation of Concerns in Object-Oriented Systems, 2001.
• 15: Fernando Brito e Abreu , Miguel Goulão, Coupling and Cohesion as Modularization Drivers: Are We Being Over-Persuaded?, Proceedings of the Fifth European Conference on Software Maintenance and Reengineering, p.47, March 14-16, 2001
• 16: M. D. Ernst. Static and dynamic analysis: Synergy and duality. In Proceedings of the ICSE Workshop on Dynamic Analysis (WODA), 2003.
• 17: Letha Etzkorn , Harry Delugach, Towards a Semantic Metrics Suite for Object-Oriented Design, Proceedings of the Technology of Object-Oriented Languages and Systems (TOOLS 34'00), p.71, July 30-August 03, 2000
• 18: R. E. Filman and D. P. Friedman. Aspect-oriented programming is quantification and obliviousness. In Proceedings of the OOPSLA Workshop on Advanced Separation of Concerns in Object-Oriented Systems, 2000.
• 19: Refactoring: improving the design of existing code, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 20: Erik Arisholm , Lionel C. Briand , Audun Foyen, Dynamic Coupling Measurement for Object-Oriented Software, IEEE Transactions on Software Engineering, v.30 n.8, p.491-506, August 2004 [doi>10.1109/TSE.2004.41]
• 21: GDB: The GNU Project Debugger. http://sourceware.org/gdb/, Last Updated in 2007.
• 22: J.-F. Gélinas, M. Badri, and L. Badri. A cohesion measure for aspects. Journal of Object Technology, 5(7):75--95, September-October 2006.
• 23: GNAT GPL. Website https://libre.adacore.com.
• 24: Susan L. Graham , Peter B. Kessler , Marshall K. Mckusick, Gprof: A call graph execution profiler, Proceedings of the 1982 SIGPLAN symposium on Compiler construction, p.120-126, June 23-25, 1982, Boston, Massachusetts, United States
• 25: Thomas Gschwind , Johann Oberleitner, Improving Dynamic Data Analysis with Aspect-Oriented Programming, Proceedings of the Seventh European Conference on Software Maintenance and Reengineering, p.259, March 26-28, 2003
• 26: Abdelwahab Hamou-Lhadj , Timothy C. Lethbridge, Compression Techniques to Simplify the Analysis of Large Execution Traces, Proceedings of the 10th International Workshop on Program Comprehension, p.159, June 27-29, 2002
• 27: Challenges and Requirements for an Effective Trace Exploration Tool, Proceedings of the 12th IEEE International Workshop on Program Comprehension, p.70, June 24-26, 2004
• 28: Youssef Hassoun , Roger Johnson , Steve Counsell, A Dynamic Runtime Coupling Metric for Meta-Level Architectures, Proceedings of the Eighth Euromicro Working Conference on Software Maintenance and Reengineering (CSMR'04), p.339, March 24-26, 2004
• 29: Henderson-Seller. Software Metrics. Prentice Hall, U.K., 1996.
• 30: M. Hitz and B. Montazeri. Measuring coupling and cohesion in object-oriented systems. In Proceedings of the International Symposium on Applied Corporate Computing (ISACC), 1995.
• 31: ISO International Organization for Standardization. ISO 8402:1994, Quality management and quality assurance, 1994.
• 32: ISO International Organization for Standardization. ISO/IEC 9126-1:2001(E), Software engineering - Product quality, Part 1: Quality model, 2001.
• 33: Gregor Kiczales , Erik Hilsdale , Jim Hugunin , Mik Kersten , Jeffrey Palm , William G. Griswold, An Overview of AspectJ, Proceedings of the 15th European Conference on Object-Oriented Programming, p.327-353, June 18-22, 2001
• 34: G. Kiczales, J. Lamping, A. Menhdhekar, C. Maeda, C. Lopes, J.-M. Loingtier, and J. Irwin. Aspect-oriented programming. In Proceedings of the 11th European Conference on Object-Oriented Programming (ECOOP), 1997.
• 35: Stefan Kramer , Hermann Kaindl, Coupling and cohesion metrics for knowledge-based systems using frames and rules, ACM Transactions on Software Engineering and Methodology (TOSEM), v.13 n.3, p.332-358, July 2004 [doi>10.1145/1027092.1027094]
• 36: Danny B. Lange , Yuichi Nakamura, Object-Oriented Program Tracing and Visualization, Computer, v.30 n.5, p.63-70, May 1997 [doi>10.1109/2.589912]
• 37: Janusz Laski , William Stanley , Jim Hurst, Dependency analysis of Ada programs, Proceedings of the 1998 annual ACM SIGAda international conference on Ada, p.263-275, November 08-12, 1998, Washington, D.C., United States
• 38: Y. S. Lee and B. S. Liang. Measuring the coupling and cohesion of an object-oriented program based on information flow. In Proceedings of the International Conference on Software Quality (ICSQ), pages 47--57, 1995.
• 39: Wei Li , Sallie Henry, Object-oriented metrics that predict maintainability, Journal of Systems and Software, v.23 n.2, p.111-122, Nov. 1993 [doi>10.1016/0164-1212(93)90077-B]
• 40: Jonathan I. Maletic , Andrian Marcus, Supporting program comprehension using semantic and structural information, Proceedings of the 23rd International Conference on Software Engineering, p.103-112, May 12-19, 2001, Toronto, Ontario, Canada
• 41: Andrian Marcus , Denys Poshyvanyk, The Conceptual Cohesion of Classes, Proceedings of the 21st IEEE International Conference on Software Maintenance, p.133-142, September 25-30, 2005 [doi>10.1109/ICSM.2005.89]
• 42: Bertrand Meyer, Object-oriented software construction (2nd ed.), Prentice-Hall, Inc., Upper Saddle River, NJ, 1997
• 43: Timothy M. Meyers , David Binkley, Slice-Based Cohesion Metrics and Software Intervention, Proceedings of the 11th Working Conference on Reverse Engineering, p.256-265, November 08-12, 2004
• 44: Minitab Software Maintenance Updates. Website http://www.minitab.com/support/maintenance/.
• 45: David Lorge Parnas, Software aging, Proceedings of the 16th international conference on Software engineering, p.279-287, May 16-21, 1994, Sorrento, Italy
• 46: Sukesh Patel , William Chu , Rich Baxter, A measure for composite module cohesion, Proceedings of the 14th international conference on Software engineering, p.38-48, May 11-15, 1992, Melbourne, Australia [doi>10.1145/143062.143086]
• 47: Wim De Pauw , David Lorenz , John Vlissides , Mark Wegman, Execution patterns in object-oriented visualization, Proceedings of the 4th conference on USENIX Conference on Object-Oriented Technologies and Systems, p.16-16, April 27-30, 1998, Santa Fe, New Mexico
• 48: Knut H. Pedersen , Constantinos Constantinides, AspectAda: aspect oriented programming for ada95, ACM SIGAda Ada Letters, v.XXV n.4, p.79-92, December 2005
• 49: Denys Poshyvanyk , Andrian Marcus, The Conceptual Coupling Metrics for Object-Oriented Systems, Proceedings of the 22nd IEEE International Conference on Software Maintenance, p.469-478, September 24-27, 2006 [doi>10.1109/ICSM.2006.67]
• 50: R S Pressman, Software engineering: a practitioner's approach (2nd ed.), McGraw-Hill, Inc., New York, NY, 1986
• 51: William W. Pritchett, IV, Applying object-oriented metrics to Ada 95, ACM SIGAda Ada Letters, v.XVI n.5, p.48-58, Sept./Oct. 1996 [doi>10.1145/240837.240841]
• 52: William W. Pritchett, IV, An object-oriented metrics suite for Ada 95, ACM SIGAda Ada Letters, v.XXI n.4, December 2001
• 53: A. Raza, G. Vogel, and E. Plödereder. Bauhaus - A tool suite for program analysis and reverse engineering. In Proceedings of the 11th International Conference on Reliable Software Technologies (Ada-Europe), pages 71--82, 2006.
• 54: S. Rugaber. Program comprehension for reverse engineering. In Proceedings of the AAAI Workshop on AI and Automated Program Understanding, 1992.
• 55: James Rumbaugh , Ivar Jacobson , Grady Booch, The Unified Modeling Language reference manual, Addison-Wesley Longman Ltd., Essex, UK, 1998
• 56: W. Stevens, G. Myers, and L. Constantine. Structured design. IBM Systems Journal, 13(2):115--139, 1997.
• 57: Anneliese von Mayrhauser , A. Marie Vans, Program Comprehension During Software Maintenance and Evolution, Computer, v.28 n.8, p.44-55, August 1995 [doi>10.1109/2.402076]
• 58: Robert J. Walker , Gail C. Murphy , Bjorn Freeman-Benson , Darin Wright , Darin Swanson , Jeremy Isaak, Visualizing dynamic software system information through high-level models, Proceedings of the 13th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, p.271-283, October 18-22, 1998, Vancouver, British Columbia, Canada
• 59: J. Wang, Y. Zhou, L. Wen, Y. Chen, H. Lu, and B. Xu. DMC: A more precise cohesion measure for classes. Information and Software Technology, 47(3):167--180, March 2005.
• 60: Baowen Xu , Zhenqiang Chen , Jianjun Zhao, Measuring cohesion of packages in Ada95, ACM SIGAda Ada Letters, v.XXIV n.1, p.62-67, March 2004
• 61: A. Zeller. Program analysis: A hierarchy. In Proceedings of the ICSE Workshop on Dynamic Analysis (WODA), pages 6--9, 2003.
• 62: J. Zhao. Measuring coupling in aspect-oriented systems. In Proceedings of the 10th IEEE International Software Metrics Symposium (METRICS), 2004.
• 63: J. Zhao and B. Xu. Measuring aspect cohesion. In Proceedings of the 7th International Conference on Fundamental Approaches to Software Engineering (FASE), 2004.
• 64: Yuming Zhou , Lijie Wen , Jianmin Wang , Yujian Chen , Hongmin Lu , Baowen Xu, DRC: A Dependence Relationships Based Cohesion Measure for Classes, Proceedings of the Tenth Asia-Pacific Software Engineering Conference Software Engineering Conference, p.215, December 10-12, 2003
• 65: ICBMC: An Improved Cohesion Measure for Classes, Proceedings of the International Conference on Software Maintenance (ICSM'02), p.44, October 03-06, 2002

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management
          Subjects: Software maintenance

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Complexity measures

General Terms:
Measurement

Keywords:
dynamic program analysis, program comprehension, quality measurement and metrics