Assessment of software system evolvability

ABSTRACT

The evolvability, the ease of further development, of a software systems is difficult to assess, but may have large economic consequences. Many studies have investigated the relations between particular software metrics and effort on evolving individual classes, but little attention has been given to methods for assessing and measuring evolvability of complete software systems. This paper discusses such methods, and motivates that they should use a combination of structural code measures and expert assessments. This is exemplified in a case study assessing the evolvability of four functionally equivalent systems. The paper also gives with directions for future work on evolvability assessments.

REFERENCES

• 1: Anda, B. Assessing Software System Maintainability using Structural Measures and Expert Assesments. Accepted for publication at the 23^rd International Conference on Software Maintenance, 2007.
• 2: AFOTEC Software maintainability evaluation guide. Department of the Air Force, HQ Air Force Operational Test and Evaluation Center, 1996.
• 3: Benestad, H. C., Anda, B. and Arisholm, E. Assessing Software Product Maintainability Based on Class-Level Structural Measures. In Proceedings of the 7th International Conference on Product-focused Software Process Improvement (PROFES), edited by Jürgen Münch. Springer-Verlag, pp. 94--111, 2006.
• 4: Briand, L. and Wuest, J. Empirical Studies of Quality Models in Object-Oriented Systems, Advances in Computers, Vol. 56, pp. 97--166, 2002.
• 5: Lionel C. Briand , Christian Bunse , John W. Daly , Christiane Differding, An Experimental Comparison of the Maintainability of Object-Orientedand Structured Design Documents, Empirical Software Engineering, v.2 n.3, p.291-312, 1997 [doi>10.1023/A:1009720117601]
• 6: S. R. Chidamber , C. F. Kemerer, A Metrics Suite for Object Oriented Design, IEEE Transactions on Software Engineering, v.20 n.6, p.476-493, June 1994 [doi>10.1109/32.295895]
• 7: David P. Darcy , Chris F. Kemerer, OO Metrics in Practice, IEEE Software, v.22 n.6, p.17-19, November 2005 [doi>10.1109/MS.2005.160]
• 8: Fowler, M. and Beck, K. Bad smells in code. In: Refactoring: Improving the design of existing code, 1st ed., Addison-Wesley, Boston, pp.75--88, 2000.
• 9: Rachel Harrison , Steve J. Counsell , Reuben V. Nithi, An Evaluation of the MOOD Set of Object-Oriented Software Metrics, IEEE Transactions on Software Engineering, v.24 n.6, p.491-496, June 1998 [doi>10.1109/32.689404]
• 10: ISO/IEC. ISO/IEC 9126 Software engineering -- Product quality, 2001.
• 11: Jørgensen, M. Estimation of Software Development Work Effort: Evidence on Expert Judgement and Formal Models. Accepted for publication in the International Journal of Forecasting, 2007.
• 12: M. Jørgensen, Software quality measurement, Advances in Engineering Software, v.30 n.12, p.907-912, Dec. 1999 [doi>10.1016/S0965-9978(99)00015-0]
• 13: Barbara A. Kitchenham , Guilherme H. Travassos , Anneliese von Mayrhauser , Frank Niessink , Norman F. Schneidewind , Janice Singer , Shingo Takada , Risto Vehvilainen , Hongji Yang, Towards an Ontology of software maintenance, Journal of Software Maintenance: Research and Practice, v.11 n.6, p.365-389, Nov. 1999 [doi>10.1002/(SICI)1096-908X(199911/12)11:6<365::AID-SMR200>3.0.CO;2-W]
• 14: Jean Mayrand , François Coallier, System acquisition based on software product assessment, Proceedings of the 18th international conference on Software engineering, p.210-219, March 25-29, 1996, Berlin, Germany
• 15: Tom Mens , Michel Wermelinger , Stéphane Ducasse , Serge Demeyer , Robert Hirschfeld , Mehdi Jazayeri, Challenges in Software Evolution, Proceedings of the Eighth International Workshop on Principles of Software Evolution, p.13-22, September 05-06, 2005 [doi>10.1109/IWPSE.2005.7]
• 16: Mika V. Mäntylä , Casper Lassenius, Subjective evaluation of software evolvability using code smells: An empirical study, Empirical Software Engineering, v.11 n.3, p.395-431, September 2006 [doi>10.1007/s10664-006-9002-8]
• 17: Lutz Prechelt , Barbara Unger , Michael Philippsen , Walter Tichy, A controlled experiment on inheritance depth as a cost factor for code maintenance, Journal of Systems and Software, v.65 n.2, p.115-126, 15 February 2003 [doi>10.1016/S0164-1212(02)00053-5]
• 18: Jeff Sauro , Erika Kindlund, A method to standardize usability metrics into a single score, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055028]
• 19: Ben Shneiderman, Software psychology: Human factors in computer and information systems (Winthrop computer systems series), Winthrop Publishers, 1980
• 20: Shepperd, M. J. System architecture metrics for controlling software maintainability. In Proceedings of the IEE Colloqium on Software Metrics, April 1--3, 1990.