On the complexity of measuring software complexity

ABSTRACT

The term software complexity (program quality, program complexity,...) has been used by software engineering researchers to denote the testability, maintainability, readability, and/or comprehensibility of a program. Curtis points out a common bond that unites all these concepts: a program's complexity determines how difficult it is for programmers to work with.

REFERENCES

• 1: Atwood, M. A. and Ramsey, H. R., "Cognitive Structures in the Comprehension and Memory of Computer Programs: An Investigation of Computer Program Debugging," ARI Technical Report TR-78-A21, August 1978.
• 2: Atwood, M., Turner, A., Ramsey, H. R., and Hooper, J., "An Exploratory Study of the Cognitive Structures Underlying the Comprehension of Software and Design Problems," U.S. Army Research Institute for the Behavioral and Social Sciences, Technical Report 392, July 1979.
• 3: Boehm, B., "The High Cost of Software," Practical Strategies for Developing Large Software Systems, Addison-Wesley, 1975.
• 4: Brooks, R., "Towards a Theory of Cognitive Processes in Computer Programming," International Journal of Man-Machine Studies, Vol. 9, 1977, pp. 737--752.
• 5: Ruven Brooks, Using a behavioral theory of program comprehension in software engineering, Proceedings of the 3rd international conference on Software engineering, p.196-201, May 10-12, 1978, Atlanta, Georgia, United States
• 6: Chapin, N., "A Measure of Software Complexity," Proceedings of the 1979 National Computer Conference, New York, 1979, pp. 995--1002.
• 7: B. Curtis , S. B. Sheppard , P. Milliman , M. A. Borst , T. Love, Measuring the Psychological Complexity of Software Maintenance Tasks with the Halstead and McCabe Metrics, IEEE Transactions on Software Engineering, v.5 n.2, p.96-104, March 1979 [doi>10.1109/TSE.1979.234165]
• 8: Dunsmore, H. E. and Gannon, J. D., "Analysis of the Effects of Programming Factors on Programming Effort," The Journal of Systems and Software, 1980, pp. 141--153.
• 9: R. D. Gordon, Measuring Improvements in Program Clarity, IEEE Transactions on Software Engineering, v.5 n.2, p.79-90, March 1979 [doi>10.1109/TSE.1979.234163]
• 10: Gould, J. D., "Some Psychological Evidence on How People Debug Computer Programs," Technical Report RC 4542, IBM Thomas J. Watson Research Center, Yorktown Heights, N.Y., 1973.
• 11: Gould, J. D., and Drongowski, M., "An Exploratory Study of Computer Program Debugging," Journal of Human Factors, Vol. 16, No. 3, 1974, pp. 258--277.
• 12: Maurice H. Halstead, Elements of Software Science (Operating and programming systems series), Elsevier Science Inc., New York, NY, 1977
• 13: Wilfred J. Hansen, Measurement of program complexity by the pair: (Cyclomatic Number, Operator Count), ACM SIGPLAN Notices, v.13 n.3, p.29-33, March 1978 [doi>10.1145/954373.954375]
• 14: Tom Love, An experimental investigation of the effect of program structure on program understanding, ACM SIGPLAN Notices, v.12 n.3, p.105-113, March 1977
• 15: Ann Fitzsimmons , Tom Love, A Review and Evaluation of Software Science, ACM Computing Surveys (CSUR), v.10 n.1, p.3-18, March 1978 [doi>10.1145/356715.356717]
• 16: T. J. McCabe, A Complexity Measure, IEEE Transactions on Software Engineering, v.2 n.4, p.308-320, July 1976 [doi>10.1109/TSE.1976.233837]
• 17: Carma L. McClure, A model for program complexity analysis, Proceedings of the 3rd international conference on Software engineering, p.149-157, May 10-12, 1978, Atlanta, Georgia, United States
• 18: Thomas Moher , G. Michael Schneider, Methods for improving controlled experimentation in software engineering, Proceedings of the 5th international conference on Software engineering, p.224-233, March 09-12, 1981, San Diego, California, United States
• 19: Glenford J. Myers, An extension to the cyclomatic measure of program complexity, ACM SIGPLAN Notices, v.12 n.10, p.61-64, October 1977 [doi>10.1145/954627.954633]
• 20: Glenford J. Myers, A controlled experiment in program testing and code walkthroughs/inspections, Communications of the ACM, v.21 n.9, p.760-768, Sept. 1978 [doi>10.1145/359588.359602]
• 21: H. Sackman , W. J. Erikson , E. E. Grant, Exploratory experimental studies comparing online and offline programming performance, Communications of the ACM, v.11 n.1, p.3-11, Jan. 1968 [doi>10.1145/362851.362858]
• 22: Schwartz, J., "Analyzing Large-scale System Development," Software Engineering Concepts and Techniques, Proceedings of the 1968 NATO Conference.
• 23: Sheppard, S., Borst, R., and Curtis, W., "Predicting Programmers' Ability to Understand and Modify Software," Proceedings of Symposium on Human Factors and Computer Science, Washington, D.C., June 1978, pp. 115--135.
• 24: S. B. Sheppard , B. Curtis , P. Milliman , T. Love, Modern Coding Practices and Programmer Performance, Computer, v.12 n.12, p.41-49, December 1979 [doi>10.1109/MC.1979.1658575]
• 25: Sheppard, S., Curtis, W., and Milliman, P. M., "Experimental Evaluation of On-line Program Construction," GE Technical Report TR-79-388100-6, December 1979.
• 26: Shneiderman, B., "Exploratory Experiments in Programmer Behavior," International Journal of Man-Machine Studies, Vol. 5, No. 2, 1976, pp. 123--143.
• 27: Shneiderman, B., "Measuring Computer Program Quality and Comprehension," International Journal of Man-Machine Studies, Vol. 9, No. 3, 1977, pp. 465--478.
• 28: Ben Shneiderman , Richard Mayer , Don McKay , Peter Heller, Experimental investigations of the utility of detailed flowcharts in programming, Communications of the ACM, v.20 n.6, p.373-381, June 1977 [doi>10.1145/359605.359610]
• 29: Shneiderman, B. and Mayer, R., "Syntactic-Semantic Interactions in Programmer Behavior: A Model and Experimental Results," International Journal of Computer and Information Sciences, Vol. 8, 1979, pp. 219--238.
• 30: M. R. Woodward , M. A. Hennell , D. Hedley, A Measure of Control Flow Complexity in Program Text, IEEE Transactions on Software Engineering, v.5 n.1, p.45-50, January 1979 [doi>10.1109/TSE.1979.226497]
• 31: Gorsline, G., and Fainter, R. "Program Complexity Measures." ACM/NBS 19th Annual Technical Symposium. Gaithersburg, Maryland, June 1980.
• 32: Miller, L. G. "Programming by Nonprogrammers." International Journal of Man-Machine Studies, 6 (1974), pp. 237--260.