Psychological complexity of computer programs: an experimental methodology

ABSTRACT

In order to reduce the complexity of programs many ideas and techniques have been expounded. However, no quantitative evidence has been given that the quality of the programs has indeed been improved. We believe that experimental studies should be performed to measure those factors which make programs difficult to understand and maintain. The first step in such research is to establish a suitable experimental methodology. This paper describes a series of experiments which have been conducted with the aim of establishing such a methodology.

REFERENCES

• 1: {Alexander 1964} C. Alexander, <u>Notes on the Synthesis of Form</u>, Harvard University Press, 1964
• 2: {Belady and Lehman 1971} L. Belady and M. Lehman, "Programming System Dynamics or the Meta-Dynamics of Systems in Maintenance and Growth", IBM Research Report RC 3546, 1971
• 3: {Buxton and Randell 1969} J. Buxton and B. Randell (eds.), <u>Software Engineering Techniques</u>, Report on a Conference Sponsored by the NATO Science Committee, Rome, Italy, 1969
• 4: {Cochran and Cox 1950} W. Cochran and G. Cox, <u>Experimental Designs</u>, John Wiley & Sons, Inc., 1950
• 5: {Cox 1958} D. Cox, <u>Planning of Experiments</u>, John Wiley & Sons, Inc., 1958
• 6: {Dijkstra 1969} F. Dijkstra, "Notes on Structured Programming", Report EWD249, Technische Hogeschool Eindhoven, 1969
• 7: {Dijkstra 1971a} E. Dijkstra, "Hierarchical Ordering of Sequential Processes", <u>Acta Informatica</u>, vol. 1, no. 2, 1971
• 8: {Dijkstra 1971b} E. Dijkstra, "A Short Introduction to the Art of Programming", Report EWD316, Technische Hogeschool Eindhoven, 1971
• 9: M. H. Halstead, Natural laws controlling algorithm structure?, ACM SIGPLAN Notices, v.7 n.2, p.19-26, February 1972 [doi>10.1145/953363.953366]
• 10: {Miller 1973} L. Miller, "Programming by Non-Programmers", IBM Research Report RC 4280, 1973
• 11: {Mills 1972} H. Mills, "Mathematical Foundations for Structured Programming", IBM Federal Systems Division Report FSC 72-6012, 1972
• 12: {Naur and Randell 1968} P. Naur and B. Randell (eds.), <u>Software Engineering</u>, Report on a Conference Sponsored by the NATO Science Committee, Garmische, Germany, 1968
• 13: {Parnas 1971} D. Parnas, "Information Distribution Aspects of Design Methodology", <u>Proceedings of IFIP Congress 71</u>, 1971
• 14: {Satterthwaite 1972} E. Satterthwaite, "Debugging Tools for High-Level Languages", <u>Software - Practice and Experience</u>, vol. 2, no. 3, 1972
• 15: {Sime 1973} M. Sime, T. Green, and D. Guest, "Psychological Evaluation of Two Conditional Constructions Used in Computer Languages", <u>International Journal of Man-Machine Studies</u>, vol. 5, no. 1, 1973
• 16: Gerald M. Weinberg, The Psychology of Computer Programming, John Wiley & Sons, Inc., New York, NY, 1985
• 17: {Weissman 1973} L. Weissman, "Psychological Complexity of Computer Programs: An Initial Experiment", Technical Report CSRG-26, Computer Systems Research Group, University of Toronto, 1973
• 18: {Wheeler 1971} D. Wheeler, "Assessing the Complexity of Computer Systems", <u>Proceedings of IFIP Congress 71</u>, 1971
• 19: Niklaus Wirth, Program development by stepwise refinement, Communications of the ACM, v.14 n.4, p.221-227, April 1971 [doi>10.1145/362575.362577]
• 20: W. Wulf , Mary Shaw, Global variable considered harmful, ACM SIGPLAN Notices, v.8 n.2, p.28-34, February 1973 [doi>10.1145/953353.953355]