A case study of the static analysis of the quality of novice student programs

ABSTRACT

Helping students to understand the quality of their programs is a difficult task hampered by the time instructors have for grading. When the number of programs to grade are in the hundreds, instructors may be able to handle dynamic analysis of the programs and possibly a cursory glance at the code itself. Automated solutions may appear attractive, but few exist in the literature. Further, not enough examples exist to help instructors choose what metrics would be useful for helping students to visualize how they program. In this study, a collection of static metrics data obtained with Verilog Logiscope is correlated to an estimate of program quality to determine which metrics would show students at least the instructor's idea of quality. The study results are encouraging and show that definite correlations exist so that static analysis is a viable methodology for assessing student work. Further work is considered to help to confirm the study's results and their practical application.

REFERENCES

• 1: R E. Berry , B A.E. Meekings, A style analysis of C programs, Communications of the ACM, v.28 n.1, p.80-88, Jan. 1985 [doi>10.1145/2465.2469]
• 2: Warren Harrison , Curtis R. Cook, A note on the Berry-Meekings style metric, Communications of the ACM, v.29 n.2, p.123-125, Feb. 1986 [doi>10.1145/5657.5660]
• 3: Sheung-Lun Hung , Lam-For Kwok , Raymond Chan, Automatic programming assessment, Computers & Education, v.20 n.2, p.183-190, March 1993 [doi>10.1016/0360-1315(93)90086-X]
• 4: David Jackson, A software system for grading student computer programs, Computers & Education, v.27 n.3-4, p.171-180, Dec. 1996 [doi>10.1016/S0360-1315(96)00025-5]
• 5: Ronald J. Leach, Using metrics to evaluate student programs, ACM SIGCSE Bulletin, v.27 n.2, p.41-43, June 1995 [doi>10.1145/201998.202010]
• 6: V. Yerramilli. Static Analysis of Novice Student C++ Programs. Master's Thesis, Computer Science, Texas Tech University, May 1998.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Training

General Terms:
Documentation, Human Factors