Experiences in automatic assessment on mass courses and issues for designing virtual courses

ABSTRACT

In this paper, we present some experiences on using automatic assessment in large scale courses of introductory programming, data structures, and algorithms over a period of 10 years. Automatic assessment provides an effective method for giving immediate 24/7 feedback service for students of mass courses. A very important factor in the promoting of learning is the possibility to resubmit answers after receiving the feedback. However, our experience shows that the resubmission option is not the only key motivation factor. More important factors include the challenge of exercises and the grading scale or the course assignments. A successful combination of all of these can produce good learning results.

REFERENCES

• 1: Ryan S. Baker , Michael Boilen , Michael T. Goodrich , Roberto Tamassia , B. Aaron Stibel, Testers and visualizers for teaching data structures, The proceedings of the thirtieth SIGCSE technical symposium on Computer science education, p.261-265, March 24-28, 1999, New Orleans, Louisiana, United States
• 2: S. Benford, E. Burke, E. Foxley, N. Gutteridge, and A. M. Zin. Ceilidh: A course administration and marking system. In Proceedings of the International Conference of Computer Based Learning, Vienna, Austria, 1993.
• 3: John English , Phil Siviter, Experience with an automatically assessed course, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.168-171, July 11-13, 2000, Helsinki, Finland
• 4: J. Hyvönen and L. Malmi. Trakla -- a system for teaching algorithms using email and a graphical editor. In Proceedings of HYPERMEDIA in Vaasa, pages 141--147, Vaasa Institute of Technology, Vaasa, Finland, 1993.
• 5: David Jackson, A semi-automated approach to online assessment, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.164-167, July 11-13, 2000, Helsinki, Finland
• 6: David Jackson , Michelle Usher, Grading student programs using ASSYST, Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education, p.335-339, February 27-March 01, 1997, San Jose, California, United States
• 7: Ari Korhonen , Lauri Malmi, Algorithm simulation with automatic assessment, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.160-163, July 11-13, 2000, Helsinki, Finland
• 8: Ari Korhonen , Lauri Malmi , Pertti Myllyselkä , Patrik Scheinin, Does it make a difference if students exercise on the web or in the classroom?, Proceedings of the 7th annual conference on Innovation and technology in computer science education, June 24-28, 2002, Aarhus, Denmark
• 9: Ari Korhonen , Lauri Malmi , Riku Saikkonen, Matrix - concept animation and algorithm simulation system, Proceedings of the 6th annual conference on Innovation and technology in computer science education, p.180, June 2001, Canterbury, United Kingdom
• 10: A. Korhonen, J. Nikander, R. Saikkonen, and P. Tenhunen. Matrix -- algorithm simulation and animation tool. http://www.cs.hut.fi/Research/Matrix/, November 2001.
• 11: D. C. Phillips. Constructivism in Education. Opinions and Second Opinions on Controversial Issues. Ninety-ninth Yearbook of the National Society for the Study of Education. Part 1. The University of Chicago Press, Chicago, Illinois, USA, 2000.
• 12: Kenneth A. Reek, The TRY system -or- how to avoid testing student programs, Proceedings of the twentieth SIGCSE technical symposium on Computer science education, p.112-116, February 23-24, 1989, Louisville, Kentucky, United States
• 13: Riku Saikkonen , Lauri Malmi , Ari Korhonen, Fully automatic assessment of programming exercises, Proceedings of the 6th annual conference on Innovation and technology in computer science education, p.133-136, June 2001, Canterbury, United Kingdom

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-assisted instruction (CAI)

Additional Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Distance learning
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

General Terms:
Human Factors

Keywords:
automatic assessment