Formative computer based assessment in diagram based domains

ABSTRACT

This paper presents an approach to conducting formative assessment of student coursework within diagram-based domains using Computer Based Assessment (CBA) technology. Formative assessment is perceived as a resource-intensive assessment mode and its usage is in steep decline in higher education. CBA technology developed out of the desire to automate assessment due to the necessity of assessing students with decreasing unit-resource; it can overcome the decline in formative assessment by automating those processes which are considered resource-intensive.The system described is based upon the CourseMarker CBA system (formerly CourseMaster / Ceilidh) and the DATsys object-oriented framework for CBA-oriented diagram editors. This paper outlines requirements for obtaining good formative assessment using CBA software and documents a live system which assessed student Entity Relationship diagrams within an undergraduate Database Systems course. Results are presented and considerable extensions proposed.

REFERENCES

• 1: Brown S., Race P. and Smith B., 500 Tips on Assessment, London: Kogan Page, 1996, ISBN 0749419415.
• 2: http://cygwin.com/cygwin-ug-net/
• 3: Colin Higgins , Tarek Hegazy , Pavlos Symeonidis , Athanasios Tsintsifas, The CourseMarker CBA System: Improvements over Ceilidh, Education and Information Technologies, v.8 n.3, p.287-304, September 2003 [doi>10.1023/A:1026364126982]
• 4: Foxley E., Higgins C., Symeonidis P. and Tsintsifas A., The CourseMaster Automated Assessment System - a next generation Ceilidh, Computer Assisted Assessment Workshop, Warwick, UK, 5-6 April 2001
• 5: Foxley E., Higgins C., Tsintsifas A. and Symeonidis P., Ceilidh: A System for the Automatic Evaluation of Student Programming Work, Proc. CBLIS'99, University of Twente, Netherlands, July 2-6 1999.
• 6: Juwah C., Macfarlane-Dick D., Matthew B., Nicol D., Ross D. and Smith B., Enhancing student learning through effective formative feedback. ISBN 1-904190-58-8.
• 7: Knight P., A Briefing on Key Concepts: Formative and summative, criterion and norm-referenced assessment, LTSN Generic Centre: Assessment Series, November 2001.
• 8: Ngo D.C.L., Teo L.S. and Byrne J.G., A Mathematical Theory of Interface Aesthetics, Visual Mathematics 2(4), Serbian Academy of Sciences and Arts, 2000.
• 9: Purchase H.C., Allder J. and Carrington D., Graph Layout Aesthetics in UML Diagrams: User Preferences, Journal of Graph Algorithms and Applications 6(3), p255--279, World Scientific Publishing, 2002, ISSN 1526-1719.
• 10: Tsintsifas A., A Framework for the Computer Based Assessment of Diagram Based Coursework, Ph.D. thesis, University of Nottingham, March 2002.
• 11: Yorke M., Assessment: A Guide for Senior Managers, LTSN Generic Centre: Assessment Series, November 2001.
• 12: Zin A. M. and Foxley E., The "oracle" program, LTR Report, Dept. of Computer Science, University of Nottingham, UK, 1992. Available from http://www.cs.nott.ac.uk/~ceilidh/papers.html

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-assisted instruction (CAI)

Additional Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-managed instruction (CMI)

General Terms:
Human Factors, Measurement, Performance

Keywords:
automatic assessment, education, formative assessment, testing