Fully automatic assessment of programming exercises

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Fully automatic assessment of programming exercises

Full text

Pdf (452 KB)

Source

Annual Joint Conference Integrating Technology into Computer Science Education archive
Proceedings of the 6th annual conference on Innovation and technology in computer science education table of contents

Canterbury, United Kingdom

Pages: 133 - 136

Year of Publication: 2001

ISBN:1-58113-330-8

Also published in ...

Authors

Riku Saikkonen	Department of Computer Science and Engineering, Helsinki University of Technology, Finland
Lauri Malmi	Department of Computer Science and Engineering, Helsinki University of Technology, Finland
Ari Korhonen	Department of Computer Science and Engineering, Helsinki University of Technology, Finland

Sponsors

SIGCSE: ACM Special Interest Group on Computer Science Education
SIGCUE: ACM Special Interest Group on Computer Uses In Education

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 22, Downloads (12 Months): 70, Citation Count: 26

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/377435.377666 What is a DOI?

ABSTRACT

Automatic assessment of programming exercises has become an important method for grading students' exercises and giving feedback for them in mass courses. We describe a system called Scheme-robo, which has been designed for assessing programming exercises written in the functional programming language Scheme. The system assesses individual procedures instead of complete programs. In addition to checking the correctness of students' solutions the system provides many different tools for analysing other things in the program like its structure and running time, and possible plagiarism. The system has been in production use on our introductory programming course with some 300 students for two years with good results.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Harold Abelson , Gerald Jay Sussman , Julie Sussman, Structure and interpretation of computer programs, MIT Press, Cambridge, MA, 1985
	2	Benford, S., Burke, E., Foxley, E., Gutteridge, N., Mohd Zin, A.: Ceilidh: A Course Administration and Marking System. Proceedings of the International Conference of Computer Based Learning, Vienna, 1993.
	3	John English , Phil Siviter, Experience with an automatically assessed course, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.168-171, July 11-13, 2000, Helsinki, Finland
	4	David Jackson, A semi-automated approach to online assessment, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.164-167, July 11-13, 2000, Helsinki, Finland
	5	Ari Korhonen , Lauri Malmi, Algorithm simulation with automatic assessment, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.160-163, July 11-13, 2000, Helsinki, Finland
	6	N. I. Adams, IV , D. H. Bartley , G. Brooks , R. K. Dybvig , D. P. Friedman , R. Halstead , C. Hanson , C. T. Haynes , E. Kohlbecker , D. Oxley , K. M. Pitman , G. J. Rozas , G. L. Steele, Jr. , G. J. Sussman , M. Wand , H. Abelson, Revised5 report on the algorithmic language scheme, ACM SIGPLAN Notices, v.33 n.9, p.26-76, Sept. 1, 1998 [doi>10.1145/290229.290234]
	7	Martin, E.: Schools Using Scheme. http://www.schemers.corn/schools.html.

CITED BY 26

	Ari Korhonen , Lauri Malmi , Pertti Myllyselkä , Patrik Scheinin, Does it make a difference if students exercise on the web or in the classroom?, ACM SIGCSE Bulletin, v.34 n.3, September 2002
	Abelardo Pardo, A multi-agent platform for automatic assignment management, ACM SIGCSE Bulletin, v.34 n.3, September 2002
	J. E. Labra Gayo , J. M. Morales Gil , A. M. Fernández Álvarez , H. Sagastegui Chigne, A generic e-learning multiparadigm programming language system: IDEFIX project, ACM SIGCSE Bulletin, v.35 n.1, January 2003
	Brenda Cheang , Andy Kurnia , Andrew Lim , Wee-Chong Oon, On automated grading of programming assignments in an academic institution, Computers & Education, v.41 n.2, p.121-131, September 2003
	Janet Carter , Kirsti Ala-Mutka , Ursula Fuller , Martin Dick , John English , William Fone , Judy Sheard, How shall we assess this?, ACM SIGCSE Bulletin, v.35 n.4, December 2003
	John English, Automated assessment of GUI programs using JEWL, ACM SIGCSE Bulletin, v.36 n.3, September 2004
	Misook Heo, A learning and assessment tool for web-based distributed education, Proceedings of the 4th conference on Information technology curriculum, October 16-18, 2003, Lafayette, Indiana, USA
	Christopher Douce , David Livingstone , James Orwell, Automatic test-based assessment of programming: A review, Journal on Educational Resources in Computing (JERIC), v.5 n.3, p.4-es, September 2005
	Michael Blumenstein , Steven Green , Ann Nguyen , Vallipuram Muthukkumarasamy, An experimental analysis of GAME: a generic automated marking environment, ACM SIGCSE Bulletin, v.36 n.3, September 2004
	Abelardo Pardo , Carlos Delgado Kloos, Deploying interactive e-labs for a course on operating systems, Proceedings of the 6th conference on Information technology education, October 20-22, 2005, Newark, NJ, USA
	Sebastian Niezgoda , Thomas P. Way, SNITCH: a software tool for detecting cut and paste plagiarism, ACM SIGCSE Bulletin, v.38 n.1, March 2006
	Lauri Malmi , Ari Korhonen , Riku Saikkonen, Experiences in automatic assessment on mass courses and issues for designing virtual courses, ACM SIGCSE Bulletin, v.34 n.3, September 2002
	Mario Amelung , Michael Piotrowski , Dietmar Rösner, EduComponents: experiences in e-assessment in computer science education, ACM SIGCSE Bulletin, v.38 n.3, September 2006
	Lauri Malmi , Ville Karavirta , Ari Korhonen , Jussi Nikander, Experiences on automatically assessed algorithm simulation exercises with different resubmission policies, Journal on Educational Resources in Computing (JERIC), v.5 n.3, p.7-es, September 2005
	Mike Joy , Nathan Griffiths , Russell Boyatt, The boss online submission and assessment system, Journal on Educational Resources in Computing (JERIC), v.5 n.3, p.2-es, September 2005
	Jaime Spacco , David Hovemeyer , William Pugh , Fawzi Emad , Jeffrey K. Hollingsworth , Nelson Padua-Perez, Experiences with marmoset: designing and using an advanced submission and testing system for programming courses, ACM SIGCSE Bulletin, v.38 n.3, September 2006
	Tiantian Wang , Xiaohong Su , Yuying Wang , Peijun Ma, Semantic similarity-based grading of student programs, Information and Software Technology, v.49 n.2, p.99-107, February, 2007
	Michael T. Helmick, Interface-based programming assignments and automatic grading of java programs, ACM SIGCSE Bulletin, v.39 n.3, September 2007
	Petri Ihantola, Creating and visualizing test data from programming exercises, Informatics in education, v.6 n.1, p.81-102, January 2007
	Michael Blumenstein , Steve Green , Shoshana Fogelman , Ann Nguyen , Vallipuram Muthukkumarasamy, Performance analysis of GAME: A generic automated marking environment, Computers & Education, v.50 n.4, p.1203-1216, May, 2008
	Arnold Pears , Stephen Seidman , Lauri Malmi , Linda Mannila , Elizabeth Adams , Jens Bennedsen , Marie Devlin , James Paterson, A survey of literature on the teaching of introductory programming, ACM SIGCSE Bulletin, v.39 n.4, December 2007
	C. K. Chang , G. D. Chen , L. Y. Li, Constructing a community of practice to improve coursework activity, Computers & Education, v.50 n.1, p.235-247, January, 2008
	Petri Ihantola, Test data generation for programming exercises with symbolic execution in Java PathFinder, Proceedings of the 6th Baltic Sea conference on Computing education research: Koli Calling 2006, February 01-01, 2006, Uppsala, Sweden
	Mario Amelung , Peter Forbrig , Dietmar Rösner, Towards generic and flexible web services for e-assessment, Proceedings of the 13th annual conference on Innovation and technology in computer science education, June 30-July 02, 2008, Madrid, Spain
	Hussein Suleman, Automatic marking with Sakai, Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology, p.229-236, October 06-08, 2008, Wilderness, South Africa
	Ahmad Taherkhani , Lauri Malmi , Ari Korhonen, Algorithm recognition by static analysis and its application in students' submissions assessment, Proceedings of the 8th International Conference on Computing Education Research, November 13-16, 2008, Koli, Finland