APOGEE: automated project grading and instant feedback system for web based computing

ABSTRACT

Providing consistent, instant, and detailed feedback to students has been a great challenge in teaching Web based computing. We present the prototype of an automated grading system called ProtoAPOGEE for enriching students' learning experience and elevating faculty productivity. Unlike other automated graders used in introductory programming classes, ProtoAPOGEE emphasizes the examination of quality attributes of student project submissions, in addition to the basic functionality requirements. The tool is able to generate step by step play-back guidance for failed test cases, hence providing informative feedback to help students make reflective and iterative improvements in learning.

REFERENCES

• 1: Joint Task Force on Computing Curricula IEEE Computer Society, Association for Computing Machinery, "Computing Curricula 2001 Computer Science", available at http://acm.org/education/curric_vols/cc2001.pdf, 2001.
• 2: Arnow, D. and Barshay, O. WebToTeach: a Web-based Automated Program Checker, Proceedings of the 29th Frontiers in Education Conference (FIE'99), San Juan, Puerto Rico, 1999.
• 3: Edwards, S. H. Education Support for Testing Graphical User Interfaces, NSF Award Abstract #0633594, 2007.
• 4: Edwards, S. H. Using Test-Driven Development in the Classroom Providing Students with Automatic, Concrete Feedback on Performance, International Conference on Education and Information Systems: Technologies and Applications (EISTA'03), pp. 421--426, 2003.
• 5: Stephen H. Edwards, Using software testing to move students from trial-and-error to reflection-in-action, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 6: Feng M. Y., and McAllister, A. A Tool for Automatic GUI Grading, 36th ASEE/IEEE Frontiers in Education Conference, 2006.
• 7: George E. Forsythe , Niklaus Wirth, Automatic grading programs, Communications of the ACM, v.8 n.5, p.275-278, May 1965 [doi>10.1145/364914.364937]
• 8: Foubister, S., Michaelson, G., and Tomes, N. Automatic assessment of elementary Standard ML programs using Ceilidh, Journal of Computer Assisted Learning, Vol. 13, No. 1, pp. 99--108, March 1997.
• 9: Gage, M., Pizer, A., et al., WeBWorK Online Homework Delivery System, available at http://devel.webwork.rochester.edu/twiki/bin/view/Webwork/WebHome, retrieved May 1, 2007.
• 10: Gorgone, J. T. , Davis, G. B., Valacich, J. S., Topi, H., Feinstein, D. L. , and Longenecker Jr., H. E. "Model Curriculum and Guidelines for Undergraduate Degree Programs in Information Systems", available at http://www.acm.org/education/is2002.pdf, 2002.
• 11: [e-mail], "WatiN: Web Application Testing in .Net," available at http://watin.sourceforge.net/documentatie.html, retrieved May 1, 2007.
• 12: Kohl, J., et al., Watir: Web Application Testing in Ruby, available at http://wtr.rubyforge.org/, retrieved May, 2007.
• 13: Laakso, M. J., Salakoski, T., and Korhonen, A. The Feasibility of Automatic Assessment and Feedback, In Proceedings of the IADIS International Conference on Cognition and Exploratory Learning in Digital Age, 2005.
• 14: Leal, J. P., and Moreira, N. Automatic Grading of Programming Exercises, Technical Report DCC-98-4, DCC-FC& LIACC, UP, June 1998.
• 15: urs von Matt, Kassandra: the automatic grading system, ACM SIGCUE Outlook, v.22 n.1, p.26-40, January 1994 [doi>10.1145/182107.182101]
• 16: NetBeans.org. "Jemmy Module Documentation," available at http://jemmy.netbeans.org/documentation.html, retrieved May 1, 2007.
• 17: David Thomas , Andrew Hunt, Programming Ruby: the pragmatic programmer's guide, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2000
• 18: Tao, L., Qian, K., Fu, X., and Liu, J. Curriculum and Lab Renovations for Teaching Server-Based Computing, (poster paper), ACM Technical Symposium on Computer Science Education (SIGCSE 2007), Covington, Kentucky, USA, March 7--10, 2007.
• 19: Wall, T. Getting Started with the Abbot Java GUI Test Framework, available at http://abbot.sourceforge.net/doc/overview.shtml, retrieved May 1, 2007.
• 20: Wiley Inc., "Companion Tool of Java Concepts, 5th Edition", information available at http://he-cda.wiley.com/WileyCDA/HigherEdTitle/productCd-0470105550,courseCd-CX0500,pageType-supplements.html, retrieved May 1, 2007.
• 21: Li, LEUnit, available at http://ieunit.sourceforge.net/, retrieved Aug 31, 2007.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

Additional Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-assisted instruction (CAI)

General Terms:
Design, Reliability, Security, Verification

Keywords:
automated grading, test case generation, web application