Teaching software quality assurance by encouraging student contributions to an open source web-based system for the assessment of programming assignments

ABSTRACT

This paper presents a novel and innovative pedagogical approach for teaching software quality assurance in the undergraduate computer science curriculum. The approach is based on students contributing programming problems to an open source web-based system that is used for student practice and instructor assessment of assignments. WeBWorK, and some of the latest web-based systems, use a mechanism based on unit testing to account for variation in the way in which the same problem can be answered in an accurate manner, making such systems highly appealing for education. Tackling open-ended programming problems within WeBWorK therefore requires students to write a code fragment that is then checked for semantic correctness. Given that WeBWorK is open source, the teaching approach that we have evolved revolves around students creating their own problems for other students to practice with. This requires students to construct comprehensive unit tests that can assure both the usability and accuracy of their work prior to deployment. The paper describes this approach, gives examples of student work, presents findings from the experience of using the approach in the classroom, and discusses broader lessons and reasons for integrating software quality assurance practices into the computer science curriculum.

REFERENCES

• 1: Jacqueline Baldwin , Eileen Crupi , Tabitha Estrellado, WeBWorK for programming fundamentals, Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education, June 26-28, 2006, Bologna, Italy
• 2: J. Baldwin, E. Crupi, T. Estrellado, O. Gotel, R. Kline, C. Scharff, and A. Wildenberg. Examples of WeBWorK programming assignments. In Proc. 37th SIGCSE Technical Symposium on Computer Science Education, Houston, Texas, USA, 2006. (Poster).
• 3: Peter Brusilovsky , Colin Higgins, Preface to the special issue on automated assessment of programming assignments, Journal on Educational Resources in Computing (JERIC), v.5 n.3, p.1-es, September 2005 [doi>10.1145/1163405.1163406]
• 4: M. Gage, A. Pizer, and V. Roth. WeBWorK: An internet-based system for generating and delivering homework problems. In Joint Meeting of the American Mathematical Society and the Mathematical Association of America, 2001.
• 5: Olly Gotel , Christelle Scharff, Adapting an open-source web-based assessment system for the automated assessment of programming problems, Proceedings of the sixth conference on IASTED International Conference Web-Based Education, p.437-442, March 14-16, 2007, Chamonix, France
• 6: Olly Gotel , Christelle Scharff , Andy Wildenberg, Extending and contributing to an open source web-based system for the assessment of programming problems, Proceedings of the 5th international symposium on Principles and practice of programming in Java, September 05-07, 2007, Lisboa, Portugal [doi>10.1145/1294325.1294327]
• 7: C. Jones. Software Cost Estimating Methods for Large Projects. CrossTalk: The Journal of Defense Software Engineering, April 2005.
• 8: The Standish Group. CHAOS Chronicles III. 2003. (http://www.standishgroup.com/chaos/toc.php).

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

Additional Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Curriculum

General Terms:
Verification

Keywords:
automated assessment systems, java, junit, open source, peer review, programming, requirements, software quality assurance, unit testing, webwork