Assessing undergraduate experience of continuous integration and test-driven development

ABSTRACT

A number of agile practices are included in software engineering curricula, including test-driven development. Continuous integration often is not included, despite it becoming increasingly common in industry to code, test, and integrate at the same time. This paper describes a study whereby software engineering undergraduates were given a short intensive experience of test-driven development with continuous integration using an environment that imitated a typical industrial circumstance. Assessment was made of students' agile experience rather than of project deliverables, using a novel set of process measures that examined students' participation and performance in agile testing. Results showed good participation by student pairs, and clear understanding of agile processes and configuration management. Future work will investigate automation of the assessment of continuous integration and configuration management server data.

REFERENCES

• 1: Eric Allen , Robert Cartwright , Charles Reis, Production programming in the classroom, Proceedings of the 34th SIGCSE technical symposium on Computer science education, February 19-23, 2003, Reno, Navada, USA
• 2: Stephen H. Edwards, Improving student performance by evaluating how well students test their own programs, Journal on Educational Resources in Computing (JERIC), v.3 n.3, p.1-es, September 2003 [doi>10.1145/1029994.1029995]
• 3: Stephen H. Edwards, Using software testing to move students from trial-and-error to reflection-in-action, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 4: Frezza, S. Integrating Testing and Design Methods for Undergraduates: Teaching Software Testing in the Context of Software Design. In Proceedings of the 32nd ASEE/IEEE Frontiers in Education Conference (Boston, MA, November 6-9, 2002).
• 5: Goldman, A., Kon F., Silva P.J.S., and Yoder J.W., Being Extreme in the Classroom: Experiences Teaching XP. Journal of the Brazilian Computer Society, 10, 2 (2004), 1--17.
• 6: Don Gotterbarn, UML and agile methods: in support of irresponsible development, ACM SIGCSE Bulletin, v.36 n.2, June 2004 [doi>10.1145/1024338.1024344]
• 7: http://ant.apache.org/
• 8: http://cruisecontrol.sourceforge.net
• 9: http://www.urbancode.com/projects/anthill/default.jsp
• 10: Christopher G. Jones, Test-driven development goes to school, Journal of Computing Sciences in Colleges, v.20 n.1, p.220-231, October 2004
• 11: Neha Katira , Laurie Williams , Jason Osborne, Towards increasing the compatibility of student pair programmers, Proceedings of the 27th international conference on Software engineering, p.625-626, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062572]
• 12: Karen Keefe , Martin Dick, Using Extreme Programming in a capstone project, Proceedings of the sixth conference on Australasian computing education, p.151-160, January 01, 2004, Dunedin, New Zealand
• 13: Macias, F., Holcolmbe, M., and Gheorghe, M. Design-led & Design-less: One Experiment and Two Approaches. Lecture Notes in Computer Science, 2675, (2003), 394--401.
• 14: Muller, M.M., Link J., Sand R., and Mahlpohl, G. Extreme Programming in Curriculum: Experiences from Academia and Industry. In International Conference on Extreme Programming and Agile Processes in Software Engineering (XP2004) (Garmisch-Partenkirchen, Germany, June 2004).
• 15: Michael Wick , Daniel Stevenson , Paul Wagner, Using testing and JUnit across the curriculum, Proceedings of the 36th SIGCSE technical symposium on Computer science education, February 23-27, 2005, St. Louis, Missouri, USA
• 16: Williams, L. and Upchurch, R. Extreme Programming for Software Engineering Education? In Proceedings of the 31st ASEE/IEEE Frontiers in Education Conference (Reno, NV, October 10-13, 2001).

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

General Terms:
Design, Human Factors, Measurement, Verification

Keywords:
JUnit, agile practices, assessment process, continuous integration, software engineering education, test driven development