A survey of evidence for test-driven development in academia

ABSTRACT

University professors traditionally struggle to incorporate software testing into their course curriculum. Worries include double-grading for correctness of both source and test code and finding time to teach testing as a topic. Test-driven development (TDD) has been suggested as a possible solution to improve student software testing skills and to realize the benefits of testing. According to most existing studies, TDD improves software quality and student productivity. This paper surveys the current state of TDD experiments conducted exclusively at universities. Similar surveys compare experiments in both the classroom and industry, but none have focused strictly on academia.

REFERENCES

• 1: S. Ambler. Test-Driven Development is the Combination of Test First Development and Refactoring. Dr. Dobbs' Agile Newsletter, June 12, 2006.
• 2: Elena García Barriocanal , Miguel-Ángel Sicilia Urbán , Ignacio Aedo Cuevas , Paloma Díaz Pérez, An experience in integrating automated unit testing practices in an introductory programming course, ACM SIGCSE Bulletin, v.34 n.4, December 2002 [doi>10.1145/820127.820183]
• 3: Beck, Test Driven Development: By Example, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2002
• 4: S. Edwards. Using Test-Driven Development in the Classroom: Providing Students with Automatic, Concrete Feedback on Performance. In Proc. Intl' Conf. on Education and Information Systems: Technologies and Applications (EISTA), August 2003.
• 5: Stephen H. Edwards, Using software testing to move students from trial-and-error to reflection-in-action, ACM SIGCSE Bulletin, v.36 n.1, March 2004
• 6: Hakan Erdogmus , Maurizio Morisio , Marco Torchiano, On the Effectiveness of the Test-First Approach to Programming, IEEE Transactions on Software Engineering, v.31 n.3, p.226-237, March 2005 [doi>10.1109/TSE.2005.37]
• 7: David Janzen , Hossein Saiedian, Test-Driven Development: Concepts, Taxonomy, and Future Direction, Computer, v.38 n.9, p.43-50, September 2005 [doi>10.1109/MC.2005.314]
• 8: David S. Janzen , Hossein Saiedian, Test-driven learning: intrinsic integration of testing into the CS/SE curriculum, Proceedings of the 37th SIGCSE technical symposium on Computer science education, March 03-05, 2006, Houston, Texas, USA
• 9: David S. Janzen , Hossein Saiedian, A Leveled Examination of Test-Driven Development Acceptance, Proceedings of the 29th international conference on Software Engineering, p.719-722, May 20-26, 2007 [doi>10.1109/ICSE.2007.8]
• 10: David Janzen , Hossein Saiedian, Test-driven learning in early programming courses, Proceedings of the 39th SIGCSE technical symposium on Computer science education, March 12-15, 2008, Portland, OR, USA
• 11: Ron Jeffries , Grigori Melnik, Guest Editors' Introduction: TDD--The Art of Fearless Programming, IEEE Software, v.24 n.3, p.24-30, May 2007 [doi>10.1109/MS.2007.75]
• 12: Christopher G. Jones, Test-driven development goes to school, Journal of Computing Sciences in Colleges, v.20 n.1, p.220-231, October 2004
• 13: Reid Kaufmann , David Janzen, Implications of test-driven development: a pilot study, Companion of the 18th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, October 26-30, 2003, Anaheim, CA, USA [doi>10.1145/949344.949421]
• 14: Karen Keefe , Judithe Sheard , Martin Dick, Adopting XP practices for teaching object oriented programming, Proceedings of the 8th Austalian conference on Computing education, p.91-100, January 16-19, 2006, Hobart, Australia
• 15: Craig Larman , Victor R. Basili, Iterative and Incremental Development: A Brief History, Computer, v.36 n.6, p.47-56, June 2003 [doi>10.1109/MC.2003.1204375]
• 16: L. Madeyski. Preliminary Analysis of the Effects of Pair Programming and Test-Driven Development on the External Code Quality. Software Engineering: Evolution and Emerging Technologies, 130:113--123, 2005.
• 17: Grigori Melnik , Frank Maurer, A cross-program investigation of students' perceptions of agile methods, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062543]
• 18: M. Muller and O. Hagner. Experiment About Test-First Programming. IEEE Proc. Software, 149(5):131--136, October 2002.
• 19: Matthias M. Müller , Walter F. Tichy, Case study: extreme programming in a university environment, Proceedings of the 23rd International Conference on Software Engineering, p.537-544, May 12-19, 2001, Toronto, Ontario, Canada
• 20: M. Pancur, M. Ciglaric, M. Trampus, and T. Vidmar. Towards Empirical Evaluation of Test-Driven Development in a University Environment. In IEEE Region 8 Proc. EUROCON, volume 2, pages 83--86. IEEE Press, September 2003.
• 21: Jaime Spacco , William Pugh, Helping students appreciate test-driven development (TDD), Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications, October 22-26, 2006, Portland, Oregon, USA [doi>10.1145/1176617.1176743]
• 22: S. Yenduri and L. Perkins. Impact of Using Test-Driven Development: A Case Study. Software Engineering Research and Practice, pages 126--129, 2006.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

Additional Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Curriculum

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
empirical survey, pedagogy, test-driven development