A survey of literature on the teaching of introductory programming

ABSTRACT

Three decades of active research on the teaching of introductory programming has had limited effect on classroom practice. Although relevant research exists across several disciplines including education and cognitive science, disciplinary differences have made this material inaccessible to many computing educators. Furthermore, computer science instructors have not had access to a comprehensive survey of research in this area. This paper collects and classifies this literature, identifies important work and mediates it to computing educators and professional bodies.

We identify research that gives well-supported advice to computing academics teaching introductory programming. Limitations and areas of incomplete coverage of existing research efforts are also identified. The analysis applies publication and research quality metrics developed by a previous ITiCSE working group [74].

REFERENCES

• 1: Harold Abelson , Gerald Jay Sussman , Julie Sussman, Structure and interpretation of computer programs, MIT Press, Cambridge, MA, 1985
• 2: Tuukka Ahoniemi , Tommi Reinikainen, ALOHA - a grading tool for semi-automatic assessment of mass programming courses, Proceedings of the 6th Baltic Sea conference on Computing education research: Koli Calling 2006, February 01-01, 2006, Uppsala, Sweden [doi>10.1145/1315803.1315830]
• 3: K. Ala-Mutka. A survey of automated assessment approaches for programming assignments. Computer Science Education, 15(2):83--102, 2005.
• 4: Eric Allen , Robert Cartwright , Brian Stoler, DrJava: a lightweight pedagogic environment for Java, ACM SIGCSE Bulletin, v.34 n.1, March 2002
• 5: Carl Alphonce , Blake Martin, Green: a customizable UML class diagram plug-in for eclipse, Companion to the 20th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, October 16-20, 2005, San Diego, CA, USA [doi>10.1145/1094855.1094917]
• 6: J. R Anderson , E. Skwarecki, The automated tutoring of introductory computer programming, Communications of the ACM, v.29 n.9, p.842-849, Sept. 1986 [doi>10.1145/6592.6593]
• 7: Byron Weber Becker, Teaching CS1 with karel the robot in Java, Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education, p.50-54, February 2001, Charlotte, North Carolina, United States
• 8: Katrin Becker, Back to Pascal: retro but not backwards, Journal of Computing Sciences in Colleges, v.18 n.2, p.17-27, December 2002
• 9: Mordechai Ben-Ari, Constructivism in computer science education, Proceedings of the twenty-ninth SIGCSE technical symposium on Computer science education, p.257-261, February 26-March 01, 1998, Atlanta, Georgia, United States
• 10: Jens Bennedsen , Michael E. Caspersen, Programming in context: a model-first approach to CS1, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 11: Joseph Bergin , Jim Roberts , Richard Pattis , Mark Stehlik, Karel++: A Gentle Introduction to the Art of Object-Oriented Programming, John Wiley & Sons, Inc., New York, NY, 1996
• 12: Robert Biddle , Ewan Tempero, Java pitfalls for beginners, ACM SIGCSE Bulletin, v.30 n.2, p.48-52, June 1998 [doi>10.1145/292422.292441]
• 13: Kevin Bierre , Phil Ventura , Andrew Phelps , Christopher Egert, Motivating OOP by blowing things up: an exercise in cooperation and competition in an introductory java programming course, Proceedings of the 37th SIGCSE technical symposium on Computer science education, March 03-05, 2006, Houston, Texas, USA
• 14: J. Biggs. What the student does: teaching for enhanced learning. Higher Education Research and Development, 18(1):57--75, 1999.
• 15: L. Böszörményi. Why Java is not my favorite first-course language. Software-Concepts & Tools, 19(3):141--145, 1998.
• 16: E. Boyer. Scholarship Reconsidered: Priorities of the Professoriate. Jossey-Bass, Hillsdale, NJ, 1997.
• 17: Susan S. Brilliant , Timothy R. Wiseman, The first programming paradigm and language dilemma, ACM SIGCSE Bulletin, v.28 n.1, p.338-342, March 1996
• 18: Benjamin M. Brosgol, A comparison of Ada and Java as a foundation teaching language, ACM SIGAda Ada Letters, v.XVIII n.5, p.12-38, Sept./Oct. 1998 [doi>10.1145/291712.291752]
• 19: Duane Buck , David J. Stucki, JKarelRobot: a case study in supporting levels of cognitive development in the computer science curriculum, Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education, p.16-20, February 2001, Charlotte, North Carolina, United States
• 20: Martin C. Carlisle , Terry A. Wilson , Jeffrey W. Humphries , Steven M. Hadfield, RAPTOR: introducing programming to non-majors with flowcharts, Journal of Computing Sciences in Colleges, v.19 n.4, p.52-60, April 2004
• 21: Computing curricula 2005; the overview report, 2005.
• 22: David Clark , Cara MacNish , Gordon F. Royle, Java as a teaching language—opportunities, pitfalls and solutions, Proceedings of the 3rd Australasian conference on Computer science education, p.173-179, July 08-10, 1998, The University of Queensland, Australia [doi>10.1145/289393.289418]
• 23: Richard Close , Danny Kopec , Jim Aman, CS1: perspectives on programming languages and the breadth-first approach, Proceedings of the fifth annual CCSC northeastern conference on The journal of computing in small colleges, p.228-234, April 2000, Ramapo College of New Jersey, Mahwah, New Jersey, United States
• 24: A. Collins, J. Brown, and S. E. Newman. Knowing, learning and instruction: Essays in honour of Robert Glaser, section Cognitive apprenticeship: Teaching the craft of reading, writing and mathematics. Erlbaum, San Francisco, 1989.
• 25: S. Cooper, W. Dann, and R. Pausch. Using animated 3d graphics to prepare novices for CS1. Computer Science Education, 13(1):3--30, 2003.
• 26: Leliane Nunes de Barros , Ana Paula dos Santos Mota , Karina Valdivia Delgado , Patricia Megumi Matsumoto, A tool for programming learning with pedagogical patterns, Proceedings of the 2005 OOPSLA workshop on Eclipse technology eXchange, p.125-129, October 16-17, 2005, San Diego, California [doi>10.1145/1117696.1117722]
• 27: M. de Raadt, R. Watson, and M. Toleman. Language Trends in Introductory Programming. In Proceedings of Informing Science and IT Education Conference, pages 329--337. InformingScience.org, June 2002.
• 28: Michael de Raadt , Richard Watson , Mark Toleman, Introductory programming: what's happening today and will there be any students to teach tomorrow?, Proceedings of the sixth conference on Australasian computing education, p.277-282, January 01, 2004, Dunedin, New Zealand
• 29: Peter J. Denning, A debate on teaching computing science, Communications of the ACM, v.32 n.12, p.1397-1414, Dec. 1989 [doi>10.1145/76380.76381]
• 30: Edsger W. Dijkstra, Letters to the editor: go to statement considered harmful, Communications of the ACM, v.11 n.3, p.147-148, March 1968 [doi>10.1145/362929.362947]
• 31: Adair Dingle , Carol Zander, Assessing the ripple effect of CS1 language choice, Proceedings of the second annual CCSC on Computing in Small Colleges Northwestern conference, p.85-93, October 2000, Oregon Graduate Institute, Beaverton, Oregon, United States
• 32: Christopher Douce , David Livingstone , James Orwell, Automatic test-based assessment of programming: A review, Journal on Educational Resources in Computing (JERIC), v.5 n.3, p.4-es, September 2005 [doi>10.1145/1163405.1163409]
• 33: A. B. Downey and L. A. Stein. Designing a small-footprint curriculum in computer science. In Proceedings of the 36th Frontiers in Education Conference, pages 21--26. IEEE Computer Society, 2006.
• 34: J. Driel, D. Beijaard, and N. Verloop. Professional development and reform in science education: the role of teachers' practical knowledge. Journal of Research in Science Teaching, 38:137--158, 2001.
• 35: Stephen H. Edwards, Improving student performance by evaluating how well students test their own programs, Journal on Educational Resources in Computing (JERIC), v.3 n.3, p.1-es, September 2003 [doi>10.1145/1029994.1029995]
• 36: John English, Automated assessment of GUI programs using JEWL, Proceedings of the 9th annual SIGCSE conference on Innovation and technology in computer science education, June 28-30, 2004, Leeds, United Kingdom
• 37: Michael B. Feldman, Ada experience in the undergraduate curriculum, Communications of the ACM, v.35 n.11, p.53-67, Nov. 1992 [doi>10.1145/138844.138847]
• 38: M. Felleisen, R. B. Findler, M. Flatt, and S. Krishnamurthi. The TeachScheme! Project: computing and programming for every student. Computer Science Education, 14(1):55--77, 2004.
• 39: A. Forte and M. Guzdial. Motivation and nonmajors in computer science: identifying discrete audiences for introductory courses. IEEE Transactions on Education, 48(2):248--253, 2005.
• 40: Ursula Fuller , Arnold Pears , June Amillo , Chris Avram , Linda Mannila, A computing perspective on the Bologna process, ACM SIGCSE Bulletin, v.38 n.4, December 2006
• 41: Ernie Giangrande, Jr., CS1 programming language options, Journal of Computing Sciences in Colleges, v.22 n.3, p.153-160, January 2007
• 42: Kenneth J. Goldman, A concepts-first introduction to computer science, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 43: Thomas R. G. Green, Instructions and descriptions: some cognitive aspects of programming and similar activities, Proceedings of the working conference on Advanced visual interfaces, p.21-28, May 2000, Palermo, Italy [doi>10.1145/345513.345233]
• 44: T. R. G. Green and M. Petre. Usability analysis of visual programming environments: a 'cognitive dimensions' framework. Journal of Visual Languages and Computing, 7(2):131--174, 1996.
• 45: David Gries, What should we teach in an introductory programming course?, Proceedings of the fourth SIGCSE technical symposium on Computer science education, p.81-89, January 1974
• 46: Paul Gross , Kris Powers, Evaluating assessments of novice programming environments, Proceedings of the 2005 international workshop on Computing education research, p.99-110, October 01-02, 2005, Seattle, WA, USA [doi>10.1145/1089786.1089796]
• 47: Said Hadjerrouit, Java as first programming language: a critical evaluation, ACM SIGCSE Bulletin, v.30 n.2, p.43-47, June 1998 [doi>10.1145/292422.292440]
• 48: Poul Henriksen , Michael Kölling, greenfoot: combining object visualisation with interaction, Companion to the 19th annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications, October 24-28, 2004, Vancouver, BC, CANADA [doi>10.1145/1028664.1028701]
• 49: Colin A. Higgins , Geoffrey Gray , Pavlos Symeonidis , Athanasios Tsintsifas, Automated assessment and experiences of teaching programming, Journal on Educational Resources in Computing (JERIC), v.5 n.3, p.5-es, September 2005 [doi>10.1145/1163405.1163410]
• 50: C. A. R. Hoare, An axiomatic basis for computer programming, Communications of the ACM, v.12 n.10, p.576-580, Oct. 1969 [doi>10.1145/363235.363259]
• 51: Emily Howe , Matthew Thornton , Bruce W. Weide, Components-first approaches to CS1/CS2: principles and practice, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 52: C. Hundhausen, S. Douglas, and J. T. Stasko. A meta-study of algorithm visualization effectiveness. Journal of Visual Languages and Computing, 13(3):259--290, 2002.
• 53: Christopher Hundhausen , Sarah Douglas, SALSA and ALVIS: A Language and System for Constructing and Presenting Low Fidelity Algorithm Visualizations, Proceedings of the 2000 IEEE International Symposium on Visual Languages (VL'00), p.67, September 10-13, 2000
• 54: Jhilmil Jain , James H. Cross, II , T. Dean Hendrix , Larry A. Barowski, Experimental evaluation of animated-verifying object viewers for Java, Proceedings of the 2006 ACM symposium on Software visualization, September 04-05, 2006, Brighton, United Kingdom [doi>10.1145/1148493.1148497]
• 55: Mike Joy , Nathan Griffiths , Russell Boyatt, The boss online submission and assessment system, Journal on Educational Resources in Computing (JERIC), v.5 n.3, p.2-es, September 2005 [doi>10.1145/1163405.1163407]
• 56: V. Karavirta, A. Korhonen, L. Malmi, and K. Stålnacke. MatrixPro - A tool for on-the-fly demonstration of data structures and algorithms. In Proceedings of the 3rd Program Visualization Workshop, pages 26--33, The University of Warwick, UK, July 2004.
• 57: Caitlin Kelleher , Randy Pausch, Lowering the barriers to programming: A taxonomy of programming environments and languages for novice programmers, ACM Computing Surveys (CSUR), v.37 n.2, p.83-137, June 2005 [doi>10.1145/1089733.1089734]
• 58: Elliot B. Koffman, The case for Modula-2 in CS1 and CS2, Proceedings of the nineteenth SIGCSE technical symposium on Computer science education, p.49-53, February 25-26, 1988, Atlanta, Georgia, United States
• 59: M. Kölling, B. Quig, A. Patterson, and J. Rosenberg. The BlueJ system and its pedagogy. Computer Science Education, 13, Dec 2003.
• 60: Jeff Kramer, Is abstraction the key to computing?, Communications of the ACM, v.50 n.4, p.36-42, April 2007 [doi>10.1145/1232743.1232745]
• 61: L. Malmi, V. Karavirta, A. Korhonen, J. Nikander, O. Seppälä, and P. Silvasti. Visual algorithm simulation exercise system with automatic assessment: TRAKLA2. Informatics in Education, 3(2):267--288, 2004.
• 62: L. Mannila, M. Peltomäki, and T. Salakoski. What about a simple language? Analyzing the difficulties in learning to program. Computer Science Education, 16(3):211--227, 2006.
• 63: E. Martin, M. Prosser, K. Trigwell, P. Ramsden, and J. Benjamin. What university teachers teach and how they teach it. Intructional Science. Special issue: Teacher Thinking, Beliefs and Knowledge in Higher Education, 28((5--6)):387--412, 2000.
• 64: Linda McIver , Damian Conway, Seven Deadly Sins of Introductory Programming Language Design, Proceedings of the 1996 International Conference on Software Engineering: Education and Practice (SE:EP '96), p.309, January 24-27, 1996
• 65: J. Meyer and R. Land. Threshold concepts and troublesome knowledge (2): Epistemological considerations and a conceptual framework for teaching and learning. Higher Education, 49(3):725--734, 2003.
• 66: R. P. Mody, C in education and software engineering, ACM SIGCSE Bulletin, v.23 n.3, p.45-56, Sept. 1991 [doi>10.1145/126459.126471]
• 67: Andrés Moreno , Niko Myller , Erkki Sutinen , Mordechai Ben-Ari, Visualizing programs with Jeliot 3, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989928]
• 68: Thomas L. Naps, JHAVÉ: Supporting Algorithm Visualization, IEEE Computer Graphics and Applications, v.25 n.5, p.49-55, September 2005 [doi>10.1109/MCG.2005.110]
• 69: Thomas L. Naps , Guido Rößling , Vicki Almstrum , Wanda Dann , Rudolf Fleischer , Chris Hundhausen , Ari Korhonen , Lauri Malmi , Myles McNally , Susan Rodger , J. Ángel Velázquez-Iturbide, Exploring the role of visualization and engagement in computer science education, Working group reports from ITiCSE on Innovation and technology in computer science education, p.131-152, June 24-28, 2002, Aarhus, Denmark
• 70: D. Palumbo. Programming language/problem-solving research: a review of relevant issues. Review of Educational Research, 60(1):65--89, 1990.
• 71: Andrew Patterson , Michael Kölling , John Rosenberg, Introducing unit testing with BlueJ, Proceedings of the 8th annual conference on Innovation and technology in computer science education, June 30-July 02, 2003, Thessaloniki, Greece
• 72: Richard E. Pattis, Karel the Robot: A Gentle Introduction to the Art of Programming, John Wiley & Sons, Inc., New York, NY, 1981
• 73: Richard E. Pattis, The “procedures early” approach in CS 1: a heresy, Proceedings of the twenty-fourth SIGCSE technical symposium on Computer science education, p.122-126, February 18-19, 1993, Indianapolis, Indiana, United States
• 74: Arnold Pears , Stephen Seidman , Crystal Eney , Päivi Kinnunen , Lauri Malmi, Constructing a core literature for computing education research, ACM SIGCSE Bulletin, v.37 n.4, December 2005 [doi>10.1145/1113847.1113893]
• 75: Nelishia Pillay, Developing intelligent programming tutors for novice programmers, ACM SIGCSE Bulletin, v.35 n.2, June 2003 [doi>10.1145/782941.782986]
• 76: B. A. Price, R. M. Baecker, and I. S. Small. A principled taxonomy of software visualization. Journal of Visual Languages and Computing, 4(3):211--266, 1993.
• 77: Noa Ragonis , Mordechai Ben-Ari, On understanding the statics and dynamics of object-oriented programs, Proceedings of the 36th SIGCSE technical symposium on Computer science education, February 23-27, 2005, St. Louis, Missouri, USA
• 78: Anthony Ralston, Fortran and the first course in computer science, ACM SIGCSE Bulletin, v.3 n.4, p.24-29, Dec. 1971 [doi>10.1145/382214.382499]
• 79: Stuart Reges, Back to basics in CS1 and CS2, Proceedings of the 37th SIGCSE technical symposium on Computer science education, March 03-05, 2006, Houston, Texas, USA
• 80: Eric S. Roberts, Using C in CS1: evaluating the Stanford experience, Proceedings of the twenty-fourth SIGCSE technical symposium on Computer science education, p.117-121, February 18-19, 1993, Indianapolis, Indiana, United States
• 81: A. Robins, J. Rountree, and N. Rountree. Learning and teaching programming: a review and discussion. Computer Science Education, 13(2):137--172, 2003.
• 82: Hamzeh Roumani, Practice what you preach: full separation of concerns in CS1/CS2, Proceedings of the 37th SIGCSE technical symposium on Computer science education, March 03-05, 2006, Houston, Texas, USA
• 83: Riku Saikkonen , Lauri Malmi , Ari Korhonen, Fully automatic assessment of programming exercises, Proceedings of the 6th annual conference on Innovation and technology in computer science education, p.133-136, June 2001, Canterbury, United Kingdom
• 84: Dean Sanders , Brian Dorn, Jeroo: a tool for introducing object-oriented programming, Proceedings of the 34th SIGCSE technical symposium on Computer science education, February 19-23, 2003, Reno, Navada, USA
• 85: G. Michael Schneider, The introductory programming course in computer science: ten principles, Papers of the SIGCSE/CSA technical symposium on Computer science education, February 23-24, 1978, Detroit, Michigan
• 86: E. Soloway, Learning to program = learning to construct mechanisms and explanations, Communications of the ACM, v.29 n.9, p.850-858, Sept. 1986 [doi>10.1145/6592.6594]
• 87: John T. Stasko, Tango: A Framework and System for Algorithm Animation, Computer, v.23 n.9, p.27-39, September 1990 [doi>10.1109/2.58216]
• 88: Joel T. Stasko, Using student-built algorithm animations as learning aids, Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education, p.25-29, February 27-March 01, 1997, San Jose, California, United States
• 89: John T. Stasko , Eileen Kraemer, A methodology for building application-specific visualizations of parallel programs, Journal of Parallel and Distributed Computing, v.18 n.2, p.258-264, June 1993 [doi>10.1006/jpdc.1993.1062]
• 90: L. Stein. What we've swept under the rug: radically rethinking CS1. Computer Science Education, 8(2):118--129, 1998.
• 91: L. Stein. Challenging the computational metaphor: implications for how we think. Cybernetics & Systems, 30(6):473--507, 1999.
• 92: C. Stephenson and T. West. Language Choice and Key Concepts in Introductory Computer Science Courses. Journal of Research on Computing in Education, 31(1):89--95, 1998.
• 93: Margaret-Anne Storey , Daniela Damian , Jeff Michaud , Del Myers , Marcellus Mindel , Daniel German , Mary Sanseverino , Elizabeth Hargreaves, Improving the usability of Eclipse for novice programmers, Proceedings of the 2003 OOPSLA workshop on eclipse technology eXchange, p.35-39, October 27-27, 2003, Anaheim, California [doi>10.1145/965660.965668]
• 94: K. Trigwell and M. Prosser. Development and use of the approaches to teaching inventory. Educational Psychology Review, 16(4), December 2004.
• 95: K. Trigwell, M. Prosser, and F. Waterhouse. Relations between teachers' approaches to teaching and students' approaches to learning. Higher Education, 37:57--70, 1999.
• 96: P. Tymann, June 2007. http://www.cs.rit.edu/ptt/apac06/Life_After_CS.pdf.
• 97: David W. Valentine, CS educational research: a meta-analysis of SIGCSE technical symposium proceedings, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 98: Tamar Vilner , Ela Zur , Judith Gal-Ezer, Fundamental concepts of CS1: procedural vs. object oriented paradigm - a case study, Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education, June 25-27, 2007, Dundee, Scotland
• 99: G. Weber and P. Brusilovsky. ELM-ART: An adaptive versatile system for web-based instruction. International Journal of Artificial Intelligence in Education, 12:351--384, 2001.
• 100: Stelios Xinogalos , Maya Satratzemi , Vassilios Dagdilelis, An introduction to object-oriented programming with a didactic microworld: objectKarel, Computers & Education, v.47 n.2, p.148-171, September 2006 [doi>10.1016/j.compedu.2004.09.005]
• 101: Andreas Zeller , Dorothea Lütkehaus, DDD—a free graphical front-end for UNIX debuggers, ACM SIGPLAN Notices, v.31 n.1, p.22-27, Jan. 1996 [doi>10.1145/249094.249108]

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION

Additional Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education

General Terms:
Theory

Keywords:
bibliography, computing education research, introductory programming, literature survey, teaching