Methods and tools for exploring novice compilation behaviour

ABSTRACT

Our research explores what we call compilation behaviour: the programming behaviour a student engages in while repeatedly editing and compiling their programs. This edit-compile cycle often represents students' attempts to make their programs syntactically, as opposed to semantically, correct. Over the course of two years, we have observed first-year university students learning to program in Java, collecting and studying thousands of snapshots of their programs from one compilation to the next. At the University of Kent, students are introduced to programming in an objects-first style using BlueJ, an environment intended for use by novice programmers.

REFERENCES

• 1: T. A. Angelo and K. P. Cross. Classroom Assessment Techniques: A Handbook for College Teachers. Jossey-Bass, 1993.
• 2: Piraye Bayman , Richard E. Mayer, A diagnosis of beginning programmers' misconceptions of BASIC programming statements, Communications of the ACM, v.26 n.9, p.677-679, Sept. 1983 [doi>10.1145/358172.358408]
• 3: Janet Carter, Collaboration or plagiarism: what happens when students work together, Proceedings of the 4th annual SIGCSE/SIGCUE ITiCSE conference on Innovation and technology in computer science education, p.52-55, June 27-30, 1999, Cracow, Poland
• 4: D. D. Cowan , J. W. Graham, Design characteristics of the WATFOR compiler, Proceedings of a symposium on Compiler optimization, p.25-36, July 27-28, 1970, Urbana-Champaign, Illinois
• 5: Peter J. Denning, ACM president's letter: smart editors, Communications of the ACM, v.24 n.8, p.491-493, Aug. 1981 [doi>10.1145/358722.358727]
• 6: Peter DePasquale , John A. N. Lee , Manuel A. Pérez-Quiñones, Evaluation of subsetting programming language elements in a novice's programming environment, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 7: P.A. Ertmer and T.J. Newby. Behaviorism, cognitivism, constructivism: Comparing critical features from an instructional design perspective. Performance Improvement Quarterly, 6(4):50--70, 1993.
• 8: Sally Fincher , Raymond Lister , Tony Clear , Anthony Robins , Josh Tenenberg , Marian Petre, Multi-institutional, multi-national studies in CSEd Research: some design considerations and trade-offs, Proceedings of the 2005 international workshop on Computing education research, p.111-121, October 01-02, 2005, Seattle, WA, USA [doi>10.1145/1089786.1089797]
• 9: Robert Bruce Findler , John Clements , Cormac Flanagan , Matthew Flatt , Shriram Krishnamurthi , Paul Steckler , Matthias Felleisen, DrScheme: a programming environment for Scheme, Journal of Functional Programming, v.12 n.2, p.159-182, March 2002 [doi>10.1017/S0956796801004208]
• 10: Stephen N. Freund , Eric S. Roberts, Thetis: an ANSI C programming environment designed for introductory use, Proceedings of the twenty-seventh SIGCSE technical symposium on Computer science education, p.300-304, February 15-17, 1996, Philadelphia, Pennsylvania, United States
• 11: Barney G. Glaser and Anselm L. Strauss. Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine, June 1967.
• 12: Mark Guzdial , Elliot Soloway, Teaching the Nintendo generation to program, Communications of the ACM, v.45 n.4, April 2002 [doi>10.1145/505248.505261]
• 13: Herman D. Hughes, A tool designed to facilitate structured programming, Proceedings of the seventh SIGCSE technical symposium on Computer science education, p.26-30, February 02-03, 1977, Atlanta, Georgia, United States
• 14: Matthew C. Jadud. A first look at novice compilation behavior. Computer Science Education, 15(1):25--40, 2005.
• 15: Matthew C. Jadud. An exploration of novice compilation behavior in BlueJ. PhD thesis, University of Kent, May 2006, unpublished.
• 16: Andrew J. Ko , Htet Aung , Brad A. Myers, Eliciting design requirements for maintenance-oriented IDEs: a detailed study of corrective and perfective maintenance tasks, Proceedings of the 27th international conference on Software engineering, p.126-135, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062492]
• 17: Andrew J. Ko , Htet Htet Aung , Brad A. Myers, Design requirements for more flexible structured editors from a study of programmers' text editing, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056965]
• 18: Andrew J. Ko , Brad A. Myers, Designing the whyline: a debugging interface for asking questions about program behavior, Proceedings of the SIGCHI conference on Human factors in computing systems, p.151-158, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985712]
• 19: M. Kolling, B. Quig, A. Patterson, and J. Rosenberg. The bluej system and its pedagogy. Journal of Computer Science Education, 13(4), 2003.
• 20: Michael Kolling and David J. Barnes. Objects first with Java: A practical introduction using BlueJ. Prentice Hall, 2nd edition, 2005.
• 21: Michael Kölling , John Rosenberg, Tools and techniques for teaching objects first in a Java course, The proceedings of the thirtieth SIGCSE technical symposium on Computer science education, p.368, March 24-28, 1999, New Orleans, Louisiana, United States
• 22: Thomas Lancaster , Fintan Culwin, Towards an error free plagarism detection process, Proceedings of the 6th annual conference on Innovation and technology in computer science education, p.57-60, June 2001, Canterbury, United Kingdom
• 23: Raymond Lister , Elizabeth S. Adams , Sue Fitzgerald , William Fone , John Hamer , Morten Lindholm , Robert McCartney , Jan Erik Moström , Kate Sanders , Otto Seppälä , Beth Simon , Lynda Thomas, A multi-national study of reading and tracing skills in novice programmers, Working group reports from ITiCSE on Innovation and technology in computer science education, June 28-30, 2004, Leeds, United Kingdom
• 24: Richard E. Mayer, A psychology of learning BASIC, Communications of the ACM, v.22 n.11, p.589-593, Nov. 1979 [doi>10.1145/359168.359171]
• 25: Michael McCracken , Vicki Almstrum , Danny Diaz , Mark Guzdial , Dianne Hagan , Yifat Ben-David Kolikant , Cary Laxer , Lynda Thomas , Ian Utting , Tadeusz Wilusz, A multi-national, multi-institutional study of assessment of programming skills of first-year CS students, Working group reports from ITiCSE on Innovation and technology in computer science education, December 01, 2001, Canterbury, UK [doi>10.1145/572133.572137]
• 26: Andrés Moreno , Niko Myller , Erkki Sutinen , Mordechai Ben-Ari, Visualizing programs with Jeliot 3, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989928]
• 27: P. G. Moulton , M. E. Muller, DITRAN—a compiler emphasizing diagnostics, Communications of the ACM, v.10 n.1, p.45-52, Jan. 1967 [doi>10.1145/363018.363060]
• 28: D. N. Perkins , Fay Martin, Fragile knowledge and neglected strategies in novice programmers, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.213-229, June 1986, Washington, D.C., United States
• 29: M. Piantanida, C. Tananis, and R. Grubs. Generating grounded theory of/for educational practice: The journey of three epistemorphs. International Journal of Qualitative Studies in Education, 17(3):325--346, 2004.
• 30: Kate Sanders, Sally Fincher, Dennis Bouvier, Gary Lewandowski, Briana Morrison, Laurie Murphy, Marian Petre, Brad Richards, Josh Tenenberg, and Lynda Thomas. A multi-institutional, multi-national study of programming concepts using card sort data. Expert Systems, 22(3):121--128, July 2005.
• 31: Peter W. Shantz , R. A. German , J. G. Mitchell , R. S. K. Shirley , C. R. Zarnke, WATFOR—The University of Waterloo FORTRAN IV compiler, Communications of the ACM, v.10 n.1, p.41-44, Jan. 1967 [doi>10.1145/363018.363059]
• 32: Ben Shneiderman , Richard Mayer , Don McKay , Peter Heller, Experimental investigations of the utility of detailed flowcharts in programming, Communications of the ACM, v.20 n.6, p.373-381, June 1977 [doi>10.1145/359605.359610]
• 33: Elliot Soloway , Jeffrey Bonar , Kate Ehrlich, Cognitive strategies and looping constructs: an empirical study, Communications of the ACM, v.26 n.11, p.853-860, Nov. 1983 [doi>10.1145/182.358436]
• 34: J. C. Spohrer , E. Soloway, Alternatives to construct-based programming misconceptions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.183-191, April 13-17, 1986, Boston, Massachusetts, United States
• 35: James Clinton Spohrer. Marcel: a generate-test-and-debug (gtd) impasse/repair model of student programmers. PhD thesis, 1989.
• 36: James G. Spohrer , Elliot Soloway, Analyzing the high frequency bugs in novice programs, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.230-251, June 1986, Washington, D.C., United States
• 37: A. Strauss and J. Corbin. Basics of qualitative research: grounded theory procedures and techniques. Sage Publications, Newbury Park, Calif., 1990.
• 38: Tim Teitelbaum , Thomas Reps, The Cornell program synthesizer: a syntax-directed programming environment, Communications of the ACM, v.24 n.9, p.563-573, Sept. 1981 [doi>10.1145/358746.358755]
• 39: Lynda Thomas , Mark Ratcliffe , Ann Robertson, Code warriors and code-a-phobes: a study in attitude and pair programming, Proceedings of the 34th SIGCSE technical symposium on Computer science education, February 19-23, 2003, Reno, Navada, USA
• 40: Tammy VanDeGrift, Coupling pair programming and writing: learning about students' perceptions and processes, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 41: Laurie Williams , Richard L. Upchurch, In support of student pair-programming, Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education, p.327-331, February 2001, Charlotte, North Carolina, United States

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education

General Terms:
Experimentation, Human Factors, Languages, Measurement

Keywords:
BlueJ, Java, behavior, compilation, compiler, novice