Strategies that students use to trace code: an analysis based in grounded theory

ABSTRACT

How do beginning students approach problems which require them to read and understand code? We report on a Grounded Theory-based analysis of student transcripts from 12 institutions where students were asked to "think aloud" when solving such problems. We identify 19 strategies used by students. Primary results are that all students employ a range of strategies, there were (in total) many different strategies that were applied, students use multiple strategies on each individual problem, students applied different strategies to different types of questions, and students often applied strategies poorly. We show that strategies conform with existing education theories including Bloom's Taxonomy and the Approaches to Study Inventory. Additionally, we discuss emergent theories developed through a card sort process.

REFERENCES

• 1: Bloom, B. S., Mesia, B. B. and Krathwohl, D. R. Taxonomy of Educational Objectives (two vols: The Affective Domain & The Cognitive Domain). Addison-Wesley, 1956.
• 2: Borgatti, S. Introduction to Grounded Theory, <http://www.analytictech.com/mb870/introtoGT.htm> (last accessed April 29, 2005).
• 3: Bush, M. Alternative Marking Schemes for On-Line Multiple-Choice Tests. In Proceedings of the Seventh Annual Conference on the Teaching of Computing (Belfast, Ireland, 1997). CTI Computing, 1999.
• 4: du Boulay, J. B. H., O'Shea, T. and Monk, J. The black box inside the glass box: Presenting computing concepts to novices. In E. Soloway and J.C. Spohrer (Eds), Studying the Novice Programmer. Lawrence Erlbaum Associates, Hillsdale, 1989, 431-446. Reprinted from du Boulay, O'Shea and Monk (1981).
• 5: Entwistle, N.J. and Tait, H. The Revised Approaches to Study Inventory. Edinburgh: Centre for Learning and Instruction, University of Edinburgh, 1994.
• 6: Dave W. Farthing , Dave M. Jones , Duncan McPhee, Permutational multiple-choice questions: an objective and efficient alternative to essay-type examination questions, Proceedings of the 6th annual conference on the teaching of computing and the 3rd annual conference on Integrating technology into computer science education: Changing the delivery of computer science education, p.81-85, August 18-21, 1998, Dublin City Univ., Ireland
• 7: Glaser, B.G. and Strauss, A.L. The discovery of Grounded Theory: Strategies for qualitative research. Aldine: Chicago, 1967.
• 8: Grounded Theory: a thumbnail sketch, <http://www.scu.edu.au/schools/gcm/ar/arp/grounded.html> (last accessed April 29, 2005).
• 9: Lawson, A.E., Karplus, R. and Adi, H. The acquisition of logic and formal operational schemata during the secondary school years. Journal of Research in Science Teaching, 15, 6 (1978), 465-478.
• 10: Learning Domains or Bloom's Taxonomy, <http://www.nwlink.com/ donclark/hrd/bloom.html> (last accessed August 18, 2005).
• 11: Learning Skills Program: Bloom's Taxonomy, <http://www.coun.uvic.ca/learn/program/hndouts/bloom.html>, (last accessed August 18, 2005).
• 12: Lister, R. Personal communication, 2005.
• 13: Raymond Lister, Objectives and objective assessment in CS1, Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education, p.292-296, February 2001, Charlotte, North Carolina, United States
• 14: Raymond Lister, On blooming first year programming, and its blooming assessment, Proceedings of the Australasian conference on Computing education, p.158-162, December 2000, Melbourne, Australia [doi>10.1145/359369.359393]
• 15: Raymond Lister , Elizabeth S. Adams , Sue Fitzgerald , William Fone , John Hamer , Morten Lindholm , Robert McCartney , Jan Erik Moström , Kate Sanders , Otto Seppälä , Beth Simon , Lynda Thomas, A multi-national study of reading and tracing skills in novice programmers, ACM SIGCSE Bulletin, v.36 n.4, December 2004
• 16: McCartney, R., Mostrom, J.E., Sanders, K., and Seppala, O. Take note: The effectiveness of novice programmers' annotations on examinations. Informatics in Education. 4. 1, (2005), 69-86.
• 17: Michael McCracken , Vicki Almstrum , Danny Diaz , Mark Guzdial , Dianne Hagan , Yifat Ben-David Kolikant , Cary Laxer , Lynda Thomas , Ian Utting , Tadeusz Wilusz, A multi-national, multi-institutional study of assessment of programming skills of first-year CS students, ACM SIGCSE Bulletin, v.33 n.4, December 2001 [doi>10.1145/572139.572181]
• 18: D. N. Perkins , Fay Martin, Fragile knowledge and neglected strategies in novice programmers, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.213-229, June 1986, Washington, D.C., United States
• 19: Richardson, J. T. E., Using Questionnaires to Evaluate Student Learning: Some Health Warnings. Gibbs, G. (ed.) Improving Student Learning - Theory and Practice. Oxford: Oxford Centre for Staff Development, 1994. (<http://www.city.londonmet.ac.uk/deliberations/ocsd-pubs/isltp-richardson.html> )
• 20: Robins, A., Rountree, J., and Rountree, N. Learning and Teaching Programming: A Review and Discussion, Computer Science Education, 13, 2 (2003), 137-172.
• 21: Rugg, G., and McGeorge, P. The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts. Expert Systems, 14, 2 (1997), 80-93.
• 22: Elliot Soloway , Ben Shneiderman , Sitharama Iyengar, Empirical Studies of Programmers: First Workshop, Greenwood Publishing Group Inc., Westport, CT, 1986
• 23: E. Soloway , James C. Spohrer, Studying the Novice Programmer, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1988

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

General Terms:
Theory

Keywords:
card sort, grounded theory, multi-institutional, multiple choice questions (MCQs), problem solving, strategies, test taking strategies, think aloud, tracing