Locus of feedback control in computer-based tutoring: impact on learning rate, achievement and attitudes

ABSTRACT

The advent of second-generation intelligent computer tutors raises an important instructional design question: when should tutorial advice be presented in problem solving? This paper examines four feedback conditions in the ACT Programming Tutor. Three versions offer the student different levels of control over error feedback and correction: (a) immediate feedback and immediate error correction; (b) immediate error flagging and student control of error correction; (c) feedback on demand and student control of error correction. A fourth, No-tutor condition offers no stepby-step problem solving support. The immediate feedback group with greatest tutor control of problem solving yielded the most efficient learning. These students completed the tutor problems fastest, and the three tutor-supported groups performed equivalently on tests. Questionnaires revealed little student preference among the four conditions. These results suggest that students will need explicit guidance to benefit from learning opportunities that arise when they have greater control over tutorial assistance.

REFERENCES

• 1: Anderson, J.R., Conrad, F.G. and Corbett, A.T. (1989). Skill acquisition and the LISP Tutor. Cognitive Science, 13, 467-505.
• 2: Anderson, J.R., Corbett, A.T., Koedinger, K.R. and Pelletier, R. (1995). Cognitive tutors: Lessons learned. Journal of the Learning Sciences, 4, 167-207.
• 3: John R Anderson , Albert T Corbett , Brian J Reiser, Essential LISP, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987
• 4: Anderson, J.R. and Lebiere, C. (1998). The atomic components of thought. Mahwah, NJ: Erlbaum.
• 5: Bangert-Drowns, R.L., Kulik, C.C., Kulik, J.A. & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61, 213-238.
• 6: Bielaczyc, K., Pirolli, P.L., and Brown, A.L. (1995). Training in self-regulation strategies: Investigating the effects of knowledge acquisition activities on problem solving. Cognition and Instruction, 13, 221-252.
• 7: Corbett, A.T. and Anderson, J.R. (1995). Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction, 4, 253-278.
• 8: Albert Corbett , Holly Trask, Instructional interventions in computer-based tutoring: differential impact on learning time and accuracy, Proceedings of the SIGCHI conference on Human factors in computing systems, p.97-104, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332412]
• 9: Chi, M.T.H., Bassok, M., Lewis, M, Reimann, P., Glaser, R. (1989). Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science, 13, 145-182.
• 10: Fox, B. (1991). Cognitive and interactional aspects of correction in tutoring. In P. Goodyear (ed.) Teaching knowledge and intelligent tutoring. Norwood, NJ: Ablex.
• 11: Kulhavy, R.W. (1977). Feedback in written instruction. Review of Educational Research, 47, 211-232.
• 12: Kulik, J.A. and Kulik, C.C. (1988). Timing of feedback and verbal learning. Review of Educational Research, 58, 79-97.
• 13: Lepper, M.R., Woolverton, M., Mume, D.L. and Gurtner, J. (1993). Motivational techniques of expert human tutors: Lessons for the design of computer-based tutors. In S. Lajoie & S. Derry (eds.) Computers a cognitive tools. Hillsdale, NJ: Erlbaum.
• 14: Merrill, D.C., Reiser, B.J., Ranney, M. and Trafton, J.G. (1992). Effective tutoring techniques: A comparison of human tutors and intelligent tutoring systems. Journal of the Learning Sciences, 2, 277-305.
• 15: Allen Munro , Michael R Fehling , Douglas M Towne, Instruction intrusiveness in dynamic simulation training, Journal of Computer Based Instruction, v.12 n.2, p.50-53, Spring 1985
• 16: Pressey, S.L. (1926). A simple apparatus which gives tests and scores - and teaches. School and Society, 23 (586), 373-376.
• 17: Schmidt, R.A., Young, D.E., Swinnen, S. and Shapiro, D.C. (1989). Summary knowledge results for skill acquisition: Support for the guidance hypothesis. Journal of Experimental Psychology: Learning, Memory and Cognition, 15, 352-359.
• 18: Janet Ward Schofield, Computers and Classroom Culture, Cambridge University Press, New York, NY, 1995
• 19: Schooler, L.J. and Anderson, J.R. (1990). The disruptive potential of immediate feedback. The Proceedings of the Twelfth Annual Conference of the Cognitive Science Society, Cambridge, MA.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Human Factors, Management, Measurement, Performance, Theory

Keywords:
feedback in problem solving, instructional interface design, intelligent tutoring systems, student modeling