Measuring the effectiveness of robots in teaching computer science

ABSTRACT

We report the results of a year-long experiment in the use of robots to teach computer science. Our data set compares results from over 800 students on identical tests from both robotics and non-robotics based laboratory sessions. We also examine the effectiveness of robots in encouraging students to select computer science or computer engineering as a field of study.Our results are negative: test scores were lower in the robotics sections than in the non-robotics ones, nor did the use of robots have any measurable effect on students choice of discipline. We believe the most significant factor that accounts for this is the lack of a simulator for our robotics programming system. Students in robotics sections must run and debug their programs on robots during assigned lab times, and are therefore deprived of both reflective time and the rapid compile-run-debug cycle outside of class that is an important part of the learning process. We discuss this and other issues, and suggest directions for future work.

REFERENCES

• 1: AAAI 2001 Spring Symposium on Robotics and Education, March 2001, numerous authors.
• 2: Arnold O. Allen, Probability, statistics, and queueing theory with computer science applications, Academic Press Professional, Inc., San Diego, CA, 1990
• 3: Barry Fagin, Using Ada-based robotics to teach computer science, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.148-151, July 11-13, 2000, Helsinki, Finland
• 4: Barry Fagin, An Ada interface to lego mindstorms, ACM SIGAda Ada Letters, v.XX n.3, p.20-40, Sept. 2000 [doi>10.1145/362076.362081]
• 5: Barry S. Fagin , Laurence D. Merkle , Thomas W. Eggers, Teaching computer science with robotics using Ada/Mindstorms 2.0, Proceedings of the 2001 annual ACM SIGAda international conference on Ada, September 30-October 04, 2001, Bloomington, MN
• 6: Fagin, B. Ada/Mindstorms 3.0: A computational environment for introductory robotics and programming, IEEE Robotics and Automation special issue on robotics and education, to appear.
• 7: Barry S. Fagin , Laurence Merkle, Quantitative analysis of the effects of robots on introductory Computer Science education, Journal on Educational Resources in Computing (JERIC), v.2 n.4, p.2-es, December 2002 [doi>10.1145/949257.949259]
• 8: Baum, D. 2002. The NQC Web site. Available http://www.enteract.com/~dbaum/nqc.
• 9: Randall D. Beer , Hillel J. Chiel , Richard F. Drushel, Using autonomous robotics to teach science and engineering, Communications of the ACM, v.42 n.6, p.85-92, June 1999 [doi>10.1145/303849.303866]
• 10: Congdon, C., Fagin, B., Goldweber, M., Hwang, D., Klassner, F. 2001. Experiences with robots in the classroom, panel presented at 32nd SIGCSE Technical Symposium on Computer Science Education.
• 11: Flowers, T. and Gossett, K. 2002. Teaching problem solving, computing, and information technology with robots, unpublished paper, project info. available at http://www.dean.usma.edu/dean/ComputingAtWestPoint/Robots.htm.
• 12: Robert M. Harlan , David B. Levine , Shelley McClarigan, The Khepera robot and the kRobot class: a platform for introducing robotics in the undergraduate curriculum, Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education, p.105-109, February 2001, Charlotte, North Carolina, United States
• 13: Frank Klassner, A case study of LEGO Mindstorms'™ suitability for artificial intelligence and robotics courses at the college level, Proceedings of the 33rd SIGCSE technical symposium on Computer science education, February 27-March 03, 2002, Cincinnati, Kentucky
• 14: Richard E. Pattis, Karel the Robot: A Gentle Introduction to the Art of Programming, John Wiley & Sons, Inc., New York, NY, 1981
• 15: Ursula Wolz, Teaching design and project management with lego RCX robots, Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education, p.95-99, February 2001, Charlotte, North Carolina, United States

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

General Terms:
Experimentation, Measurement

Keywords:
CS1, Lego, pedagogy, programming environments, robotics