Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

It is difficult for instructors of CS1 and CS2 courses to get accurate answers to such critical questions as "how long are students spending on programming assignments?", or "what sorts of errors are they making?" At the same time, students often have no idea of where they stand with respect to the rest of the class in terms of time spent on an assignment or the number or types of errors that they encounter. In this paper, we present a tool called Retina, which collects information about students' programming activities, and then provides useful and informative reports to both students and instructors based on the aggregation of that data. Retina can also make real-time recommendations to students, in order to help them quickly address some of the errors they make. In addition to describing Retina and its features, we also present some of our initial findings during two trials of the tool in a real classroom setting.

REFERENCES

• 1: Stephen Chan , Benjamin Hill , Sarita Yardi, Instant messaging bots: accountability and peripheral participation for textual user interfaces, Proceedings of the 2005 international ACM SIGGROUP conference on Supporting group work, November 06-09, 2005, Sanibel Island, Florida, USA [doi>10.1145/1099203.1099221]
• 2: I. Coman and A. Sillitti. An empirical exploratory study on inferring developers' activities from low-level data. In Proc of the nineteenth International Conference on Software Engineering and Knowledge Engineering (SEKE), 2007.
• 3: Davor Čubranić , Margaret Anne D. Storey, Collaboration support for novice team programming, Proceedings of the 2005 international ACM SIGGROUP conference on Supporting group work, November 06-09, 2005, Sanibel Island, Florida, USA [doi>10.1145/1099203.1099229]
• 4: Stephen H. Edwards , Manuel A. Perez-Quinones, Web-CAT: automatically grading programming assignments, Proceedings of the 13th annual conference on Innovation and technology in computer science education, June 30-July 02, 2008, Madrid, Spain
• 5: T. Flowers, C. Carver, and J. Jackson. Empowering students and building confidence in novice programmers through Gauntlet. In 34th ASEE/IEEE Frontiers in Education Conference, pages T3H-10-T3H-13, Oct 2004.
• 6: R. G. P. Galluccio. Humanizing CALL: The use of pedagogical agents as language tutors. New England Regional Association for Language Learning Technology, Oct. 2006.
• 7: Reid Holmes , Robert J. Walker , Gail C. Murphy, Strathcona example recommendation tool, Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering, September 05-09, 2005, Lisbon, Portugal
• 8: Maria Hristova , Ananya Misra , Megan Rutter , Rebecca Mercuri, Identifying and correcting Java programming errors for introductory computer science students, Proceedings of the 34th SIGCSE technical symposium on Computer science education, February 19-23, 2003, Reno, Navada, USA
• 9: M. Jadud. A first look at novice compilation behaviour using BlueJ. Computer Science Education, 15(1):25--40, March 2005.
• 10: Java Glossary. Compile time error messages. http://mindprod.com/jgloss/compileerrormessages.html.
• 11: JClaim. Java compliant logging and auditing instant messenger. http://www.itbsllc.com/jclaim/.
• 12: Philip M. Johnson , Hongbing Kou , Joy Agustin , Christopher Chan , Carleton Moore , Jitender Miglani , Shenyan Zhen , William E. J. Doane, Beyond the Personal Software Process: metrics collection and analysis for the differently disciplined, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon
• 13: Y. Liu, E. Stroulia, K. Wong, and D. German. Using CVS historical information to understand how students develop software. In Proc of the 2004 international workshop on mining software repositories, 2004.
• 14: John McKeogh , Chris Exton, Eclipse plug-in to monitor the programmer behaviour, Proceedings of the 2004 OOPSLA workshop on eclipse technology eXchange, p.93-97, October 24-24, 2004, Vancouver, British Columbia, Canada [doi>10.1145/1066129.1066148]
• 15: Keir Mierle , Kevin Laven , Sam Roweis , Greg Wilson, Mining student CVS repositories for performance indicators, Proceedings of the 2005 international workshop on Mining software repositories, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 16: Christian Murphy , Eunhee Kim , Gail Kaiser , Adam Cannon, Backstop: a tool for debugging runtime errors, Proceedings of the 39th SIGCSE technical symposium on Computer science education, March 12-15, 2008, Portland, OR, USA
• 17: Cindy Norris , Frank Barry , James B. Fenwick Jr. , Kathryn Reid , Josh Rountree, ClockIt: collecting quantitative data on how beginning software developers really work, Proceedings of the 13th annual conference on Innovation and technology in computer science education, June 30-July 02, 2008, Madrid, Spain
• 18: Amnon Ribak , Michal Jacovi , Vladimir Soroka, "Ask before you search": peer support and community building with reachout, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587097]
• 19: Jaime Spacco , David Hovemeyer , William Pugh , Fawzi Emad , Jeffrey K. Hollingsworth , Nelson Padua-Perez, Experiences with marmoset: designing and using an advanced submission and testing system for programming courses, Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education, June 26-28, 2006, Bologna, Italy

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-assisted instruction (CAI)

Additional Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

General Terms:
Human Factors, Measurement

Keywords:
compilation errors, cs1, cs2, tutoring systems