Competency matrices for peer assessment of individuals in team projects

ABSTRACT

Assessing individual contributions on team projects and promoting the maturation of team knowledge skills in students is difficult. Traditional assessment tools score an individual over a set of categories that are loosely defined and lack well-defined expectations. Further, for curriculum in which team-based learning is a primary component, the traditional approach to assessment fails to provide visibility to the students as to how their team-knowledge skills should mature as they progress. In this paper we present a competency matrix based approach that defines expected performance for required team knowledge skills, where assessment is performed relative to the expectations for the current level of the student. This competency matrix not only provides guidance and clarification for students learning these skills as they mature in their academic careers but also provides a foundation for self and peer assessments. A comparison survey was distributed to students at various levels within the curriculum currently using a traditional assessment instrument. While the students recognized that the competency-based approach was more involved and time consuming, the results of that survey demonstrate that students have a stronger preference for the competency matrix approach. We also include a discussion of the benefits and difficulties associated with this model and future work.

REFERENCES

• 1: Fallows, S. and Chandramohan, B., "Multiple Approaches to Assessment: reflections on use of tutor, peer and self-assessment", Teaching in Higher Education, 6(2):229--246, 2001.
• 2: Freeman, S.A. and Dyrenfurth, M.J., "Using Peer Assessments in Team Activities", Journal of Industrial Technology, 20(1):1--8, November 2003.
• 3: Jane Huffman Hayes , Timothy C. Lethbridge , Daniel Port, Evaluating individual contribution toward group software engineering projects, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon
• 4: Thomas B. Hilburn, Teams need a process!, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.53-56, July 11-13, 2000, Helsinki, Finland
• 5: Kaufman, D. B, Felder, R. M., & Fuller, H., "Accounting for individual effort in cooperative learning teams", Journal of Engineering Education, 89(2): 133--140, 2000.
• 6: Clive C. H. Rosen, Individual Assessment of Group Projects in Software Engineering: A Facilitated Peer Assessment Approach, Proceedings of the 9th Conference on Software Engineering Education, p.68, April 21-24, 1996
• 7: Jirarat Sitthiworachart , Mike Joy, Effective peer assessment for learning computer programming, Proceedings of the 9th annual SIGCSE conference on Innovation and technology in computer science education, June 28-30, 2004, Leeds, United Kingdom
• 8: Sluijsmans, D., Dochy, F., Moerkerke, G., "Creating a Learning Environment by Using Self-, Peer- and Co-Assessment, Learning Environments Research, 1, 293--319, 1999.
• 9: Debra L. Smarkusky , Harold H. Smith, Team projects throughout the curriculum: course management, teaching initiatives and outreach, Journal of Computing Sciences in Colleges, v.19 n.5, p.119-129, May 2004
• 10: Topping, K., Smith, E., Swanson, I., Elliot, A., "Formative Peer Assessment of Academic Writing Between Postgraduate Students", Assessment and Evaluation in Higher Education, 25(2):149--169, 2000.
• 11: Van Duzer, E., McMartin, F., "Methods to Improve the Validity and Sensitivity of a Self/Peer Assessment Instrument", IEEE Transactions on Education, 43(2):153--158, May 2000.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.9 Management
          Subjects: Programming teams

  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Literacy; Self-assessment; Information systems education

General Terms:
Management, Measurement

Keywords:
competency matrix, peer assessment, problem-based learning, project-based learning, team process