Evaluation of a computer networking class in information technology

ABSTRACT

Information Technology (IT) is a rapidly-developing discipline. IT instructors often design new courses to meet changing needs. There is also a need to evaluate courses once they have been designed and implemented. Evaluation of courses leads to improvements in the learning experiences for students and better understanding of the educational process and outcomes for course designers and instructors. Evaluation and improvement of quality is a requirement for programs accredited under ABET (and other accrediting bodies).

A networking class in IT was selected for evaluation. Networking was selected because it is one of the core required topics in the IT curriculum. The course was compared to national standards for curriculum in the networking area. A single class was evaluated but methods were developed which can be applied to other courses in the IT discipline. The evaluation study included evaluation of the course content and the course structure. Student input was obtained through a survey instrument and the validity of the input was considered.

Several questions were identified for this evaluation: Did the networking class meet student needs and expectations in terms of content and teaching approach; What are the students preferred learning styles; What coursework should a networking class include compared to what was actually taught; Did success in the earlier foundation class lead to success in the networking class; How well did students perform in this class relative to their performance in the IT major as a whole?

Pursuing these questions involved data gathering from students as well as researching student records. Appropriate mechanisms were developed to protect student privacy.

The evaluation of this class led to a number of useful insights and recommendations into technical class content, teaching and learning styles, and into the evaluation process. The methods of the study can be used for other courses and for other IT programs.

REFERENCES

• 1: Lisa M. Frye, Wireless sensor networks: learning and teaching, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324360]
• 2: Alessio Gaspar , Sarah Langevin, Restoring "coding with intention" in introductory programming courses, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324323]
• 3: Sandra Gorka , Jacob R. Miller , Brandon J. Howe, Developing realistic capstone projects in conjunction with industry, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324309]
• 4: Michael D. Kane , John A. Springer, Integrating bioinformatics, distributed data management, and distributed computing for applied training in high performance computing, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324311]
• 5: Raheel A. Malik , Raymond A. Hansen , James E. Goldman , Anthony H. Smith, Laboratory modules for conducting comparative analysis of 802.11 frames, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324351]
• 6: Brandon Wagner , Stephen Renshaw , Kent Broadbent, A multi-part lab exercise for analyzing the effect of peer-to-peer software on a university network, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324352]
• 7: Linda D. Webster , Edward J. Mirielli, Student reflections on an academic service learning experience in a computer science classroom, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324347]
• 8: Stephen J. Zilora , Lisa M. Hermsen, Take a WAC at writing in your course, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324339]
• 9: Jill E. Courte, Comparing student acceptance and performance of online activities to classroom activities, Proceedings of the 8th ACM SIGITE conference on Information technology education, October 18-20, 2007, Destin, Florida, USA [doi>10.1145/1324302.1324341]
• 10: Paul Strooper , Larissa Meinicke, Evaluation of a new assesment scheme for a third-year concurrency course, Proceedings of the ninth Australasian conference on Computing education, p.147-154, January 30-February 02, 2007, Ballarat, Victoria, Australia
• 11: Kay C. Bryant, The evaluation of courses in Information Systems, Proceedings of the sixth conference on Australasian computing education, p.15-23, January 01, 2004, Dunedin, New Zealand
• 12: Information technology - Open Systems Interconnection - Basic Reference Model: The Basic Model. 1994. Retrieved. from http://standards.iso.org/ittf/licence.html
• 13: Computing Curricula: Information Technology Volume. 2005. (May 2008 update version) Retrieved. from http://campus.acm.org/public/comments/it--curriculum--draft--may--2008.pdf
• 14: Moore, G. E. (1965). Cramming more components onto integrated circuits. Electronics, 38(8).
• 15: Robert R. Schaller, Moore's law: past, present, and future, IEEE Spectrum, v.34 n.6, p.52-59, June 1997 [doi>10.1109/6.591665]
• 16: C. Richard G. Helps , Stephen A. Renshaw, Design of a flexible case-study instructional module for operating systems for information technology, Proceedings of the 5th conference on Information technology education, October 28-30, 2004, Salt Lake City, UT, USA [doi>10.1145/1029533.1029548]
• 17: Helps, R. G., & Renshaw, S. A. (2005, June 2005). UML and Design Layers Provide a Course Design Paradigm and Notation to Create Robust Technology Courses in Rapidly Changing Environments. Paper presented at the 2005 ASEE Annual Conference & Exposition, Portland OR.
• 18: Kolb, D. A. 1984. Experiential learning: experience as the source of learning and development. Englewood Cliffs, N.J.: Prentice-Hall
• 19: Johnson, David W.; Johnson, Roger T.; Smith, Karl A., 1998, Active Learning: Cooperation in the College Classroom, Interaction Book Company
• 20: Collins, A., Brown, J. S., & Holum, A. (1991). Cognitive Apprenticeship: Making Thinking Visible. American Educator (Winter, 1991).
• 21: Collins, A., Brown, J. S., & Newman, S. E. (1989). Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. In L. B. Resnick (Ed.), Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser. Hillsdale, NJ: Erlbaum.
• 22: Mayer, R. E. (1999). Designing Instruction for Constructivist Learning. In C. M. Reigeluth (Ed.), Instructional Design Theories and Models (Vol. II, pp. 141--159). London: Lawrence Erlbaum Associates.
• 23: Slavin, R. (1994). Cooperative Learning: Theory, Research and Practice (2 Ed.). New Jersey: Prentice Hall.
• 24: Baker, A. C., Jensen, P. J., & Kolb, D. A. (2002). Conversational Learning: An Experiential Approach to Knowledge Creation: Greenwood Publishing Group.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.0 General

General Terms:
Documentation, Human Factors, Management, Measurement

Keywords:
course design, course evaluation, networking