The automated web application testing (AWAT) system

ABSTRACT

In this paper we propose an Automated Web application Testing (AWAT) system which can be used by instructors to effectively evaluate student web programming projects automatically based on the test cases specified on Excel. The AWAT is driven by WATIR and simulates the actions of human testers to extract information from Web pages, and verify expected outcome based on the test case specification. The system is unique in its ability to interact with web GUI and its portability to work with any client side or server side web application on any platforms.

The preliminary experiments have been conducted and We found that the system can provide fairness to the grading of large scaled student projects and can greatly help elevate faculty productivity.

REFERENCES

• 1: Kenneth A. Reek, The TRY system -or- how to avoid testing student programs, ACM SIGCSE Bulletin, v.21 n.1, p.112-116, Feb. 1989
• 2: Kenneth A. Reek, A software infrastructure to support introductory computer science courses, Proceedings of the twenty-seventh SIGCSE technical symposium on Computer science education, p.125-129, February 15-17, 1996, Philadelphia, Pennsylvania, United States
• 3: David Jackson , Michelle Usher, Grading student programs using ASSYST, Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education, p.335-339, February 27-March 01, 1997, San Jose, California, United States
• 4: Edward L. Jones, Grading student programs - a software testing approach, Journal of Computing Sciences in Colleges, v.16 n.2, p.185-192, Jan. 2001
• 5: Morris, D. S. "Automatic grading of student's programming assignments: An interactive process and suite of programs", Proceedings 33^rd ASEE/IEEE Frontiers in Education Conference, Boulder, CO, USA, November 5--8, 2003, pp. 112--116
• 6: Brenda Cheang , Andy Kurnia , Andrew Lim , Wee-Chong Oon, On automated grading of programming assignments in an academic institution, Computers & Education, v.41 n.2, p.121-131, September 2003 [doi>10.1016/S0360-1315(03)00030-7]
• 7: Yanhong Sun , Edward L. Jones, Specification-driven automated testing of GUI-based Java programs, Proceedings of the 42nd annual Southeast regional conference, April 02-03, 2004, Huntsville, Alabama [doi>10.1145/986537.986570]
• 8: Feng, M. Y. and McAllister, A. "A Tool for Automated GUI Program Grading", 36^th ASEE/IEEE Frontiers in Education Conference, October 28--31, 2006, Session S1F
• 9: http://wtr.rubyforge.org/watir_user_guide.html, WATIR library User Guide
• 10: http://www.rubydoc.org/stdlib/libdoc/win32ole/rdoc/index.html, WIN32OLE library Documentation
• 11: Excel Test Data Format, Sheet Format, from the internet site, http://www.ddsteps.org/display/doc/Excel+Test+Data+Format

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-managed instruction (CMI)

General Terms:
Algorithms, Design, Standardization, Verification

Keywords:
GUI design, automated grading, automated testing, programming specifications, software testing, test cases, web applications