Automated testing of non-functional requirements

ABSTRACT

We present an open-source toolkit that enables automated testing of non-functional requirements. Our toolkit offers an alternative to current approaches (e.g. testing suites) by being lightweight, flexible, free and by reusing libraries and executables found on common operating systems and platforms. The toolkit provides developers and project managers with reports about the system under development. We would like to advocate the importance of non-functional testing, especially in the context of agile projects, and we have experienced significant risk reductions in our projects when using the toolkit described here.

REFERENCES

• 1: http://en.wikipedia.org/wiki/Test_automation
• 2: http://en.wikipedia.org/wiki/Agile_software_development
• 3: http://en.wikipedia.org/wiki/Inversion_of_control
• 4: http://en.wikipedia.org/wiki/Dependency_injection
• 5: http://cruisecontrol.sourceforge.net/

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management
          Subjects: Software development

General Terms:
Measurement, Performance, Reliability, Verification

Keywords:
automated testing, metrics, non-functional requirements, open source