Using genetic algorithms to generate test plans for functionality testing

ABSTRACT

Like in other fields, computer products (applications, hardware, etc.), before being marketed, require some level of testing to verify whether they meet their design and functional specifications -- called functionality test. The general process of performing functionality test consists in the production of a test plan that is then executed by humans or by automated software tools. The main difficulty in this entire process is the definition of such test plan. How can we know what a good sequence (test plan) is? The rule of thumb is to trust on people who understand the workings of the application being tested and who can decide what should be tested. The danger is that experts, due to their over-confidence on their knowledge, may become blind to issues that should otherwise be easy to see. This paper describes a technique based on genetic algorithms that is able to generate good test plans in an unbiased way and with minimum expert interference.

REFERENCES

• 1: A.-L. Barabási. Linked: The New Science of Networks. Perseus Publishing, 2002.
• 2: Kent Beck, Extreme programming explained: embrace change, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 3: D. Berndt , J. Fisher , L. Johnson , J. Pinglikar , A. Watkins, Breeding Software Test Cases with Genetic Algorithms, Proceedings of the 36th Annual Hawaii International Conference on System Sciences (HICSS'03) - Track 9, p.338.1, January 06-09, 2003
• 4: D. J. Berndt. Investigating the performance of genetic algorithms-based software test case generation. In Eighth IEEE International Symposium on High Assurance Systems Engineering (HASE'04), 2004.
• 5: C. Darwin. On the Origin of Species: A facsimile of the first edition. Harvard University Press, July 1975.
• 6: E. W. Dijkstra. Structured programming. In O.-J. Dahl, E. W. Dijkstra, and C. A. R. Hoare, editors, Notes on Structured Programming, pages 1--82. Academic Press, 1972.
• 7: John H. Holland, Adaptation in natural and artificial systems, MIT Press, Cambridge, MA, 1992
• 8: IVIA Ltda. Phonnia. http://www.phonnia.com.br/.
• 9: Bogdan Korel, Automated test data generation for programs with procedures, Proceedings of the 1996 ACM SIGSOFT international symposium on Software testing and analysis, p.209-215, January 08-10, 1996, San Diego, California, United States
• 10: C. Lloyd. The alarm pheronones of social insects: A review. Technical report, Colorado State University, 2003.
• 11: C. C. Michael , G. E. McGraw , M. A. Schatz , C. C. Walton, Genetic algorithms for dynamic test data generation, Proceedings of the 12th international conference on Automated software engineering (formerly: KBSE), p.307, November 02-05, 1997
• 12: C. E. Williams. Software testing and uml. In Proceedings of the 10th International Symposium on Software Reliability Engineering, Boca Raton, Florida, Nov. 1999. IEEE Press.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search
          Subjects: Heuristic methods

General Terms:
Algorithms, Design, Verification