Javalanche: efficient mutation testing for Java

ABSTRACT

To assess the quality of a test suite, one can use mutation testing - seeding artificial defects (mutations) into the program and checking whether the test suite finds them. Javalanche is an open source framework for mutation testing Java programs with a special focus on automation, efficiency, and effectiveness. In particular, Javalanche assesses the impact of individual mutations to effectively weed out equivalent mutants; it has been demonstrated to work on programs with up to 100,000 lines of code.

REFERENCES

• 1: R. A. DeMillo, D. S. Guindi, K. N. King, W. M. McCracken, and A. J. Offutt. An extended overview of the Mothra software testing environment. In Proceedings of the Second Workshop on Software Testing, Verification, and Analysis, pages 142--151, Banff, Alberta, 1988. IEEE Computer Society Press.
• 2: B. J. M. Grün, D. Schuler, and A. Zeller. The impact of equivalent mutants. In Mutation 2009: International Workshop on Mutation Analysis, Apr. 2009.
• 3: A. J. Offutt, A. Lee, G. Rothermel, R. H. Untch, and C. Zapf. An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering and Methodology (TOSEM), 5(2):99--118, 1996.
• 4: A. J. Offutt and R. H. Untch. Mutation 2000: Uniting the orthogonal, pages 34--44. Kluwer Academic Publishers, Norwell, MA, USA, 2001.
• 5: D. Schuler, V. Dallmeier, and A. Zeller. Efficient mutation testing by checking invariant violations. In ISSTA '09: Proceedings of the 2009 International Symposium on Software Testing and Analysis, July 2009. To appear.
• 6: R. H. Untch, A. J. Offutt, and M. J. Harrold. Mutation analysis using mutant schemata. In ISSTA '93: Proceedings of the 1993 International Symposium on Software Testing and Analysis, pages 139--148, New York, NY, USA, 1993. ACM.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

General Terms:
Experimentation

Keywords:
mutation testing