Evaluation of mutation testing for object-oriented programs

ABSTRACT

The effectiveness of mutation testing depends heavily on the types of faults that the mutation operators are designed to represent. Thus, the quality of the mutation operators is key to mutation testing. Although, mutation operators for object-oriented languages have previously been presented, little research has been done to show the usefulness of the class mutation operators. To assess the usefulness of class mutation operators, we conducted two empirical studies. In the first study, we examine the number and kinds of mutants that are generated for object-oriented programs. In the second study, we investigate the way in which class mutation operators model faults that are not detected by traditional mutation testing. We conducted our studies using a well-known object-oriented system, BCEL.

REFERENCES

• 1: BCEL: Byte Code Engineering Library WWW page.
• 2: Roger T. Alexander , James M. Bieman , Sudipto Ghosh , Bixia Ji, Mutation of Java Objects, Proceedings of the 13th International Symposium on Software Reliability Engineering (ISSRE'02), p.341, November 12-15, 2002
• 3: P. Chevalley and P. Thévenod-Fosse. A mutation analysis tool for Java programs. Journal on Software Tools for Technology Transfer (STTT), pages 1--14, December 2002.
• 4: S. Kim, J. Clark, and J. McDermid. Class mutation: Mutation testing for object-oriented programs. OOSS: Object-Oriented Software Systems, October 2000.
• 5: R. J. Lipton, R. A. DeMillo, and F. G. Sayward. Hints on test data selection: help for the practicing programmer. IEEE Computer, 11(4):34--41, November April.
• 6: Yu-Seung Ma , Yong-Rae Kwon , Jeff Offutt, Inter-Class Mutation Operators for Java, Proceedings of the 13th International Symposium on Software Reliability Engineering (ISSRE'02), p.352, November 12-15, 2002
• 7: A. J. Offutt , S. D. Lee, An Empirical Evaluation of Weak Mutation, IEEE Transactions on Software Engineering, v.20 n.5, p.337-344, May 1994 [doi>10.1109/32.286422]
• 8: Jeff Offutt , Yu-Seung Ma , Yong-Rae Kwon, An experimental mutation system for Java, ACM SIGSOFT Software Engineering Notes, v.29 n.5, September 2004 [doi>10.1145/1022494.1022537]
• 9: Jeff Offutt , Roger Alexander , Ye Wu , Quansheng Xiao , Chuck Hutchinson, A Fault Model for Subtype Inheritance and Polymorphism, Proceedings of the 12th International Symposium on Software Reliability Engineering (ISSRE'01), p.84, November 27-30, 2001

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

General Terms:
Experimentation