The coupling effect: fact or fiction

ABSTRACT

Fault-based testing strategies test software by focusing on specific, common types of errors. The coupling effect states that test data sets that detect simple types of faults are sensitive enough to detect more complex types of faults. This paper describes empirical investigations into the coupling effect over a specific domain of software faults. All the results from this investigation support the validity of the coupling effect. The major conclusion from this investigation is that by explicitly testing for simple faults, we are also implicitly testing for more complicated faults. This gives us confidence that fault-based testing is an effective means of testing software.

REFERENCES

• ABD+79: A. T. Acree, T. A. Budd, R. A. De- Millo, R. J. Lipton, and F. G. Sayward. Mutation analysis. Technical report GIT-ICS-79/08, School of Information and Computer Science, Georgia Institute of Technology, Atlanta GA, September 1979.
• Bud80: Timothy Alan Budd, Mutation analysis of program test data, 1980
• CR83: Lori A. Clarke , Debra J. Richardson, The application of error-sensitive testing strategies to debugging, Proceedings of the ACM SIGSOFT/SIGPLAN software engineering symposium on High-level debugging, p.45-52, January 1983 [doi>10.1145/800007.808007]
• DGK+88: R. A. DeMillo, D. S. Guindi, K. N. King, W. M. McCracken, and A. J. Offutt. An extended overview of the Mothra software testing environment. In Proceedings of the Second Workshop on Software Testing, Verification and Analysis, Banff Alberta, July 1988.
• DKM+89: R. A. DeMillo, E. W. Krauser, R. J. Martin, A. J. Offutt, and E. H. Spafford. The Mothra tool set. In Proceedings of the Hawaii International Conference on System Sciences, Kailua-Kona HI, January 1989.
• DLS78: R. A. DeMillo, R. J. Lipton, and F. G. Sayward. Hints on test data selection: Help for the practicing programmer. Computer, 11(4), April 1978.
• DO88: R. A. DeMiIIo and A. J. Offutt. Experimental results of automatically generated adequate test sets. In Proceedings of the Sixth Annual Pacific Northwest Software Quality Conference, Portland OR, September 1988.
• Hoa71: C. A. R. Hoare, Proof of a program: FIND, Communications of the ACM, v.14 n.1, p.39-45, Jan. 1971 [doi>10.1145/362452.362489]
• How87: William E Howden, Functional program testing and analysis, McGraw-Hill, Inc., New York, NY, 1986
• LS78: R. J. Lipton and F. G. Sayward. The status of research on program mutation. In Digest for the Workshop on Software Testing and Test Documentation, pages 355-373, December 1978.
• Mor84: Larry Joe Morell, A theory of error-based testing, 1983
• Mor88: L. J. Morell. Theoretical insights into fault-based testing. In Proceedings of the Second Workshop on Software Testing, Verification and Analysis, Banff Alberta, July 1988.
• Off88: Andrew Jefferson Offutt, VI , R. A. Demillo, Automatic test data generation, 1988
• RHC76: C. V. R amamoorthy, S. F. Ho, and W. T. Chen. On the automated generation of program test data. Transactions on Software Engineering, 2(4), December 1976.
• RT88: D. J. Richardson and M. C. Thompson. The relay model for error detection and its application. In Proceedings of the Second Workshop on Software Testing, Verification and Analysis, Banff Alberta, July 1988.
• Wey83: Elaine J. Weyuker, Assessing Test Data Adequacy through Program Inference, ACM Transactions on Programming Languages and Systems (TOPLAS), v.5 n.4, p.641-655, Oct. 1983 [doi>10.1145/69575.357231]
• WO80: E. J. Weyuker and T. J. Ostrand. Theories of program testing and the application of revealing subdomains. Transactions of Software Engineering, 6(3):236-246, May 1980.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Reliability

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Diagnostics

General Terms:
Experimentation, Reliability, Verification