The application of error-sensitive testing strategies to debugging

ABSTRACT

Program errors can be considered from two perspectives—cause and effect. The goal of program testing is to detect errors by discovering their effects, while the goal of debugging is to search for the associated cause. In this paper, explore ways in which some of the results of testing research can be applied to the debugging process. In particular, computation testing and domain testing, which are two error-sensitive test data selection strategies, are described. Ways in which these selection strategies can be used as debugging aids are then discussed.

REFERENCES

• 1: R.M. Balzer, "EXDAMS—Extendable Debugging and Monitoring System," 1969 Spring Joint Computer Conference, AFIPS Conference Proceedings, 34, AFIPS Press, Montvale, New Jersey, 576-580.
• 2: Robert S. Boyer , Bernard Elspas , Karl N. Levitt, SELECT—a formal system for testing and debugging programs by symbolic execution, Proceedings of the international conference on Reliable software, p.234-245, April 21-23, 1975, Los Angeles, California
• 3: T.E. Cheatham, G.H. Holloway, and J.A. Townley, "Symbolic Evaluation and the Analysis of Programs," IEEE Transactions on Software Engineering, SE-5, 4, July 1979, 402-417.
• 4: L.A. Clarke, "Automatic Test Data Selection Techniques," Infotech State of the Art Report on Software Testing, 2, September 1978, 43-64.
• 5: L.A. Clarke and D.J. Richardson, "Symbolic Evaluation Methods—Implementations and Applications," Computer Program Testing, North-Holland Publishing Co., B.Chandrasekaran and S.Radicchi (eds.), 1981, 65-102.
• 6: L.A. Clarke, J. Hassell, and D.J. Richardson, "A Close Look at Domain Testing," IEEE Transactions on Software Engineering, SE-8, 4, July 1982, 380-390.
• 7: L.A.Clarke and D.J. Richardson, "A Rigorous Approach to Error-Sensitive Testing," accepted for publication in the Sixteenth Annual Hawaii Conference on System Sciences, January 1983.
• 8: M. Davis, "Hilbert's Tenth Problem is Unsolvable," American Mathematics Monthly, 80, March 1973, 233-269.
• 9: R.A. DeMillo, F.G. Sayward, and R.J. Lipton, "Program Mutation: A New Approach to Program Testing," State of the Art Report on Program Testing, 1979, Infotech International.
• 10: R.E. Fairley, "An Experimental Program-Testing Facility," IEEE Transactions on Software Engineering, SE-1, 4, December 1975, 350-357.
• 11: K.A. Foster, "Error Sensitive Test Case Analysis (ESTCA)," IEEE Transactions on Software Engineering, SE-6, 3, May 1980, 258-264.
• 12: W.E. Howden, "Methodology for the Generation of Program Test Data," IEEE Transactions on Computer, C-24,5, May 1975, 554-559.
• 13: W.E.Howden, "An Evaluation of the Effectiveness of Symbolic Testing," Software: Practice and Experience, 10, July-August 1978, 381-397.
• 14: W.E. Howden, "Algebraic Program Testing," ACTA Informatica, 10, 1978.
• 15: W.E. Howden, "Functional Program Testing," IEEE Transactions on Software Engineering, SE-6, 2, March 1980, 162-169.
• 16: J. C. Huang, An Approach to Program Testing, ACM Computing Surveys (CSUR), v.7 n.3, p.113-128, Sept. 1975 [doi>10.1145/356651.356652]
• 17: J.W. Laski, "A Hierarchical Approach to Program Testing," Department of Systems Design, University of Waterloo, Waterloo, Ontario, Canada, Technical Report No.55CFW130779.
• 18: Glenford J. Myers, Art of Software Testing, John Wiley & Sons, Inc., New York, NY, 1979
• 19: S.C. Ntafos, "On Testing With Required Elements," Proceedings of COMPSAC '81, November 1981, 132-139.
• 20: C.Ramamoorthy, Y. Mok, F. Bastani, G. Chin, and K. Suzuki, "Application of a Methodology for the Development and Validation of Reliable Process Control Software," IEEE Transactions on Software Engineering, SE-7, 6, November 1981, pp.537-555.
• 21: S.Rapps and E.J. Weyuker, "Data Flow Analysis Techniques for Test Data Selection," Computer Science Department, New York University, New York, New York, Technical Report No.023, December 1981.
• 22: S.T. Redwine, "An Engineering Approach to Test Data Design," IEEE Transactions on Software Engineering, SE-9, 2, March 1983, pp. 191-200.
• 23: Debra J. Richardson , Lori A. Clarke, A partition analysis method to increase program reliability, Proceedings of the 5th international conference on Software engineering, p.244-253, March 09-12, 1981, San Diego, California, United States
• 24: D.J. Richardson and L.A. Clarke, "On the Effectiveness of the Partition Analysis Method," Proceedings of COMPSAC '82 529-537.
• 25: John H. Rowland , Philip J. Davis, On the Use of Transcendentals for Program Testing, Journal of the ACM (JACM), v.28 n.1, p.181-190, Jan. 1981 [doi>10.1145/322234.322247]
• 26: Mark Weiser, Program slicing, Proceedings of the 5th international conference on Software engineering, p.439-449, March 09-12, 1981, San Diego, California, United States
• 27: E.J. Weyuker, "An Error-Based Testing Strategy," Computer Science Department, New York University, New York, New. York, Technical Report No.027, January 1981.
• 28: L.J. White and E.I. Cohen, "A Domain Strategy for Computer Program Testing", IEEE Transactions on Software Engineering, SE-6, May 1980, 247-257.
• 29: Steven J. Zeil , Lee J. White, Sufficient test sets for path analysis testing strategies, Proceedings of the 5th international conference on Software engineering, p.184-191, March 09-12, 1981, San Diego, California, United States

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Symbolic execution

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

General Terms:
Performance, Verification