Introduction to special section on software testing

ABSTRACT

The field of software testing spans mathematical theory, the art and practice of validation, and methodology of software development. To cover this range would require a textbook (or several texts), not a trio of articles. But the work presented in this special section is a kind of "test set." Each paper is a significant contribution within one of the three broad areas. The reader must now make the assessment that is critical to any review of test points: are they representative? My own answer is 'no'; these articles are provocative and revealing rather than routine summaries. And perhaps that is what software testing is all about: good tests are the ones that provide new insights, not the ones that cover well worn ground.

REFERENCES

• 1: Victor R. Basili , Richard W. Selby, Comparing the effectiveness of software testing strategies, IEEE Transactions on Software Engineering, v.13 n.12, p.1278-1296, December 1, 1987 [doi>10.1109/TSE.1987.232881]
• 2: Clarke, L. A system to generate test data and symbolically execute programs. IEEE Trans. Sofiw. Eng. SE-2, 5 (Sept. 1977), 215-222.
• 3: Darringer, J. and King, J. Applications of symbolic execution to program testing. Computer lI, 4 (Apr. 1978), 51-60.
• 4: DeMillo, R., Lipton, R., and Sayward, F. Hints on test data selection: Help for the practicing programmer. Computer 11, 4 (Apr. 1978), 34-43.
• 5: Duran, J. and Ntafos, S. An evaluation of random testing. IEEE Trans. Softw. Eng. SE-IO, 4 (July 1984), 438-444.
• 6: Maurice H Halstead, Machine-independent computer programming, Spartan Books, 1962
• 7: R. G. Hamlet, A patent problem for abstract programming languages; machine-independent computations, Proceedings of the fourth annual ACM symposium on Theory of computing, p.193-197, May 01-03, 1972, Denver, Colorado, United States [doi>10.1145/800152.804914]
• 8: Hamlet, R. Other people's monitors. ACM SIGPLAN Not. 8, 7 (July 1973), 21-22.
• 9: Hamlet, R. Testing programs with the aid of a compiler. IEEE Trans. Softw. Eng. SE-3, 4 (July 1977}, 279-290.
• 10: Richard G. Hamlet, Probable correctness theory, Information Processing Letters, v.25 n.1, p.17-25, 20 April 1987 [doi>10.1016/0020-0190(87)90088-3]
• 11: Howden, W. Methodology for the generation of program test data. IEEE Trans. Computers C-24, 5 (May 1975}, 554-559.
• 12: Howden, W. Reliability of the path analysis testing strategy. IEEE Trans. Softw. Eng. SE-2, 5 (Sept. 1976), 208-215.
• 13: Howden, W. Weak mutation testing and completeness of test sets. IEEE Trans. Softw. Eng. SE-8, 4 (July 1982), 371-379.
• 14: J. C. Huang, An Approach to Program Testing, ACM Computing Surveys (CSUR), v.7 n.3, p.113-128, Sept. 1975 [doi>10.1145/356651.356652]
• 15: Lonergan, L., and King, P. Design of the B5000 system. Datamation 7, (May 1961), 28-32.
• 16: Morell, L. A model for assessing code-based testing techniques. In Proceedings of the 5th Annual Pacific Northwest Software Quality Conference (Portland), 1987, 309-325.
• 17: Ramamoorthy, C., Ho, S., and Chen, W. On the automated generation of program test data. IEEE Trans. Softw. Eng. SE-2, 6 {Dec. 1976), 293-300.
• 18: Sandra Rapps , Elaine J. Weyuker, Selecting software test data using data flow information, IEEE Transactions on Software Engineering, v.11 n.4, p.367-375, April 1985 [doi>10.1109/TSE.1985.232226]
• 19: Ross, S. Software reliability: The stopping rule problem. IEEE Trans. Softw. Eng. SE- 11, 12 (Dec. 1985}, 1472-~ 476.
• 20: Martin L. Shooman, Software engineering: reliability, development, and management., McGraw-Hill, Inc., New York, NY, 1983
• 21: Weiser, M., Gannon, J., and McMullin, P. Comparison of structural test coverage metrics. IEEE Softw. 2, 2 (Mar. 1985}, 80-85.
• 22: E J Weyuker, Axiomatizing software test data adequacy, IEEE Transactions on Software Engineering, v.12 n.12, p.1128-1138, Dec.1986
• 23: Weyuker, E. The applicability of program schema results to programs. Int. }. Computer Inform. Sci. 8, 387-.403.
• 24: Zelkowitz, M., et al. Software engineering practices in the U.S. and Japan. Computer 17, 6 tJune 1984), 57-66.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Validation

General Terms:
Design, Performance, Verification