Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Regression testing involves testing the modified program in order to establish the confidence in the modifications. Existing regression testing methods generate test cases to satisfy selected testing criteria in the hope that this process may reveal faults in the modified program. In this paper we present a novel approach of automated regression test generation in which all generated test cases uncover an error(s). This approach is used to test the common functionality of the original program and its modified version, i.e., it is used for programs whose functionality is unchanged after modifications. The goal in this approach is to identify test cases for which the original program and the modified program produce different outputs. If such a test is found, then this test uncovers an error. The problem of finding such a test case may be reduced to the problem of finding program input on which a selected statement is executed. As a result, existing methods of automated test data generation for white-box testing may be used to generate these tests. Our experiments have shown that our approach may improve the chances of finding software errors as compared to the existing methods of regression testing. The advantage of our approach is that it is fully automated and that all generated test cases reveal an error(s).

REFERENCES

• 1: David L Bird , Carlos Urias Munoz, Automatic generation of random self-checking test cases, IBM Systems Journal, v.22 n.3, p.229-245, 1983
• 2: Robert S. Boyer , Bernard Elspas , Karl N. Levitt, SELECT—a formal system for testing and debugging programs by symbolic execution, ACM SIGPLAN Notices, v.10 n.6, p.234-245, June 1975
• 3: L. Clarke, "A system to generate test data and symbolically execute programs," IEEE Tran. Software Eng., Vol. 2, No. 3, 1976, pp. 215-222.
• 4: Richard A. DeMillo , A. Jefferson Offutt, Constraint-Based Automatic Test Data Generation, IEEE Transactions on Software Engineering, v.17 n.9, p.900-910, September 1991 [doi>10.1109/32.92910]
• 5: Roger Ferguson , Bogdan Korel, The chaining approach for software test data generation, ACM Transactions on Software Engineering and Methodology (TOSEM), v.5 n.1, p.63-86, Jan. 1996 [doi>10.1145/226155.226158]
• 6: R. Gupta, M. Harrold, M. Sofia, "An approach to regression testing using slices," Pr~ of Conference on Software Maintenance, 1992, pp. 299-308.
• 7: M. Harrold, M. Sofia, "An incremental approach to unit testing during maintenance," Proc. of Conference on Software Maintenance, 1988, pp. 362-367.
• 8: M. Harrold, R. Gupta, M. Sofia, "A methodology for controlling the size of a test suite," Proe. of Conf. on Software Maintenance, 1990, pp. 302-310.
• 9: W. Hetzel, The complete guide to system testing, QED Information Sciences, Inc., Wellesley, MA, 1988
• 10: Susan Horwitz , Thomas Reps , David Binkley, Interprocedural slicing using dependence graphs, ACM Transactions on Programming Languages and Systems (TOPLAS), v.12 n.1, p.26-60, Jan. 1990 [doi>10.1145/77606.77608]
• 11: W. How&n, "Symbolic testing and the DISSECT symbolic evaluation system," ~ Tran. on Software Eng., Vol. SE-3, No. 4, 1977, pp. 266-278.
• 12: Bogdan Korel, The program dependence graph in static program testing, Information Processing Letters, v.24 n.2, p.103-108, January 1987 [doi>10.1016/0020-0190(87)90102-5]
• 13: B. Korel, 'WESTG~ - A structural test data generation system," Prigs of the 6th International Conference on Software Testing, Washington, D.C., 1989.
• 14: B. Korel, Automated Software Test Data Generation, IEEE Transactions on Software Engineering, v.16 n.8, p.870-879, August 1990 [doi>10.1109/32.57624]
• 15: BJ Korel, "Dynamic method for software test data generation," journal of $oflw~e Testing, Verification and Reliability, Vol. 2, 1992, pp. 203--213.
• 16: B. Korel, 'WF_A'TGEN- An execution-oriented test data generation system," Technical Report TR.--SE-95-01, Department of Computer Science, Illinois Institute of Technology, i995.
• 17: Bogdan Korel, Automated test data generation for programs with procedures, Proceedings of the 1996 ACM SIGSOFT international symposium on Software testing and analysis, p.209-215, January 08-10, 1996, San Diego, California, United States
• 18: H. Leung, L. White, "Insights into regression testing," Prcreedmgs of Conference on Software Maintenance, Miami, 1989, pp. 6069.
• 19: H. Leung, L. White, "A study of Integration testing and software regression at the integration level" Proe. Conf. on Software Maintenance, 1990, pp. 290-301.
• 20: C. Ramamoorthy/ S. Ho, W. Chen, "On the automatext generation of program test data," IEEE Tran. on Software Eng., Vol. SE-2, No. 4, 1976, pp. 293-300.
• 21: Gregg Rothermel , Mary Jean Harrold, Selecting tests and identifying test coverage requirements for modified software, Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis, p.169-184, August 17-19, 1994, Seattle, Washington, United States [doi>10.1145/186258.187171]
• 22: Gregg Rothermel , Mary Jean Harrold, Selecting tests and identifying test coverage requirements for modified software, Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis, p.169-184, August 17-19, 1994, Seattle, Washington, United States [doi>10.1145/186258.187171]
• 23: Gregg Rothermel , Mary Jean Harrold, Analyzing Regression Test Selection Techniques, IEEE Transactions on Software Engineering, v.22 n.8, p.529-551, August 1996 [doi>10.1109/32.536955]
• 24: B. Sherlund, B. Korel, "Modification oriented software testing," In Conference Prigs: Quality Week 1991, May 1991, pp. 1-17.
• 25: M. Weiser, "Program slicing," IEEE Trans. on Software Eng., vol. SF_,-10, No. 4,A982, pp. 352-357.
• 26: Lee J. White , Venkatasubramaniam Narayanswamy , Ted Friedman , Marc Kirschenbaum , Paul Piwowarski , Mitsuru Oha, Test Manager: A Regression Testing Tool, Proceedings of the Conference on Software Maintenance, p.338-347, September 01, 1993

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.7 Distribution, Maintenance, and Enhancement
          Subjects: Restructuring, reverse engineering, and reengineering

General Terms:
Algorithms, Experimentation, Verification