Testing levels for object-oriented software

ABSTRACT

One of the characteristics of object-oriented software is the complex dependency that may exist between classes due to inheritance, association and aggregation relationships. Hence, where to start testing and how to define an integration strategy are issues that require further investigation. This paper presents an approach to define a test order by exploiting a model produced during design stages (e.g., using OMT, UML), namely the class diagram. Our goal is to minimize the number of stubs to be constructed in order to decrease the cost of testing. This is done by testing a class after the classes it depends on. The novelty of the test order lies in the fact that it takes account of: (i) dynamic (polymorphism) dependencies; (ii) abstract classes that cannot be instantiated, making some testing levels infeasible. The test order is represented by a graph showing which testing levels must be done in sequence and which ones may be done independently. It also provides information about the classes involved in each level and how they are involved (e.g., instantiation or not). The approach is implemented in a tool called TOONS (Testing level generator for Object-OrieNted Software). It is applied to an industrial case study from the avionics domain.

REFERENCES

• 1: Boris Beizer, Software testing techniques (2nd ed.), Van Nostrand Reinhold Co., New York, NY, 1990
• 2: R. V. Binder, "Testing Object-Oriented Software: a Survey," Software Testing, Verification & Reliability, vol. 6 (3/4), pp. 125-252, 1996.
• 3: Roong-Ko Doong , Phyllis G. Frankl, The ASTOOT approach to testing object-oriented programs, ACM Transactions on Software Engineering and Methodology (TOSEM), v.3 n.2, p.101-130, April 1994 [doi>10.1145/192218.192221]
• 4: Mary Jean Harrold , John D. McGregor , Kevin J. Fitzpatrick, Incremental testing of object-oriented class structures, Proceedings of the 14th international conference on Software engineering, p.68-80, May 11-15, 1992, Melbourne, Australia [doi>10.1145/143062.143093]
• 5: Thierry Jéron , Jean-Marc Jézéquel , Yves Le Traon , Pierre Morel, Efficient Strategies for Integration and Regression Testing of OO Systems, Proceedings of the 10th International Symposium on Software Reliability Engineering, p.260, November 01-04, 1999
• 6: Paul C. Jorgensen , Carl Erickson, Object-oriented integration testing, Communications of the ACM, v.37 n.9, p.30-38, Sept. 1994 [doi>10.1145/182987.182989]
• 7: D. Kung, J. Gao, P. Hsia, J. Lin and Y. Toyoshima, "Class Firewall, test order, and regression testing of object-oriented programs," Journal of Object-Oriented Programming, vol. 8 (2), pp. 51-65, 1995.
• 8: David Kung , Jerry Gao , Pei Hsia , Yasufumi Toyoshima , Chris Chen , Young-Si Kim , Young-Kee Song, Developing an object-oriented software testing and maintenance environment, Communications of the ACM, v.38 n.10, p.75-87, Oct. 1995 [doi>10.1145/226239.226256]
• 9: David C. Kung , Jerry Gao , Chen-Ho Kung, Testing Object-Oriented Software, IEEE Computer Society Press, Los Alamitos, CA, 1998
• 10: J. Mc Gregor, "Let's Don't and Say We Did," Journal of Object-Oriented Programming, vol. 11 (5), pp. 6- 11,14, 1998.
• 11: Allen S. Parrish , Richard B. Borie , David W. Cordes, Automated flow graph-based testing of object-oriented software modules, Journal of Systems and Software, v.23 n.2, p.95-109, Nov. 1993 [doi>10.1016/0164-1212(93)90076-A]
• 12: K.-C. Tai and F. J. Daniels, "Interclass Test Order for Object-Oriented Software," Journal of Object-Oriented Programming, vol. 12 (4), pp. 18-25,35, 1999.
• 13: Pascale Thevenod-Fosse , Helene Waeselynck, Towards a Statistical Approach to Testing Object-Oriented Programs, Proceedings of the 27th International Symposium on Fault-Tolerant Computing (FTCS '97), p.99, June 25-27, 1997
• 14: Christopher D. Turner , David J. Robson, The State-Based Testing of Object-Oriented Programs, Proceedings of the Conference on Software Maintenance, p.302-310, September 01, 1993
• 15: Hélène Waeselynck , Pascale Thévenod-Fosse, A Case Study in Statistical Testing of Reusable Concurrent Objects, Proceedings of the Third European Dependable Computing Conference on Dependable Computing, p.401-418, September 15-17, 1999

INDEX TERMS

Primary Classification:
  D. Software
  D.1 PROGRAMMING TECHNIQUES

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management
          Subjects: Software maintenance

General Terms:
Algorithms, Design, Management, Measurement, Performance, Reliability, Theory, Verification

Keywords:
abstract classes, integration strategy, object-oriented oftware, polymorphism, test order, tool