Automated testing of protocol specifications and their implementations

ABSTRACT

A highly automated approach is proposed for validating the consistency of distinct representations of an identical software functionality. This approach is based on checking whether the observable behaviors presented by software functionality representations given in different levels of abstraction are consistent with one another. These representations are encoded in a relatively mechanical way as procedures in sequential PROLOG, a very high level language. The approach is extremely flexible, straight-forward to use, and particularly appropriate to layered protocol architectures. As well, the approach leads to more reliable and less tedious, less error-prone test harness construction and maintenance. A number of variations and extensions of the approach are given. The use of this approach is illustrated in the context of communication protocols design and evaluation.

REFERENCES

• 1: Bazzichi, F. and I. Spadafora, "An automatic generator for compiler testing", IEEE Trans. on SE., Vol. SE-8, No. 4, July 1982, pp. 343-353.
• 2: G.V. Bochmann, "A General Transition Model for Protocols and Communication Services", IEEE Trans. on Communications, Vol. COM 28, 4 (April 1980), pp. 643-650.
• 3: Chow, T.S., "Testing Software design modelled by finite-state machines", IEEE Trans. on SE., Vol. SE-4, No. 3, May 1978.
• 4: Colmerauer, A., "Natural language communication with computers", in Lecture Notes in Computer Science(L. Bolc), Springer-Verlag, New York, 1978).
• 5: Howden W.E., "Weak mutation testing and completeness of test sets", IEEE Trans. on SE., Vol. SE-8, No. 4, July 1982, pp. 371-379.
• 6: "Tutorial on formal description techniques (FDT)", ISO TC97/SC 16N, May 1983.
• 7: C. Jard , G. V. Bochmann, An approach to testing specifications (Preliminary Draft), Proceedings of the ACM SIGSOFT/SIGPLAN software engineering symposium on High-level debugging, p.53-59, January 1983 [doi>10.1145/800007.808008]
• 8: Robert Kowalski, Logic for problem-solving, North-Holland Publishing Co., Amsterdam, The Netherlands, 1986
• 9: Logrippo, L., "Constructive and executable specification of protocol services by using abstract data types and finite state tranducers", Proc. of 3rd Int. Workshop on Protocol Specification, Testing, Verification, Zurich, May 1983, pp. 111-124.
• 10: Piatkowski, T.F., "Remarks on the feasibillty of validating and testing ADCCP implementations", Proc. of Trends and Applications, May 1980, pp. 94-109.
• 11: Probert, R.L., "Grey-Box (Design-Based) testing techniques", Proc. of 15th Hawaii Int. Conf. on System Sciences, 1982, pp. 94-102.
• 12: Probert, R.L., D.R. Skuce and H. Ural, "Specification of representative test cases", Proc. of 16th Hawaii Int. Conf. on System Sciences, Jan 1983, pp. 190-196.
• 13: Ural, H., "A life-cycle approach to testing protocol implementations", Ph.D. thesis (in preparation).
• 14: Ural, H. and R.L. Probert, "Architectures for testing protocol implementations", Proc. of CIPS'83, Ottawa, May 17, 1983, pp. 130-136.
• 15: Ural, H. and R.L. Probert, "User guided test sequence generation", Proc. of 3rd IFIP/WG6.1 Int. Workshop on Protocol Specification, Testing, and Verification, Zurich, May 1983, pp. 421-436.
• 16: Zimmermann, H., "OSI Reference Model-The ISO model of Architecture for OSI", IEEE Trans. on Comm., Vol, 28, No. 4, 1980.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols
          Subjects: Protocol architecture (OSI model)

  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Validation
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

          Nouns: Prolog

General Terms:
Design, Languages, Verification