Model-based functional conformance testing of web services operating on persistent data

ABSTRACT

We propose a model based approach to functional conformance test generation for web services which operate in the presence of persistent data. Typically, web services are described in a standard notation called Web Services Description Language (WSDL). Unfortunately, WSDL standard does not allow behavioral specification (such as pre- and postconditions)of web services in the presence of persistent data. New standards which remedy this situation are being proposed (such as WSDL-S). In this paper, we propose the use of existing test generation techniques based on Extended Finite State Machine (EFSM) specification to address the generation of functional conformance testes for web services which operate on persistent data. The novel contribution of this paper is an algorithm which translates a WSDL-S behavioral specification of operations of a web service into an equivalent EFSM representation which can be exploited to generate an effective set of test cases.

REFERENCES

• 1: Rama Akkiraju, Joel Farrell, John Miller, Meenakshi Nagarajan, Marc-Thomas Schmidt, Amit Sheth, and Kunal Verma. Web service semantics - wsdl-s, 2005.
• 2: Paul E. Ammann , Paul E. Black , William Majurski, Using Model Checking to Generate Tests from Specifications, Proceedings of the Second IEEE International Conference on Formal Engineering Methods, p.46, December 09-11, 1998
• 3: Xiaoying Bai , Wenli Dong , Wei-Tek Tsai , Yinong Chen, WSDL-Based Automatic Test Case Generation for Web Services Testing, Proceedings of the IEEE International Workshop, p.215-220, October 20-21, 2005 [doi>10.1109/SOSE.2005.43]
• 4: A. Bertolino, L. Frantzen, A. Polini, and J. Tretmans. Audition of web services for testing conformance to open specified protocols. In Ralf Reussner, Judith Stafford, and Clemens Szyperski, editors, Architecting Systems with Trustworthy Components, number 3938 in LNCS. Springer-Verlag, 2006.
• 5: P. E. Black, V. Okum, and Y. Yesha. Mutation operators for specifications. In Proc. Second IEEE Int. Conf. on Formal Eng. Methods, pages 46--54, 1998.
• 6: Duncan Clarke , Thierry Jéron , Vlad Rusu , Elena Zinovieva, STG: A Symbolic Test Generation Tool, Proceedings of the 8th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, p.470-475, April 08-12, 2002
• 7: Jeremy Dick , Alain Faivre, Automating the Generation and Sequencing of Test Cases from Model-Based Specifications, Proceedings of the First International Symposium of Formal Methods Europe on Industrial-Strength Formal Methods, p.268-284, April 19-23, 1993
• 8: G. Friedman , A. Hartman , K. Nagin , T. Shiran, Projected state machine coverage for software testing, Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis, July 22-24, 2002, Roma, Italy
• 9: Peter Fröhlich , Johannes Link, Automated Test Case Generation from Dynamic Models, Proceedings of the 14th European Conference on Object-Oriented Programming, p.472-492, June 12-16, 2000
• 10: Wolfgang Grieskamp , Yuri Gurevich , Wolfram Schulte , Margus Veanes, Generating finite state machines from abstract state machines, Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis, July 22-24, 2002, Roma, Italy
• 11: R. Heckel and M. Lohmann. Towards contract-based testing of web services, 2004.
• 12: Reiko Heckel and Leonardo Mariani. Automatic conformance testing of web services.
• 13: R. Hierons. Testing from a z specifications. J. Soft. Testing, Verification, and Reliability, 7(1):19--33, 1997.
• 14: Adele E. Howe , Anneliese von Mayrhauser , Richard T. Mraz, Test Case Generation as an AI Planning Problem, Automated Software Engineering, v.4 n.1, p.77-106, January 1997 [doi>10.1023/A:1008607721339]
• 15: Bruno Legeard , Fabien Peureux, Generation of Functional Test Sequences from B Formal Specifications-Presentation and Industrial Case Study, Proceedings of the 16th IEEE international conference on Automated software engineering, p.377, November 26-29, 2001
• 16: Bruno Legeard , Fabien Peureux , Mark Utting, A Comparison of the BTT and TTF Test-Generation Methods, Proceedings of the 2nd International Conference of B and Z Users on Formal Specification and Development in Z and B, p.309-329, January 23-25, 2002
• 17: Atif M. Memon , Martha E. Pollack , Mary Lou Soffa, Using a goal-driven approach to generate test cases for GUIs, Proceedings of the 21st international conference on Software engineering, p.257-266, May 16-22, 1999, Los Angeles, California, United States [doi>10.1145/302405.302632]
• 18: Leesa Murray , David A. Carrington , Ian MacColl , Jason McDonald , Paul A. Strooper, Formal Derivation of Finite State Machines for Class Testing, Proceedings of the 11th International Conference of Z Users on The Z Formal Specification Notation, p.42-59, September 24-26, 1998
• 19: J. Offutt, S. Liu, A. Abdurazik, and P. Ammann. Generating test data from state-based specifications. J. Software Testing, Verification and Reliability, 13:25--53, 2003.
• 20: Amit Paradkar, Plannable Test Selection Criteria for FSMs Extracted From Operational Specifications, Proceedings of the 15th International Symposium on Software Reliability Engineering (ISSRE'04), p.173-184, November 02-05, 2004 [doi>10.1109/ISSRE.2004.28]
• 21: A. M. Paradkar. Towards model-based generation of self-priming and self-checking conformance tests for interactive systems. Journal of Information and Software Technology, 46(5):315--322, May 2004.
• 22: A. Pretschner, O. Slotosch, H. Lötzbeyer, E. Aiglstorfer, and S. Kriebel. Model based testing for real: the inhouse card case-study. In Proc. Int. Workshop on Formal Methods for Industrial Critical Systems, pages 79--94, 2001.
• 23: Kuo-Chung Tai, Theory of Fault-Based Predicate Testing for Computer Programs, IEEE Transactions on Software Engineering, v.22 n.8, p.552-562, August 1996 [doi>10.1109/32.536956]
• 24: Wei-Tek Tsai , Yinong Chen , Raymond Paul , Hai Huang , Xinyu Zhou , Xiao Wei, Adaptive Testing, Oracle Generation, and Test Case Ranking for Web Services, Proceedings of the 29th Annual International Computer Software and Applications Conference (COMPSAC'05) Volume 1, p.101-106, July 26-28, 2005

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
      H.3.5 On-line Information Services

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Systems analysis and design

General Terms:
Design, Performance, Reliability