Data flow testing of service-oriented workflow applications

ABSTRACT

WS-BPEL applications are a kind of service-oriented application. They use XPath extensively to integrate loosely-coupled workflow steps. However, XPath may extract wrong data from the XML messages received, resulting in erroneous results in the integrated process. Surprisingly, although XPath plays a key role in workflow integration, inadequate researches have been conducted to address the important issues in software testing. This paper tackles the problem. It also demonstrates a novel transformation strategy to construct artifacts. We use the mathematical definitions of XPath constructs as rewriting rules, and propose a data structure called XPath Rewriting Graph (XRG), which not only models how an XPath is conceptually rewritten but also tracks individual rewritings progressively. We treat the mathematical variables in the applied rewriting rules as if they were program variables, and use them to analyze how information may be rewritten in an XPath conceptually. We thus develop an algorithm to construct XRGs and a novel family of data flow testing criteria to test WS-BPEL applications. Experiment results show that our testing approach is promising.

REFERENCES

• 1: C. Barreto et al., Eds. Web Services Business Process Execution Language Version 2.0: Primer. OASIS, 2007. Available at http://docs.oasis-open.org/wsBPEL/2.0/wsBPEL-v2.0.html.
• 2: B. Benatallah, R.M. Dijkman, M. Dumas, and Z. Maamar. Service composition: concepts, techniques, tools and trends. In Service-Oriented Software Engineering: Challenges and Practices, pages 48--66. Idea Group Publishing, 2005.
• 3: A. Berglund et al., Eds. XML Path Language (XPath) 2.0: W3C Recommendation. World Wide Web Consortium, 2007. Available at http://www.w3c.org/TR/xpath20/.
• 4: BPWS4J: a Platform for Creating and Executing BPEL4WS Processes, Version 2.1. IBM, 2004. Available at http://www.alphaworks.ibm.com/tech/bpws4j.
• 5: Manfred Broy , Ingolf H. Krüger , Michael Meisinger, A formal model of services, ACM Transactions on Software Engineering and Methodology (TOSEM), v.16 n.1, p.5-es, February 2007 [doi>10.1145/1189748.1189753]
• 6: Huo Yan Chen , T. H. Tse , F. T. Chan , T. Y. Chen, In black and white: an integrated approach to class-level testing of object-oriented programs, ACM Transactions on Software Engineering and Methodology (TOSEM), v.7 n.3, p.250-295, July 1998 [doi>10.1145/287000.287004]
• 7: H. Foster, S. Uchitel, J. Magee, and J. Kramer. Model-based verification of web service compositions. In Proceedings of ASE 2003, pages 152--161. 2003.
• 8: P. G. Frankl , E. J. Weyuker, An Applicable Family of Data Flow Testing Criteria, IEEE Transactions on Software Engineering, v.14 n.10, p.1483-1498, October 1988 [doi>10.1109/32.6194]
• 9: Phyllis G. Frankl , Oleg Iakounenko, Further empirical studies of test effectiveness, Proceedings of the 6th ACM SIGSOFT international symposium on Foundations of software engineering, p.153-162, November 01-05, 1998, Lake Buena Vista, Florida, United States
• 10: Xiang Fu , Tevfik Bultan , Jianwen Su, Analysis of interacting BPEL web services, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988756]
• 11: Xiang Fu , Tevfik Bultan , Jianwen Su, Model checking XML manipulating software, Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis, July 11-14, 2004, Boston, Massachusetts, USA
• 12: J. García-Fanjul, J. Tuya, and C. de la Riva. Generating test cases specifications for BPEL compositions of web services using SPIN. In Proceedings of WS-MaTe 2006, pages 83--94. 2006.
• 13: Georg Gottlob , Christoph Koch , Reinhard Pichler , Luc Segoufin, The complexity of XPath query evaluation and XML typing, Journal of the ACM (JACM), v.52 n.2, p.284-335, March 2005 [doi>10.1145/1059513.1059520]
• 14: D. Gries , J. L. van de Snepscheut, Inorder traversal of a binary tree and its inversion, Formal development programs and proofs, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 15: Monica Hutchins , Herb Foster , Tarak Goradia , Thomas Ostrand, Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria, Proceedings of the 16th international conference on Software engineering, p.191-200, May 16-21, 1994, Sorrento, Italy
• 16: C. Innocenti. SOA and the importance of XQuery. SOA Magazine Issue X, September 2007.
• 17: Gregory M. Kapfhammer , Mary Lou Soffa, A family of test adequacy criteria for database-driven applications, Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering, September 01-05, 2003, Helsinki, Finland
• 18: Zhongjie Li , Wei Sun , Zhong Bo Jiang , Xin Zhang, BPEL4WS Unit Testing: Framework and Implementation, Proceedings of the IEEE International Conference on Web Services, p.103-110, July 11-15, 2005 [doi>10.1109/ICWS.2005.31]
• 19: Heng Lu , W.K. Chan , T.H. Tse, Testing pervasive software in the presence of context inconsistency resolution services, Proceedings of the 30th international conference on Software engineering, May 10-18, 2008, Leipzig, Germany [doi>10.1145/1368088.1368098]
• 20: Heng Lu , W. K. Chan , T. H. Tse, Testing context-aware middleware-centric programs: a data flow approach and an RFID-based experimentation, Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering, November 05-11, 2006, Portland, Oregon, USA [doi>10.1145/1181775.1181805]
• 21: Gerome Miklau , Dan Suciu, Containment and equivalence for a fragment of XPath, Journal of the ACM (JACM), v.51 n.1, p.2-45, January 2004 [doi>10.1145/962446.962448]
• 22: Marina Mongiello , Daniela Castelluccia, Modelling and verification of BPEL business processes, Proceedings of the Fourth Workshop on Model-Based Development of Computer-Based Systems and Third International Workshop on Model-Based Methodologies for Pervasive and Embedded Software, p.144-148, March 30-30, 2006 [doi>10.1109/MBD-MOMPES.2006.22]
• 23: D. Olteanu, T. Furche, and F.Bry. Evaluating complex queries against XML streams with polynomial combined complexity. In Key Technologies for Data Management, volume 3112 of LNCS, pages 31--44. 2004.
• 24: Oracle BPEL Process Manager. Oracle Technology Network. Available at http://www.oracle.com/technology/products/ias/bpel/.
• 25: K. Schmidt and C. Stahl. A Petri net semantic for BPEL4WS: validation and application. In Proceedings of the 11th Workshop on Algorithms and Tools for Petri Nets, pages 1--6. 2004.
• 26: Amie L. Souter , Lori L. Pollock, The Construction of Contextual Def-Use Associations for Object-Oriented Systems, IEEE Transactions on Software Engineering, v.29 n.11, p.1005-1018, November 2003 [doi>10.1109/TSE.2003.1245302]
• 27: Web Services Invocation Framework: DSL Provider Sample Application. Apache Software Foundation. Available at http://svn.apache.org/viewvc/webservices/wsif/trunk/java/samples/dslprovider/README.html?view=co.
• 28: Jun Yan , Zhongjie Li , Yuan Yuan , Wei Sun , Jian Zhang, BPEL4WS Unit Testing: Test Case Generation Using a Concurrent Path Analysis Approach, Proceedings of the 17th International Symposium on Software Reliability Engineering, p.75-84, November 07-10, 2006 [doi>10.1109/ISSRE.2006.16]
• 29: Chunyang Ye , S. C. Cheung , W. K. Chan, Publishing and composition of atomicity-equivalent services for B2B collaboration, Proceedings of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China [doi>10.1145/1134285.1134335]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Product metrics

General Terms:
Measurement, Reliability, Verification

Keywords:
rewriting rules, service-orientation, soa, testing, workflow testing, ws-bpel, xml, xml document model, xpath