Automatic generation of test-beds for pre-deployment QoS evaluation of web services

ABSTRACT

This paper presents Puppet (Pick UP Performance Evaluation Test-bed), an approach for the automatic generation of test-beds to empirically evaluate different QoS features of a Web Service under development. Specifically, the generation exploits the information about the coordinating scenario, the service description and the specification of the agreements that the roles will abide. The approach is supported by a proof-of-concept tool to validate the feasibility of the idea.

REFERENCES

• 1: G. Alonso, F. Casati, H. Kuno, and V. Machiraju. Web Services--Concepts, Architectures and Applications. Springer--Verlag, 2004.
• 2: Apache Software Foundation. Axis User's Guide. http://ws.apache.org/axis/java/user-guide.html.
• 3: A. Bertolino, A. Bonivento, G. De Angelis, and A. Sangiovanni Vincentelli. Modeling and Early Performance Estimation for Network Processor Applications. In Proc. of the 9th International Conference on Model Driven Engineering Languages and Systems (MoDELS/UML 2006). Springer--Verlag, 2006. to appear.
• 4: Antonia Bertolino , Raffaela Mirandola, Software performance engineering of component-based systems, Proceedings of the 4th international workshop on Software and performance, January 14-16, 2004, Redwood Shores, California
• 5: Giovanni Denaro , Andrea Polini , Wolfgang Emmerich, Early performance testing of distributed software applications, Proceedings of the 4th international workshop on Software and performance, January 14-16, 2004, Redwood Shores, California
• 6: Dirk Draheim , John Grundy , John Hosking , Christof Lutteroth , Gerald Weber, Realistic Load Testing ofWeb Applications, Proceedings of the Conference on Software Maintenance and Reengineering, p.57-70, March 22-24, 2006
• 7: Global Grid Forum. Web Services Agreement Specification (WS--Agreement), version 2005/09 edition, September 2005.
• 8: John Grundy , John Hosking , Lei Li , Na Liu, Performance engineering of service compositions, Proceedings of the 2006 international workshop on Service-oriented software engineering, May 27-28, 2006, Shanghai, China [doi>10.1145/1138486.1138493]
• 9: Curtis E. Hrischuk , Jerome A. Rolia , C. Murray Woodside, Automatic Generation of a Software Performance Model Using an Object-Oriented Prototype, Proceedings of the 3rd International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, p.399-409, January 10-18, 1995
• 10: Y. Liu and I. Gorton. Accuracy of Performance Prediction for EJB Applications: A Statistical Analysis. In Proc. of Software Engineering and Middleware (SEM 2004), volume LNCS 3437, pages 185--198. Springer, 2004.
• 11: H. Ludwig. WS-Agreement Concepts and Use -- Agreement-Based Service-Oriented Architectures. Technical report, IBM, May 2006.
• 12: Heiko Ludwig , Asit Dan , Robert Kearney, Crona: an architecture and library for creation and monitoring of WS-agreents, Proceedings of the 2nd international conference on Service oriented computing, November 15-19, 2004, New York, NY, USA [doi>10.1145/1035167.1035178]
• 13: C. U. Smith and L. Williams. Performance Solutions: A practical Guide To Creating Responsive, Scalable Software. Addison--Wesley, 2001.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

General Terms:
Design, Performance, Verification

Keywords:
WS-agreement, empirical QoS evaluation, web services