Towards adaptive, scalable, and reliable resource provisioning for wsrf-compliant applications

ABSTRACT

Although WSRF (Web Services Resource Framework) and Java-based hosting environment have been successful in dealing with the heterogeneity of resources and the diversity of applications, the current Grid middleware has several limitations to support on-demand resource provisioning effectively.

This paper proposes DynaGrid, a new framework for WSRF-compliant applications. Many new components, such as Service Door, Dynamic Service Launcher (DSL), Client Proxy, and Partition Manager, have been introduced to offer adaptive, scalable, and reliable resource provisioning. All of these components are implemented as standard WSRF-compliant Web services, hence DynaGrid is complementary to the existing Grid middleware. The experimental evaluations are performed on a real test bed with practical applications including the Map Reduce application. The results indicate that DynaGrid effectively utilizes Grid resources by allocating only the required number of resources adaptively according to the amount of incoming requests, providing both the scalability and the reliability at the same time.

REFERENCES

• 1: Apache Nutch Project. http://nutch.apache.org/nutch.
• 2: OASIS Web Services Resource Framework (WSRF) TC. http://www.oasis-open.org/committees/wsrf/.
• 3: Jeffrey Dean , Sanjay Ghemawat, MapReduce: simplified data processing on large clusters, Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, p.10-10, December 06-08, 2004, San Francisco, CA
• 4: I. Foster. Globus Toolkit Version 4: Software for Service-Oriented Systems. Lecture Notes in Computer Science, 3779:2--13, 2005.
• 5: I. Foster, C. Kesselman, J. Nick, and S. Tuecke. The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, 2002. http://www.globus.org/research/papers/ogsa.pdf.
• 6: Ian T. Foster, The Anatomy of the Grid: Enabling Scalable Virtual Organizations, Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing, p.1-4, August 28-31, 2001
• 7: L. Qi, H. Jin, I. Foster, and J. Gawor. HAND: Highly Available Dynamic Deployment Infrastructure for Globus Toolkit 4. http://www.globus.org/alliance/publications/papers/HANDSubmitted. pdf, 2006.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

General Terms:
Design, Management, Reliability

Keywords:
Globus Toolkit, WSRF, fault tolerant, grid computing, scalability