Connecting client objectives with resource capabilities: an essential component for grid service managent infrastructures

ABSTRACT

In large-scale, distributed systs such as Grids, an agreent between a client and a service provider specifies service level objectives both as expressions of client requirents and as provider assurances. Ideally, these objectives are expressed in a high-level, service- or application-specific manner rather than requiring clients to detail the necessary resources. Resource providers on the other hand, expect low-level, resource specific performance criteria that are uniform across applications and can easily be interpreted and provisioned.

This paper presents a framework for Grid service managent that addresses this gap between high-level specification of client performance objectives and existing resource managent infrastructures It identifies three levels of abstraction for resource requirents that a service provider needs to manage, namely: detailed specification of raw resources, virtualization of heterogeneous resources as abstract resources, and performance objectives at an application level. The paper also identifies three key functions for managing service level agreents, namely: <i>translation</i> of resource requirents across abstraction layers, <i>arbitration</i> in allocating resources to client requests, and <i>aggregation and allocation</i> of resources from multiple lower level resource managers. One or more of these key functions may be present at each abstraction layer of a service level manager. Thus, the composition of these functions across resource abstraction layers enables modeling of a wide array of managent scenarios. We present a framework that supports these functions: it uses the service metadata and/or service performance models to map client requirents to resource capabilities, it uses business value associated with objectives in allocation decisions to arbitrate between competing requests, and it allocates resources based on previously negotiated agreents.

REFERENCES

• 1: Ian Foster , Carl Kesselman, The grid: blueprint for a new computing infrastructure, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 2: A. Andrieux, K. Czajkowski, A. Dan, K. Keahey, J. Pruyne, J. Rofrano, S. Tuecke, and M. Xu, " Web Services Agreent Specification (WS-Agreent), Version 1.1, Draft 20," in Global Grid Forum, 2004.
• 3: Heiko Ludwig , Asit Dan , Robert Kearney, Crona: an architecture and library for creation and monitoring of WS-agreents, Proceedings of the 2nd international conference on Service oriented computing, November 15-19, 2004, New York, NY, USA [doi>10.1145/1035167.1035178]
• 4: Heiko Ludwig , Alexander Keller , Asit Dan , Richard King, A Service Level Agreement Language for Dynamic Electronic Services, Proceedings of the Fourth IEEE International Workshop on Advanced Issues of E-Commerce and Web-Based Information Systems (WECWIS'02), p.25, June 26-28, 2002
• 5: "WSLA Language Specification, Version 1.0," IBM Corporation, 2003.
• 6: M. P. Papazoglou , D. Georgakopoulos, Introduction, Communications of the ACM, v.46 n.10, October 2003 [doi>10.1145/944217.944233]
• 7: M. Novaes, "Personal Communication," 2002.
• 8: Avraham Leff , James T. Rayfield , Daniel M. Dias, Service-Level Agreements and Commercial Grids, IEEE Internet Computing, v.7 n.4, p.44-50, July 2003 [doi>10.1109/MIC.2003.1215659]
• 9: "IBM Load Leveler: User's Guide," Septber 1993.
• 10: "Maui Scheduler, http://www.supercluster.org/maui/." Center for HPC Cluster Resource management and Scheduling, 2004.
• 11: PlatformComputing, "Load Sharing Facility, http://www.platform.com," 2004.
• 12: Karl Czajkowski , Ian T. Foster , Nicholas T. Karonis , Carl Kesselman , Stuart Martin , Warren Smith , Steven Tuecke, A Resource Management Architecture for Metacomputing Systems, Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing, p.62-82, March 30, 1998
• 13: A. Anjomshoaa, F. Brisard, R. L. Cook, D. K. Fellows, A. Ly, S. McGough, and D. Pulsipher, "Job Submission Description Language (JSDL) Specification v0.3," Global Grid Forum 2004.
• 14: J. J. Dongarra , Jeremy Du Croz , Sven Hammarling , I. S. Duff, A set of level 3 basic linear algebra subprograms, ACM Transactions on Mathematical Software (TOMS), v.16 n.1, p.1-17, March 1990 [doi>10.1145/77626.79170]
• 15: Antoine Petitet , Susan Blackford , Jack Dongarra , Brett Ellis , Graham Fagg , Kenneth Roche , Sathish Vadhiyar, Numerical Libraries and the Grid, International Journal of High Performance Computing Applications, v.15 n.4, p.359-374, November 2001 [doi>10.1177/109434200101500403]
• 16: Marco Vanneschi, The programming model of ASSIST, an environment for parallel and distributed portable applications, Parallel Computing, v.28 n.12, p.1709-1732, December 2002 [doi>10.1016/S0167-8191(02)00188-6]
• 17: Francine Berman , Andrew Chien , Keith Cooper , Jack Dongarra , Ian Foster , Dennis Gannon , Lennart Johnsson , Ken Kennedy , Carl Kesselman , John Mellor-Crumme , Dan Reed , Linda Torczon , Rich Wolski, The GrADS Project: Software Support for High-Level Grid Application Development, International Journal of High Performance Computing Applications, v.15 n.4, p.327-344, November 2001 [doi>10.1177/109434200101500401]
• 18: G. Edjlali, G. Agrawal, A. Sussman, J. Humphries, and J. Saltz, "Runtime and Compiler Support for Programming in Adaptive Parallel Environments," Scientiffic Programming, vol. 4, 1996.
• 19: S. B. Calo and D. Verma, "Service Level Driven Provisioning of Outsourced IT Systs," IBM T.J. Watson, Hawthrone, NY RC22501, 06/25/2002. 2002.
• 20: Catalin Dumitrescu , Ioan Raicu , Matei Ripeanu , Ian Foster, DiPerF: An Automated DIstributed PERformance Testing Framework, Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04), p.289-296, November 08-08, 2004 [doi>10.1109/GRID.2004.21]
• 21: R. Raman , M. Livny , M. Solomon, Matchmaking: Distributed Resource Management for High Throughput Computing, Proceedings of the The Seventh IEEE International Symposium on High Performance Distributed Computing, p.140, July 28-31, 1998
• 22: Chuang Liu , Lingyun Yang , Ian Foster , Dave Angulo, Design and Evaluation of a Resource Selection Framework for Grid Applications, Proceedings of the 11 th IEEE International Symposium on High Performance Distributed Computing HPDC-11 20002 (HPDC'02), p.63, July 24-26, 2002
• 23: M. Litzkow, M. Livny, and M. Mutka, "Condor - A Hunter of Idle Workstations," in Proc. 8th Intl Conf. on Distributed Computing Systs, 1988, pp. 104--111.
• 24: R. Henderson and D. Tweten, "Portable Batch Syst: External Reference Specification," 1996.
• 25: David E. Irwin , Laura E. Grit , Jeffrey S. Chase, Balancing Risk and Reward in a Market-Based Task Service, Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing (HPDC'04), p.160-169, June 04-06, 2004 [doi>10.1109/HPDC.2004.5]
• 26: M. Balazinska, H. Balakrishnan, and M. Stonebraker, "Contract-Based Load management in Federated Distributed Systs," presented at NSDI'04, San Francisco, CA, 2004.
• 27: J. Aman , C. K. Eilert , D. Emmes , P. Yocom , D. Dillenberger, Adaptive algorithms for managing a distributed data processing workload, IBM Systems Journal, v.36 n.2, p.242-283, 1997
• 28: A. Dan , D. Davis , R. Kearney , A. Keller , R. King , D. Kuebler , H. Ludwig , M. Polan , M. Spreitzer , A. Youssef, Web services on demand: WSLA-driven automated management, IBM Systems Journal, v.43 n.1, p.136-158, January 2004
• 29: I. Foster, C. Kesselman, C. Lee, R. Lindell, K. Nahrstedt, and A. Roy, "A Distributed Resource management Architecture that Supports Advance Reservations and Co-Allocation," presented at Proc. International Workshop on Quality of Service, 1999.
• 30: C. H. Crawford , A. Dan, eModel: Addressing the Need for a Flexible Modeling Framework in Autonomic Computing, Proceedings of the 10th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS'02), p.203, October 11-16, 2002
• 31: Gabrielle Allen , Tom Goodale , Gerd Lanfermann , Thomas Radke , Edward Seidel , Werner Benger , Hans-Christian Hege , Andre Merzky , Joan Massó , John Shalf, Solving Einstein's Equations on Supercomputers, Computer, v.32 n.12, p.52-58, December 1999 [doi>10.1109/2.809251]
• 32: W. Benger, I. Foster, J. Novotny, E. Seidel, J. Shalf, W. Smith, and P. Walker, "Numerical Relativity in a Distributed Environment," presented at Proc. 9th SIAM Conference on Parallel Processing for Scientific Computing, 1999.
• 33: Gabrielle Allen , Thomas Dramlitsch , Ian Foster , Nicholas T. Karonis , Matei Ripeanu , Edward Seidel , Brian Toonen, Supporting efficient execution in heterogeneous distributed computing environments with cactus and globus, Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), p.52-52, November 10-16, 2001, Denver, Colorado [doi>10.1145/582034.582086]
• 34: Matei Ripeanu , Adriana Iamnitchi , Ian T. Foster, Cactus Application: Performance Predictions in Grid Environments, Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing, p.807-816, August 28-31, 2001
• 35: S. Tuecke, K. Czajkowski, I. Foster, J. Frey, S. Graham, C. Kesselman, T. Maquire, T. Standholm, D. Snelling, and P. Vanderbilt, "Open Grid Services Infrastructure (OGSI) version 1.0," presented at Global Grid Forum, 2003.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.4 System Management

General Terms:
Design, Management, Performance

Keywords:
grid computing, management of service-level agreents, resource managements, service oriented computing