GWiQ-P: an efficient decentralized grid-wide quota enforcement protocol

ABSTRACT

Mega grids span several continents and may consist of millions of nodes and billions of tasks executing at any point in time. This setup calls for scalable and highly available resource utilization control that adapts itself to dynamic changes in the grid environment as they occur. In this paper, we address the problem of enforcing upper bounds on the consumption of grid resources. We propose a grid-wide quota enforcement system, called GWiQ-P. GWiQ-P is light-weight, and in practice is infinitely scalable, satisfying concurrently any number of resource demands, all within the limits of a global quota assigned to each user. GWiQ-P adapts to dynamic changes in the grid as they occur, improving future performance by means of improved locality. This improved performance does not impair the system's ability to respond to current requests, tolerate failures, or maintain the allotted quota levels.

REFERENCES

• 1: EGEE. http://www.eu-egee.org.
• 2: TeraGrid. http://www.teragrid.org.
• 3: Condor manual version 6.6.6. https://www.cs.wisc.edu/condor.
• 4: OpenPBS. http://www.openpbs.org.
• 5: LSF. http://www.platform.com/products/lsf.
• 6: Avaki. http://www.avaki.com.
• 7: Ali Raza Butt , Rongmei Zhang , Y. Charlie Hu, A Self-Organizing Flock of Condors, Proceedings of the 2003 ACM/IEEE conference on Supercomputing, p.42, November 15-21, 2003
• 8: Galen Hunt , Doug Brubacher, Detours: binary interception of Win32 functions, Proceedings of the 3rd conference on USENIX Windows NT Symposium, p.14-14, July 12-15, 1999, Seattle, Washington
• 9: Xuxian Jiang , Dongyan Xu , R. Eigenmann, Protection mechanisms for application service hosting platforms, Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid, p.656-663, April 19-22, 2004
• 10: Takahiro Shinagawa, Kenji Kono, and Takashi Masuda. Flexible and efficient sandboxing based on fine-grained protection domains. In ISSS, pages 172--184, 2002.
• 11: Ian Goldberg , David Wagner , Randi Thomas , Eric A. Brewer, A secure environment for untrusted helper applications confining the Wily Hacker, Proceedings of the 6th conference on USENIX Security Symposium, Focusing on Applications of Cryptography, p.1-1, July 22-25, 1996, San Jose, California
• 12: Grzegorz Czajkowski , Thorsten von Eicken, JRes: A Resource Accounting Interface for Java, Cornell University, Ithaca, NY, 1998
• 13: Niranjan Suri , Jeffrey Bradshaw , Maggie R. Breedy , Paul T. Groth , Gregory A. Hill , Renia Jeffers, Strong Mobility and Fine-Grained Resource Control in NOMADS, Proceedings of the Second International Symposium on Agent Systems and Applications and Fourth International Symposium on Mobile Agents, p.2-15, September 13-15, 2000
• 14: VMWare. http://www.vmware.com.
• 15: Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 16: Qumranet Kernel based Virtual Machine (KVM). http://kvm.qumranet.com/kvmwiki.
• 17: Yitzhak Birk, Liran Liss, Assaf Schuster, and Ran Wolff. A local algorithm for ad hoc majority voting via charge fusion. In DISC, pages 275--289, 2004.
• 18: Jeffrey M. Jaffe and Franklin H. Moss. A responsive distributed routing algorithm for computer networks. IEEE Transactions on Communications, 30(7): 1758--1762, jul 1982.
• 19: K. Karmon , L. Liss , A. Schuster, GWiQ-P: an efficient decentralized grid-wide quota enforcement protocol, Proceedings of the High Performance Distributed Computing, 2005. HPDC-14. Proceedings. 14th IEEE International Symposium, p.222-232, July 24-27, 2005 [doi>10.1109/HPDC.2005.1520964]
• 20: Alberto Medina , Anukool Lakhina , Ibrahim Matta , John Byers, BRITE: An Approach to Universal Topology Generation, Proceedings of the Ninth International Symposium in Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS'01), p.346, August 15-18, 2001
• 21: L. Moreau and C. Queinnec. Distributed and multi-type resource management, 2002.
• 22: Moez A. Abdel-Gawad, Shu Du, and Khaled ElMeleegy. Decentralized past quota system.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.1 Process Management
      D.4.4 Communications Management

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software

General Terms:
Design, Management