Scalable dht-based information service for large-scale grids

ABSTRACT

Current grid information service is centralized or hierarchical and proves inefficient as grid scale rapidly increases. The introduction of P2P techniques into grids breaks an encouraging path. However, frequent join and departure of resource nodes require strong self-organization capacity of system to maintain their rigid structure. Moreover, arranging identifier space for P2P nodes is knotty and has great impact on system performance. If the identifier space is too large, some nodes will be overloaded. On the contrary, small identifier space will bring the same problem as millennium bug. To address the issues, this paper proposes a scalable DHT-based (Distributed Hash Table) Information Service (DIS) for grid system, which organizes grid resources into a DHT ring based on VO (Virtual Organization). To save the identifier space while retaining the scalability and system performance, only stable VOs can join DIS via a new DHT node, whereas volatile VOs join DIS through being the sub-domain of other VO. Experimental results show that DIS provides rapid resource query, strong scalability and high throughput, meanwhile avoiding the key node failure as well as the bottleneck problem.

REFERENCES

• 1: Ian Foster , Carl Kesselman, The grid: blueprint for a new computing infrastructure, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 2: Steven Fitzgerald, Grid Information Services for Distributed Resource Sharing, Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, p.181, August 07-09, 2001
• 3: Foster, I. and Iamnitchi, A. On death, taxes, and the convergence of peer-to-peer and grid computing. In Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS'03), 2003, pp.118--128.
• 4: Domenico Talia , Paolo Trunfio, Toward a Synergy Between P2P and Grids, IEEE Internet Computing, v.7 n.4, p.96-95, July 2003 [doi>10.1109/MIC.2003.1215667]
• 5: Iamnitchi, A., Foster, I. and Nurmi, D. A peer-to-peer approach to resource discovery in grid environments. Technical Report TR-2002--06, University of Chicago, 2002.
• 6: Cai, M., Frank, M., Chen, J. and Szekely, P. MAAN: A multi-attribute addressable network for grid information services. Journal of Grid Computing, 2(1):3--14, 2004.
• 7: Oppenheimer, D., Albrecht, J., Patterson, D. and Vahdat, A. Scalable wide-area resource discovery. UC Berkeley Technical Report, UCB/CSD-04--1334, July 2004.
• 8: Sujoy Basu , Sujata Banerjee , Puneet Sharma , Sung-Ju Lee, NodeWiz: peer-to-peer resource discovery for grids, Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 1, p.213-220, May 09-12, 2005
• 9: Ion Stoica , Robert Morris , David Liben-Nowell , David R. Karger , M. Frans Kaashoek , Frank Dabek , Hari Balakrishnan, Chord: a scalable peer-to-peer lookup protocol for internet applications, IEEE/ACM Transactions on Networking (TON), v.11 n.1, p.17-32, February 2003 [doi>10.1109/TNET.2002.808407]
• 10: UDDI V3.0.2 specification. http://uddi.org/pubs/uddi_v3.htm
• 11: Globus MDS. http://www.globus.org/toolkit/docs/4.0/info/
• 12: Gnutella Protocol Development. http://rfc-gnutella.sourceforge.net/src/rfc-0_6-draft.html
• 13: Sylvia Ratnasamy , Paul Francis , Mark Handley , Richard Karp , Scott Schenker, A scalable content-addressable network, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.161-172, August 2001, San Diego, California, United States
• 14: Antony I. T. Rowstron , Peter Druschel, Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems, Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg, p.329-350, November 12-16, 2001
• 15: Sean Rhea , Dennis Geels , Timothy Roscoe , John Kubiatowicz, Handling churn in a DHT, Proceedings of the annual conference on USENIX Annual Technical Conference, p.10-10, June 27-July 02, 2004, Boston, MA
• 16: Artur Andrzejak , Zhichen Xu, Scalable, Efficient Range Queries for Grid Information Services, Proceedings of the Second International Conference on Peer-to-Peer Computing, p.33, September 05-07, 2002
• 17: David Spence , Tim Harris, XenoSearch: Distributed Resource Discovery in the XenoServer Open Platform, Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing, p.216, June 22-24, 2003
• 18: FIPS 180--1. Secure Hash Standard. U.S. Departure of Commerce/NIST, National Technical Information Service, Springfield, VA, Apr.1995.
• 19: El-Ansary, S., Alima, L. O., Brand, P. and Haridi, S. Efficient broadcast in structured P2P networks. In Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS'03), 2003, pp.304--314.
• 20: Jin, H. ChinaGrid: making grid computing a reality. Digital Libraries: International Collaboration and Cross-Fertilization - Lecture Notes in Computer Science, Vol.3334, Springer-Verlag, Dec. 2004, pp.13--24.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

General Terms:
Design, Experimentation, Standardization

Keywords:
dht, grid computing, information service, p2p