Performance study of dispatching algorithms in multi-tier web architectures

ABSTRACT

The number and heterogeneity of requests to Web sites are increasing also because the Web technology is becoming the preferred interface for information systems. Many systems hosting current Web sites are complex architectures composed by multiple server layers with strong scalability and reliability issues. In this paper we compare the performance of several combinations of centralized and distributed dispatching algorithms working at the first and second layer, and using different levels of state information. We confirm some known results about load sharing in distributed systems and give new insights to the problem of dispatching requests in multi-tier cluster-based Web systems.

REFERENCES

• 1: Characterizing the scalability of a large web-based shopping system, ACM Transactions on Internet Technology (TOIT), v.1 n.1, p.44-69, Aug. 2001 [doi>10.1145/383034.383036]
• 2: M. F. Arlitt and T. Jin. A workload characterization study of the 1998 World Cup Web site. IEEE Network, 14(3):30-37, May/June 2000.
• 3: M. Aron, P. Druschel, and Z. Zwaenepoel. Efficient support for P-HTTP in cluster-based Web servers. In Proceedings of the 1999 USENIX Annual Technical Conference, pages 185-198, Monterey, CA, June 1999.
• 4: Eric A. Brewer, Lessons from Giant-Scale Services, IEEE Internet Computing, v.5 n.4, p.46-55, July 2001 [doi>10.1109/4236.939450]
• 5: Valeria Cardellini , Emiliano Casalicchio , Michele Colajanni , Philip S. Yu, The state of the art in locally distributed Web-server systems, ACM Computing Surveys (CSUR), v.34 n.2, p.263-311, June 2002 [doi>10.1145/508352.508355]
• 6: Emiliano Casalicchio , Michele Colajanni, A client-aware dispatching algorithm for web clusters providing multiple services, Proceedings of the 10th international conference on World Wide Web, p.535-544, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372155]
• 7: Cisco Systems Inc. http://www.cisco.com/.
• 8: A. Cohen, S. Rangarajan, and H. Slye. On the performance of TCP splicing for URL-aware redirection. In Proceedings of the 2nd USENIX Symposium on Internet Technologies and Systems, Boulder, CO, Oct. 1999.
• 9: Michele Colajanni , Philip S. Yu , Daniel M. Dias, Analysis of Task Assignment Policies in Scalable Distributed Web-Server Systems, IEEE Transactions on Parallel and Distributed Systems, v.9 n.6, p.585-600, June 1998 [doi>10.1109/71.689446]
• 10: Mark E. Crovella , Azer Bestavros, Self-similarity in World Wide Web traffic: evidence and possible causes, IEEE/ACM Transactions on Networking (TON), v.5 n.6, p.835-846, Dec. 1997 [doi>10.1109/90.650143]
• 11: Michael Dahlin, Interpreting Stale Load Information, IEEE Transactions on Parallel and Distributed Systems, v.11 n.10, p.1033-1047, October 2000 [doi>10.1109/71.888643]
• 12: Louis Degenaro , Arun Iyengar , Ilya Lipkind , Isabelle Rouvellou, A middleware system which intelligently caches query results, IFIP/ACM International Conference on Distributed systems platforms, p.24-44, April 03-07, 2000, New York, New York, United States
• 13: Derek L. Eager , Edward D. Lazowska , John Zahorjan, Adaptive load sharing in homogeneous distributed systems, IEEE Transactions on Software Engineering, v.12 n.5, p.662-675, May 1986
• 14: F5 Networks Inc. http://www.f51abs.com/.
• 15: Domenico Ferrari , Songnian Zhou, An Empirical Investigation of Load Indices for Load Balancing Applications, Proceedings of the 12th IFIP WG 7.3 International Symposium on Computer Performance Modelling, Measurement and Evaluation, p.515-528, December 07-09, 1987
• 16: Guerney D. H. Hunt , Germán S. Goldszmidt , Richard P. King , Rajat Mukherjee, Network dispatcher: a connection router for scalable Internet services, Computer Networks and ISDN Systems, v.30 n.1-7, p.347-357, April 1, 1998
• 17: Linux Virtual Server project. http://www.linuxvirtualserver.org/.
• 18: Michael Mitzenmacher, How Useful Is Old Information?, IEEE Transactions on Parallel and Distributed Systems, v.11 n.1, p.6-20, January 2000 [doi>10.1109/71.824633]
• 19: D. Mosberger and T. Jin. httperf - A tool for measuring web server performance. In Proceedings of Workshop on Internet Server Performance, Madison, Wisconsin, 1998.
• 20: Oracle. Oracle9ias web Cache. http://www.oracle.com/ip/deploy/ias/caching/index.html.
• 21: O. Othman, C. O'Ryan, and D. C. Schmidt. Strategies for CORBA middleware-based load balancing. IEEE Distributed Systems Online, 2(3), Mar. 2001.
• 22: Vivek S. Pai , Mohit Aron , Gaurov Banga , Michael Svendsen , Peter Druschel , Willy Zwaenepoel , Erich Nahum, Locality-aware request distribution in cluster-based network servers, Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, p.205-216, October 02-07, 1998, San Jose, California, United States
• 23: Resonate Inc. http://www.resonate.com/.
• 24: Chu-Sing Yang , Mon-Yen Luo, A Content Placement and Management System for Distributed Web-Server Systems, Proceedings of the The 20th International Conference on Distributed Computing Systems ( ICDCS 2000), p.691, April 10-13, 2000
• 25: Huican Zhu , Ben Smith , Tao Yang, Scheduling optimization for resource-intensive Web requests on server clusters, Proceedings of the eleventh annual ACM symposium on Parallel algorithms and architectures, p.13-22, June 27-30, 1999, Saint Malo, France [doi>10.1145/305619.305621]