Web server benchmarking using parallel WAN emulation

ABSTRACT

This paper discusses the use of a parallel discrete-event network emulator called the Internet Protocol Traffic and Network Emulator (IP-TNE) for Web server benchmarking. The experiments in this paper demonstrate the feasibility of high-performance WAN emulation using parallel discrete-event simulation techniques on shared-memory multiprocessors. Our experiments with the Apache Web server achieve 3400 HTTP transactions per second for simple Web workloads, and 1000 HTTP transactions per second for realistic Web workloads, for static document retrieval across emulated WAN topologies of up to 4096 concurrent Web/TCP clients. The results show that WAN characteristics, including round-trip delays, link speeds, packet losses, packet sizes, and bandwidth asymmetry, all have significant impacts on Web server performance. WAN emulation enables stress testing and benchmarking of Web server performance in ways that may not be possible in simple LAN test scenarios.

REFERENCES

• 1: Gaurav Banga , Peter Druschel, Measuring the capacity of a Web server under realistic loads, World Wide Web, v.2 n.1-2, p.69-83, 1999 [doi>10.1023/A:1019292504731]
• 2: Paul Barford , Mark Crovella, Generating representative Web workloads for network and server performance evaluation, Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, p.151-160, June 22-26, 1998, Madison, Wisconsin, United States
• 3: Russell Bradford , Rob Simmonds , Brian Unger, Packet Reading for Network Emulation, Proceedings of the Ninth International Symposium in Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS'01), p.150, August 15-18, 2001
• 4: Mudashiru Busari , Carey Williamson, ProWGen: a synthetic workload generation tool for simulation evaluation of web proxy caches, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.38 n.6, p.779-794, 22 April 2002 [doi>10.1016/S1389-1286(01)00285-7]
• 5: Erich M. Nahum , Marcel-Catalin Rosu , Srinivasan Seshan , Jussara Almeida, The effects of wide-area conditions on WWW server performance, Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.257-267, June 2001, Cambridge, Massachusetts, United States
• 6: Rob Simmonds , Russell Bradford , Brian Unger, Applying parallel discrete event simulation to network emulation, Proceedings of the fourteenth workshop on Parallel and distributed simulation, p.15-22, May 28-31, 2000, Bologna, Italy
• 7: R. Simmonds, C. Williamson, R. Bradford, M. Arlitt, and B. Unger, "A Case Study of Web Benchmarking Using Parallel WAN Emulation", available from http://www.cpsc.ucalgary.ca/~carey/papers/iptne.pdf