An evaluation of TCP splice benefits in web proxy servers

ABSTRACT

This study is the first to evaluate the performance benefits of using the recently proposed TCP Splice kernel service in Web proxy servers. Previous studies show that splicing client and server TCP connections in the IP layer improves the throughput of proxy servers like firewalls and content routers by reducing the data transfer overheads. In a Web proxy server, data transfer overheads represent a relatively large fraction of the request processing overheads, in particular when content is not cacheable or the proxy cache is memory-based. The study is conducted with a socket-level implementation of TCP Splice. Compared to IP-level implementations, socket-level implementations make possible the splicing of connections with different TCP characteristics, and improve response times by reducing recovery delay after a packet loss. The experimental evaluation is focused on HTTP request types for which the proxy can fully exploit the TCP Splice service, which are the requests for non-cacheabl.content and SSL tunneling. The experimental testbed includes an emulated WAN environment and benchmark applications for HTTP/1.0 Web client, Web server, and Web proxy running on AIX RS/6000 machines. Our experiments demonstrate that TCP Splice enables reductions in CPU utilization of 10-43% of the CPU, depending on file sizes and request rates. Larger relative reductions are observed when tunneling SSL connections, in particular for small file transfers. Response times are also reduced by up to 1.8sec.

REFERENCES

• 1: Hari Balakrishnan , Srinivasan Seshan , Elan Amir , Randy H. Katz, Improving TCI/IP performance over wireless networks, Proceedings of the 1st annual international conference on Mobile computing and networking, p.2-11, November 13-15, 1995, Berkeley, California, United States [doi>10.1145/215530.215544]
• 2: Hari Balakrishnan , Venkata N. Padmanabhan , Srinivasan Seshan , Randy H. Katz, A comparison of mechanisms for improving TCP performance over wireless links, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.256-269, August 28-30, 1996, Palo Alto, California, United States
• 3: Gaurav Banga , Peter Druschel, Measuring the capacity of a Web server under realistic loads, World Wide Web, v.2 n.1-2, p.69-83, 1999 [doi>10.1023/A:1019292504731]
• 4: P. Cao, S. Irani Cost-Aware WWW Proxy Caching Algorithms USENIX Symposium on Internet Technologies and Systems, 1997
• 5: J. Chase, A. Gallatin, K. Yocum End-System Optimizations for High-Speed TCP IEEE Communications, 39(4), Apr. 2001
• 6: A. Cohen, S. Rangarajan, H. Slye On the Performance of TCP Splicing for URL-aware Redirection USENIX Symposium on Internet Technologies and Systems, 1999
• 7: A. Feldmann, R. Caceres, F. Douglis, G. Glass, M. Rabinovich Performance of Web Proxy Caching in Heterogeneous Bandwidth Environments IEEE INFOCOM, 1999
• 8: Guerney D. H. Hunt , Germán S. Goldszmidt , Richard P. King , Rajat Mukherjee, Network dispatcher: a connection router for scalable Internet services, Proceedings of the seventh international conference on World Wide Web 7, p.347-357, April 1998, Brisbane, Australia
• 9: Arun Iyengar , Jim Challenger , Daniel Dias , Paul Dantzig, High-Performance Web Site Design Techniques, IEEE Internet Computing, v.4 n.2, p.17-26, March 2000 [doi>10.1109/4236.832942]
• 10: Shudong Jin , Azer Bestavros, Popularity-Aware Greedy Dual-Size Web Proxy Caching Algorithms, Proceedings of the The 20th International Conference on Distributed Computing Systems ( ICDCS 2000), p.254, April 10-13, 2000
• 11: Jian Yin , Lorenzo Alvisi , Mike Dahlin , Arun Iyengar, Engineering server-driven consistency for large scale dynamic Web services, Proceedings of the 10th international conference on World Wide Web, p.45-57, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.371935]
• 12: C. Liu , P. Cao, Maintaining Strong Cache Consistency in the World-Wide Web, Proceedings of the 17th International Conference on Distributed Computing Systems (ICDCS '97), p.12, May 27-30, 1997
• 13: D. Maltz, P. Bhagwat MSOCKS: An Architecture for Transport Layer Mobility INFOCOM, 1998
• 14: D. Maltz, P. Bhagwat TCP Splicing for Application Layer Proxy Performance IBM Research Report RC 21139, Mar. 1998
• 15: D. Maltz, P. Bhagwat Improving HTTP Caching Proxy Performance with TCP Tap IBM Research Report RC 21147, Mar. 1998
• 16: D. Menasce, V. Almeida Scaling for e-Business Prentice Hall, 2000
• 17: Merkatos.Katevenis.Pnevmatikatos.Flouris E. Markatos, M. Katevenis, D. Pnevmatikatos, M. Flouris Secondary Storage Management for Web Proxies USENIX Symposium on Internet Technologies and Systems (USITS), 1999
• 18: Erich M. Nahum , Marcel-Catalin Rosu , Srinivasan Seshan , Jussara Almeida, The effects of wide-area conditions on WWW server performance, Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.257-267, June 2001, Cambridge, Massachusetts, United States
• 19: National Institute of Standards and Technology NIST Net Home Page http://snad.ncsl.nist.gov/itg/nistnet
• 20: IBM Corporation IBM Netfinity Web Server Accelerator V2.0 http://www.pc.ibm.com/us/solutions/netfinity/server_accelerator.html
• 21: Vivek S. Pai , Peter Druschel , Willy Zwaenepoel, IO-lite: a unified I/O buffering and caching system, Proceedings of the third symposium on Operating systems design and implementation, p.15-28, February 1999, New Orleans, Louisiana, United States
• 22: Vern Paxson, End-to-end internet packet dynamics, IEEE/ACM Transactions on Networking (TON), v.7 n.3, p.277-292, June 1999 [doi>10.1109/90.779192]
• 23: Web Polygraph Workloads http://www.web-polygraph.org/docs/workloads
• 24: Web Polygraph The Third Cache-Off, Oct. 2000 http://www.measurement-factory.com/results/public/cacheoff/N03/
• 25: T.Dierks, C. Allen The TLS Protocol, Version 1.0 IETF, Network Working Group, RFC 2246
• 26: Dan Rubenstein , Jim Kurose , Don Towsley, Detecting shared congestion of flows via end-to-end measurement, Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.145-155, June 18-21, 2000, Santa Clara, California, United States
• 27: Oliver Spatscheck , Jørgen S. Hansen , John H. Hartman , Larry L. Peterson, Optimizing TCP forwarder performance, IEEE/ACM Transactions on Networking (TON), v.8 n.2, p.146-157, April 2000 [doi>10.1109/90.842138]
• 28: Craig E. Wills , Mikhail Mikhailov , Hao Shang, N for the price of 1: bundling web objects for more efficient content delivery, Proceedings of the 10th international conference on World Wide Web, p.257-265, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372061]

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.4 Communications Management

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.8 Performance
          Subjects: Measurements

General Terms:
Measurement, Performance

Keywords:
TCP splice, web proxy