Automatic TCP buffer tuning

ABSTRACT

With the growth of high performance networking, a single host may have simultaneous connections that vary in bandwidth by as many as six orders of magnitude. We identify requirements for an automatically-tuning TCP to achieve maximum throughput across all connections simultaneously within the resource limits of the sender. Our auto-tuning TCP implementation makes use of several existing technologies and adds dynamically adjusting socket buffers to achieve maximum transfer rates on each connection without manual configuration.Our implementation involved slight modifications to a BSD-based socket interface and TCP stack. With these modifications, we achieved drastic improvements in performance over large bandwidth delay paths compared to the default system configuration, and significant reductions in memory usage compared to hand-tuned connections, allowing servers to support at least twice as many simultaneous connections.

REFERENCES

• Cra92: Nettest, 1992. Network performance analysis tool~ Cray Research Inco
• FF96: Kevin Fall , Sally Floyd, Simulation-based comparisons of Tahoe, Reno and SACK TCP, ACM SIGCOMM Computer Communication Review, v.26 n.3, p.5-21, July 1996 [doi>10.1145/235160.235162]
• Jac88: V. Jacobson, Congestion avoidance and control, Symposium proceedings on Communications architectures and protocols, p.314-329, August 16-18, 1988, Stanford, California, United States
• Mah96: Jamshid Mahdavi. Enabling high performance data transfers on hosts~ (notes for users and system administrators), November 1996~ Obtain via: http://www.psc.edu/networking/perf_tune.html.
• MBKQ96: Marshall Kirk McKusick , Keith Bostic , Michael J. Karels , John S. Quarterman, The design and implementation of the 4.4BSD operating system, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 1996
• Min97: March 1997. Private conversation between Greg Minshall and the authors.
• MM96: Matthew Mathis , Jamshid Mahdavi, Forward acknowledgement: refining TCP congestion control, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.281-291, August 28-30, 1996, Palo Alto, California, United States
• MSMO97: Matthew Mathis , Jeffrey Semke , Jamshid Mahdavi, The macroscopic behavior of the TCP congestion avoidance algorithm, ACM SIGCOMM Computer Communication Review, v.27 n.3, p.67-82, July 1997 [doi>10.1145/263932.264023]
• MSZ96: Qingming Ma , Peter Steenkiste , Hui Zhang, Routing high-bandwidth traffic in max-min fair share networks, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.206-217, August 28-30, 1996, Palo Alto, California, United States
• MTW98: Gregory J~ Miller, Kevin Thompson, and Rick Wilder~ Performance measurement on the vBNS~ In Interop'98 Engineering Conference, 1998.
• Net96: NetBSD 1.2 operating system, 1996. Based upon 4.4BSD Lite, it is the result of a collective volunteer effort. See http://www.netbsd.org~
• RFC793: J. Postel~ Transmission control protocol, Request for Comments 793, September 1981.
• RFC1191: Jeffrey Mogul and Steve Deering. Path MTU discovery, Request for Comments 1191, October 1991.
• RFC1323: Van Jacobson, Robert Braden, and Dave Borman. TCP extensions for high performance, Request for Comments 1323, May 1992.
• RFC2001: W. Richard Stevens. TCP slow start, congestion avoidance, fast retransmit, and fast recovery algorithms, Request for Comments 2001, March 1996.
• RFC2018: Matthew Mathis, J amshid Mahdavi, Sally Floyd, and Allyn Romanow. TCP Selective Acknowledgement options, Request for Comments 2018, October 1996.
• SAC98: Experimental TCP selective acknowledgment implementations, 1998. Obtain via: http://www.psc.edu/networking/tcp.html.
• Ste94: W. Richard Stevens. TCP//IP Illustrated, volume 1. Addison-Wesley, Reading MA, 1994.
• VS94: Curtis Villamizar , Cheng Song, High performance TCP in ANSNET, ACM SIGCOMM Computer Communication Review, v.24 n.5, p.45-60, Oct. 1994 [doi>10.1145/205511.205520]
• Wel96: Von Welch~ A user's guide to TCP windows, 1996. Obtain via: http://www.ncsa.uiuc.edu/People/vwelch/net_perf/tcp-windows.html.
• WS95: Gary R. Wright and W. Richard Stevens. TCP//IP Illustrated, volume 2. Addison-Wesley, Reading MA, 1995.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols

          Nouns: TCP/IP

General Terms:
Performance