High performance TCP in ANSNET

ABSTRACT

This report concentrates on specific requirements and goals of the research networks supported by ANSNET, but applies to any TCP dominated high speed WAN and in particular those striving to support high speed end-to-end flows. Measurements have been made under conditions intended to better understand performance barriers imposed by network equipment queueing capacities and queue drop strategies.The IBM RS/6000 based routers currently supporting ANSNET performed very well in these tests. Measurements have been made with the current software and performance enhanced software. Single TCP flows are able to achieve 40 Mb/s and competing multiple TCP flows achieve over 41 Mb/s link utilization on 44.7 Mb/s DS3 links with delays comparable to US cross continent ANSNET delays. Congestion collapse is demonstrated with intentionally reduced queueing capacity and using window sizes much larger than optimal.A variation of Floyd and Jacobson's Random Early Detection (RED) algorithm [1] is tested. Performance improved with the use of RED for tests involving multiple flows. With RED and queueing capacity at or above the delay bandwidth product, congestion collapse is avoided, allowing the maximum window size to safely be set arbitrarily high.Queueing capacity greater than or equal to the delay bandwidth product and RED are recommended. RED provides performance improvement in all but the single flow case, but cannot substitute for adequate queueing capacity, particularly if high speed flows are to be supported.

REFERENCES

• 1: Sally Floyd , Van Jacobson, Random early detection gateways for congestion avoidance, IEEE/ACM Transactions on Networking (TON), v.1 n.4, p.397-413, Aug. 1993 [doi>10.1109/90.251892]
• 2: [2] G. T. Almes, "Engineering trans-oceanic 44 mb/s tcp/ip networks." presented at the Third Symposium on High Speed Networking for Research in Europe, Brussels, Feb 1994.
• 3: [3] K. C. Claffy, H.-W. Braun, and G. C. Polyzos, "Long-term traffic aspects of the NSFNET," in Proceedings of the International Networking Conference INET), (San Francisco, California), pp. CBA.-1- CBA-12, Internet Society, Aug. 1993.
• 4: [4] ANS Network Operations Center, "Ansnet link utilization daily reports." unpublished reports used for capacity planning, Oct 1994.
• 5: [5] ANS Network Operations Center, "Ansnet congestion loss daily reports." unpublished reports used for capacity planning, Oct 1994.
• 6: John Nagle, Congestion control in IP/TCP internetworks, ACM SIGCOMM Computer Communication Review, v.14 n.4, p.11-17, October 1984 [doi>10.1145/1024908.1024910]
• 7: V. Jacobson, Congestion avoidance and control, Symposium proceedings on Communications architectures and protocols, p.314-329, August 16-18, 1988, Stanford, California, United States
• 8: [8] J. Postel, "Transmission control protocol," Network Working Group Request for Comments RFC 793, Information Sciences Institute, University of Southern California, Sept. 1981.
• 9: D. D. Clark, Window and Acknowledgement Strategy in TCP, RFC Editor, 1982
• 10: J. Nagle, Congestion control in IP/TCP internetworks, RFC Editor, 1984
• 11: J. Postel, TCP maximum segment size and related topics, RFC Editor, 1983
• 12: D. L. Mills, Internet delay experiments, RFC Editor, 1983
• 13: R. Braden, Requirements for Internet Hosts - Communication Layers, RFC Editor, 1989
• 14: S. O'Malley , L. L. Peterson, TCP Extensions Considered Harmful, RFC Editor, 1991
• 15: V. Jacobson , R. T. Braden, TCP extensions for long-delay paths, RFC Editor, 1988
• 16: R. Fox, TCP big window and NAK options, RFC Editor, 1989
• 17: A. M. McKenzie, Problem with the TCP big window option, RFC Editor, 1989
• 18: V. Jacobson , R. T. Braden , L. Zhang, TCP Extension for High-Speed Paths, RFC Editor, 1990
• 19: [19] D. Borman, R. Braden, and V. Jacobson, "TCP extensions for high performance," Request for Comments (Proposed Standard) RFC 1323, Internet Engineering Task Force, May 1992. Obsoletes RFC1185.
• 20: W. Richard Stevens, TCP/IP illustrated (vol. 1): the protocols, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1993
• 21: [21] D. Clark, V. Jacobson, J. Romkey, and M. Salwen, "An analysis of TCP processing overhead," IEEE Communications Magazine, vol. 27, pp. 23-29, June 1989.
• 22: David A. Borman, Implementing TCP/IP on a cray computer, ACM SIGCOMM Computer Communication Review, v.19 n.2, p.11-15, April 1, 1989 [doi>10.1145/378444.378446]
• 23: [23] V. Jacobson, "Some design issues for high-speed networks," in Networkshop '93, (Melbourne, Australia), Nov. 1993.
• 24: J. C. Mogul , S. E. Deering, Path MTU discovery, RFC Editor, 1990
• 25: S. Knowles, IESG Advice from Experience with Path MTU Discovery, RFC Editor, 1993
• 26: [26] S. Floyd and V. Jacobson, "On traffic phase effects in packet-switched gateways," Internetworking : Research and Experience, vol. 3, pp. 115-156, Sept. 1992.
• 27: Scott Schenker , Lixia Zhang , David D. Clark, Some observations on the dynamics of a congestion control algorithm, ACM SIGCOMM Computer Communication Review, v.20 n.5, p.30-39, Oct 1 1990 [doi>10.1145/381906.381931]
• 28: Lixia Zhang , Scott Shenker , Daivd D. Clark, Observations on the dynamics of a congestion control algorithm: the effects of two-way traffic, Proceedings of the conference on Communications architecture & protocols, p.133-147, September 03-06, 1991, Zurich, Switzerland
• 29: Kimberly C. Claffy , Hans-Werner Braun , George C. Polyzos, Tracking long-term growth of the NSFNET, Communications of the ACM, v.37 n.8, p.34-45, Aug. 1994 [doi>10.1145/179606.179616]
• 30: [30] C. Villamizar, "A variation of random early detection congestion avoidance." work in progress.
• 31: Ramón Cáceres , Peter B. Danzig , Sugih Jamin , Danny J. Mitzel, Characteristics of wide-area TCP/IP conversations, ACM SIGCOMM Computer Communication Review, v.21 n.4, p.101-112, Sept. 1991
• 32: [32] V. Paxson, "Empirically-derived analytic models of wide-area TCP connections," technical report, Lawrence Berkeley Laboratory and EECS Division, University of California, Berkeley, California, June 1993.
• 33: Will E. Leland , Murad S. Taqqu , Walter Willinger , Daniel V. Wilson, On the self-similar nature of Ethernet traffic, ACM SIGCOMM Computer Communication Review, v.23 n.4, p.183-193, Oct. 1993
• 34: Vern Paxson , Sally Floyd, Wide-area traffic: the failure of Poisson modeling, Proceedings of the conference on Communications architectures, protocols and applications, p.257-268, August 31-September 02, 1994, London, United Kingdom
• 35: [35] C. Partridge, "Editorial : The end of simple traffic models," IEEE Network, vol. 7, Sept. 1993.
• 36: [36] T. Skibo, "Experiences with tcp extensions for high-performance networks." contained in ftp://vixen.cso.uiuc.edu/pub/tcplw.shar.Z.
• 37: Sally Floyd, Connections with multiple congested gateways in packet-switched networks part 1: one-way traffic, ACM SIGCOMM Computer Communication Review, v.21 n.5, p.30-47, Oct. 1991 [doi>10.1145/122431.122434]
• 38: [38] I. Merit, "Nsfnet statistics repository." ftp://nis.nsf.net/statistics/nsfnet/.
• 39: [39] A. Romanow and S. Floyd, "Dynamics of TCP traffic over ATM networks." see also 6th IEEE LAN/MAN Workshop, 1993.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems
          Subjects: Routing and layout

  G. Mathematics of Computing
  G.m MISCELLANEOUS
      Subjects: Queueing theory**

General Terms:
Algorithms, Design, Measurement, Performance, Reliability, Standardization, Theory