Measuring the evolution of transport protocols in the internet

ABSTRACT

In this paper we explore the evolution of both the Internet's most heavily used transport protocol, TCP, and the current network environment with respect to how the network's evolution ultimately impacts end-to-end protocols. The traditional end-to-end assumptions about the Internet are increasingly challenged by the introduction of intermediary network elements (middleboxes) that intentionally or unintentionally prevent or alter the behavior of end-to-end communications. This paper provides measurement results showing the impact of the current network environment on a number of traditional and proposed protocol mechanisms (e.g., Path MTU Discovery, Explicit Congestion Notification, etc.). In addition, we investigate the prevalence and correctness of implementations using proposed TCP algorithmic and protocol changes (e.g., selective acknowledgment-based loss recovery, congestion window growth based on byte counting, etc.). We present results of measurements taken using an active measurement framework to study web servers and a passive measurement survey of clients accessing information from our web server. We analyze our results to gain further understanding of the differences between the behavior of the Internet in theory versus the behavior we observed through measurements. In addition, these measurements can be used to guide the definition of more realistic Internet modeling scenarios. Finally, we present several lessons that will benefit others taking Internet measurements.

REFERENCES

• 1: Alexa web search - top 500 web sites. URL: http://www.alexa.com/site/ds/top sites.
• 2: NLANR Web Caching project. http://www.ircache.net/.
• 3: PMTU Black Hole Detection Algorithm Change for Windows NT 3.51. Microsoft Knowledge Base Artible - 136970.
• 4: tcpdump. URL http://www.tcpdump.org.
• 5: tcpurify. URL http://irg.cs.ohiou.edu/~eblanton/tcpurify/.
• 6: Tools for Bandwidth Estimation. Web page, URL 'http://www.icir.org/models/tools.html'.
• 7: Ethereal: Network Protocol Analyzer, 2004.
• 8: Mark Allman, On the generation and use of TCP acknowledgments, ACM SIGCOMM Computer Communication Review, v.28 n.5, p.4-21, Oct. 1998 [doi>10.1145/303297.303301]
• 9: Mark Allman, TCP byte counting refinements, ACM SIGCOMM Computer Communication Review, v.29 n.3, July 1999 [doi>10.1145/505724.505727]
• 10: M. Allman, H. Balakrishnan, and S. Floyd. Enhancing TCP's Loss Recovery Using Limited Transmit, January 2001. RFC 3042.
• 11: M. Allman, S. Floyd, and C. Partridge. Increasing TCP's Initial Window, 2002. RFC 3390.
• 12: Mark Allman, A web server's view of the transport layer, ACM SIGCOMM Computer Communication Review, v.30 n.5, October 2000 [doi>10.1145/505672.505674]
• 13: Mark Allman, On the performance of middleboxes, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA [doi>10.1145/948205.948246]
• 14: Mark Allman , Vern Paxson, On estimating end-to-end network path properties, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.263-274, August 30-September 03, 1999, Cambridge, Massachusetts, United States
• 15: Mark Allman , Vern Paxson, On estimating end-to-end network path properties, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.263-274, August 30-September 03, 1999, Cambridge, Massachusetts, United States
• 16: Mark Allman, Vern Paxson, and W. Richard Stevens. TCP Congestion Control, April 1999. RFC 2581.
• 17: R. Barden. Requirements for Internet Hosts - Communication Layers, October 1989. RFC 1122.
• 18: Jon C. R. Bennett , Craig Partridge , Nicholas Shectman, Packet reordering is not pathological network behavior, IEEE/ACM Transactions on Networking (TON), v.7 n.6, p.789-798, Dec. 1999 [doi>10.1109/90.811445]
• 19: Ethan Blanton , Mark Allman, On making TCP more robust to packet reordering, ACM SIGCOMM Computer Communication Review, v.32 n.1, p.20-30, January 2002 [doi>10.1145/510726.510728]
• 20: Ethan Blanton and Mark Allman. Using TCP DSACKs and SCTP Duplicate TSNs to Detect Spurious Retransmissions, 2004. RFC 3708.
• 21: John Border, Markku Kojo, Jim Griner, Gabriel Montenegro, and Zach Shelby. Performance Enhancing Proxies Intended to Mitigate Link-Related Degradations, June 2001. RFC 3135.
• 22: Douglas E. Comer and John C. Lin. Probing TCP Implementations. In USENIX Summer 1994 Conference, 1994.
• 23: Wesley M. Eddy , Shawn Ostermann , Mark Allman, New techniques for making transport protocols robust to corruption-based loss, ACM SIGCOMM Computer Communication Review, v.34 n.5, p.75-88, October 2004 [doi>10.1145/1039111.1039114]
• 24: Kevin Fall , Sally Floyd, Simulation-based comparisons of Tahoe, Reno and SACK TCP, ACM SIGCOMM Computer Communication Review, v.26 n.3, p.5-21, July 1996 [doi>10.1145/235160.235162]
• 25: S. Floyd. Inappropriate TCP Resets Considered Harmful, 2002. RFC 3360.
• 26: S. Floyd, J. Mahdavi, M. Mathis, and M. Podolsky. An Extension to the Selective Acknowledgement (SACK) Option for TCP, July 2000. RFC 2883.
• 27: Sally Floyd , Kevin Fall, Promoting the use of end-to-end congestion control in the Internet, IEEE/ACM Transactions on Networking (TON), v.7 n.4, p.458-472, Aug. 1999 [doi>10.1109/90.793002]
• 28: Sally Floyd and Eddie Kohler. Internet Research Needs Better Models. In Proceedings of the First Workshop on Hot Topics in Networks (HotNets-I), October 2002.
• 29: Mark Handley, Jitendra Padhye, and Sally Floyd. TCP Congestion Window Validation, June 2000. RFC 2861.
• 30: V. Jacobson, R. Barden, and D. Borman. TCP Extensions for High Performance, May 1992. RFC 1323.
• 31: Amit Jain, Sally Floyd, Mark Allman, and Pasi Sarolahti. Quick-Start for TCP and IP, February 2005. Internet-Draft draft-amit-quick-start-04.txt (work in progress).
• 32: C. A. Kent , J. C. Mogul, Fragmentation considered harmful, ACM SIGCOMM Computer Communication Review, v.17 n.5, p.390-401, Oct./Nov. 1987
• 33: Sourabh Ladha. The TCP Behavior Inference Tool (TBIT) Extensions, 2004. URL http://www.cis.udel.edu/~ladha/tbit-ext.html.
• 34: Sourabh Ladha, Paul D. Amer, Armando L. Caro, and Janardhan Iyengar. On the Prevalence and Evaluation of Recent TCP Enhancements. Globecom 2004, November 2004.
• 35: Kevin Lahey. TCP Problems with Path MTU Discovery, September 2000. RFC 2923.
• 36: R. Ludwig and M. Meyer. The Eifel Detection Algorithm for TCP, 2003. RFC 3522.
• 37: Matt Mathis, Jamshid Mahdavi, Sally Floyd, and Allyn Romanow. TCP Selective Acknowledgement Options, October 1996. RFC 2018.
• 38: Jack McCann, Steve Deering, and Jeffrey C. Mogul. Path MTU Discovery for IP Version 6, August 1996. RFC 1981.
• 39: Alberto Medina , Mark Allman , Sally Floyd, Measuring interactions between transport protocols and middleboxes, Proceedings of the 4th ACM SIGCOMM conference on Internet measurement, October 25-27, 2004, Taormina, Sicily, Italy [doi>10.1145/1028788.1028835]
• 40: Jeffrey C. Mogul and Steve Deering. Path MTU Discovery, November 1990. RFC 1191.
• 41: Jitendra Padhye and Sally Floyd. Identifying the TCP Behavior of Web Servers. In ACM SIGCOMM, August 2001.
• 42: V. Paxson and M. Allman. Computing TCP's Retransmission Timer, November 2000. RFC 2988.
• 43: Vern Paxson, Automated packet trace analysis of TCP implementations, Proceedings of the ACM SIGCOMM '97 conference on Applications, technologies, architectures, and protocols for computer communication, p.167-179, September 14-18, 1997, Cannes, France
• 44: Vern Paxson, End-to-end Internet packet dynamics, Proceedings of the ACM SIGCOMM '97 conference on Applications, technologies, architectures, and protocols for computer communication, p.139-152, September 14-18, 1997, Cannes, France
• 45: Jon Postel. Transmission Control Protocol, September 1981. RFC 793.
• 46: K.K. Ramakrishnan, Sally Floyd, and David Black. The Addition of Explicit Congestion Notification (ECN) to IP, September 2001. RFC 3168.
• 47: J.H. Saltzer, D.P. Reed, and David Clark. End-to-End Arguments in System Design. In Proceedings of the Second International Conference on Distributed Computing Systems, pages 509-512, August 1981.
• 48: Stefan Savage , Neal Cardwell , David Wetherall , Tom Anderson, TCP congestion control with a misbehaving receiver, ACM SIGCOMM Computer Communication Review, v.29 n.5, October 1999 [doi>10.1145/505696.505704]
• 49: Srinivasan Seshan, Hari Balakrishnan, Venkata N. Padmanabhan, Mark Stemm, and Randy Katz. TCP Behavior of a Busy Internet Server: Analysis and Improvements. San Francisco, CA, March 1998.
• 50: Matthew Smart, G. Robert Malan, and Farnam Jahanian. Defeating TCP/IP Stack Fingerprinting. In 9th USENIX Security Symposium, pages 229--240, 2000.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.3 Network Operations

General Terms:
Design, Measurement, Reliability, Standardization, Verification

Keywords:
Internet, TCP, evolution, middleboxes