Inter-Layer Coordination for Parallel TCP Streams on Long Fat Pipe Networks

ABSTRACT

As the network speed grows, inter-layer coordination becomes more important. This paper shows 3 inter-layer coordination methods; (1) "Comet-TCP"; cooperation of data-link layer and transport layer using hardware, (2) "Transmission Rate Controlled TCP (TRC-TCP)"; cooperation of data-link layer and transport layer using software, and (3) "Dulling Edges of Cooperative Parallel streams (DECP)"; cooperation of transport layer and application layer. We show the experimental results of file transfer at Bandwidth Challenge in SC2003; one and a half round trip from Japan to U.S., 15,000 miles, which has 350 ms RTT and 8.2 Gbps bandwidth. Comet-TCP hardware solution attained max 7.56 Gbps using a pair of 16 IA servers, which is 92% of available bandwidth and DECP software attained max 7.01 Gbps using a pair of 32 IA servers.

REFERENCES

• 1: J. Border , M. Kojo , J. Griner , G. Montenegro , Z. Shelby, Performance Enhancing Proxies Intended to Mitigate Link-Related Degradations, RFC Editor, 2001
• 2: [2] L. Brakmo and L. Peterson, "TCP Vegas: End to End Congestion Avoidance on a Global Internet", IEEE Journal of Selected Areas in Communications, 13(8):1465-1480, October 1995.
• 3: Lars Eggert , John Heidemann , Joe Touch, Effects of ensemble-TCP, ACM SIGCOMM Computer Communication Review, v.30 n.1, January 2000 [doi>10.1145/505688.505691]
• 4: S. Floyd, HighSpeed TCP for Large Congestion Windows, RFC Editor, 2003
• 5: Thomas J. Hacker , Brian D. Athey , Brian Noble, The End-to-End Performance Effects of Parallel TCP Sockets on a Lossy Wide-Area Network, Proceedings of the 16th International Parallel and Distributed Processing Symposium, p.314, April 15-19, 2002
• 6: [6] T. Hacker, B. Noble and B. Athey, "Improving Throughput and Maintaining Fairness using Parallel TCP", IEEE Infocom 2004, Mar. 2004.
• 7: Kei Hiraki , Mary Inaba , Junji Tamatsukuri , Ryutaro Kurusu , Yukichi Ikuta , Hisashi Koga , Akira Zinzaki, Data Reservoir: utilization of multi-gigabit backbone network for data-intensive research, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, p.1-9, November 16, 2002, Baltimore, Maryland
• 8: Janey C. Hoe, Improving the start-up behavior of a congestion control scheme for TCP, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.270-280, August 28-30, 1996, Palo Alto, California, United States
• 9: [9] C. Jin, D. Wei, and S. Low "FAST TCP: Motivation, Architecture, Algorithms, Performance", IEEE Infocom 2004, Mar. 2004.
• 10: [10] A. Jinzaki, "Stream Processor", Proc. JSPP2000, pp. 205-212, (in Japanese), 2000.
• 11: Shrikrishna Karandikar , Shivkumar Kalyanaraman , Prasad Bagal , Bob Packer, TCP rate control, ACM SIGCOMM Computer Communication Review, v.30 n.1, January 2000 [doi>10.1145/505688.505694]
• 12: [12] T. Kelly, "Scalable TCP: Improving Performance in Highspeed Wide Area Networks", PFLDnet 2003.
• 13: [13] T. Miyata, H. Fukuda, and S. Ono, "Impact of Packet Spacing Time on Packet Loss under LW for QoS of FEC-based Applications", IPSJ Sig Notes, Mobile Computing, Vol. 6, pp. 7-13, 1998.
• 14: [14] M. Nakamura, M. Inaba, and K. Hiraki, "Fast Ethernet is sometimes faster than Gigabit Ethernet on Long Fat Pipe Network environment - Observation of congestion control of TCP streams", PDCS2003, Nov. 2003.
• 15: [15] S. Nakano, and et al. "DR Giga Analyzer", Symp. on Global Dependable Information Infrastructure, Feb. 2004. (in Japanese)
• 16: [16] M. Nakamura, J. Senbon, Y. Sugawara, T. Itoh, M. Inaba, K. Hiraki, "End-node transmission rate control kind to intermediate routers - towards 10Gbps era", PFLDnet2004, Feb. 2004.
• 17: H. Sivakumar , S. Bailey , R. L. Grossman, PSockets: the case for application-level network striping for data intensive applications using high speed wide area networks, Proceedings of the 2000 ACM/IEEE conference on Supercomputing (CDROM), p.37-es, November 04-10, 2000, Dallas, Texas, United States
• 18: [18] Y. Sugawara, M. Inaba, and K. Hiraki, "Over 10Gbps String Matching Mechanism for Multi-Stream Packet Scanning Systems" FPL2004, To appear.
• 19: [19] : BBftp. http://doc.in2p3.fr/bbftp/.
• 20: [20] : pftp. http://www.indiana.edu/ rats/research/hsi/.
• 21: [21] : GridFTP. http://www.globus.org/datagrid/.