Performance optimization of TCP/IP over 10 gigabit ethernet by precise instrumentation

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Performance optimization of TCP/IP over 10 gigabit ethernet by precise instrumentation

Full text

Pdf (1.40 MB)

Source

Conference on High Performance Networking and Computing archive
Proceedings of the 2008 ACM/IEEE conference on Supercomputing - Volume 00 table of contents

Austin, Texas

SECTION: Papers table of contents

Article No. 11

Year of Publication: 2008

ISBN:978-1-4244-2835-9

Authors

Takeshi Yoshino	Google Japan Inc.
Yutaka Sugawara	The University of Tokyo
Katsushi Inagami	The University of Tokyo
Junji Tamatsukuri	The University of Tokyo
Mary Inaba	The University of Tokyo
Kei Hiraki	The University of Tokyo

Publisher

IEEE Press Piscataway, NJ, USA

Bibliometrics

Downloads (6 Weeks): 34, Downloads (12 Months): 315, Citation Count: 0

Additional Information:

abstract references index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

ABSTRACT

End-to-end communications on 10 Gigabit Ethernet (10GbE) WAN became popular. However, there are difficulties that need to be solved before utilizing Long Fat-pipe Networks (LFNs) by using TCP. We observed that the followings caused performance depression: short-term bursty data transfer, mismatch between TCP and hardware support, and excess CPU load. In this research, we have established systematic methodologies to optimize TCP on LFNs. In order to pinpoint causes of performance depression, we analyzed real networks precisely by using our hardware-based wire-rate analyzer with 100-ns time-resolution. We took the following actions on the basis of the observations: (1) utilizing hardware-based pacing to avoid unnecessary packet losses due to collisions at bottlenecks, (2) modifying TCP to adapt packet coalescing mechanism, (3) modifying programs to reduce memory copies. We have achieved a constant through-put of 9.08Gbps on a 500ms RTT network for 5h. Our approach has overcome the difficulties on single-end 10GbE LFNs.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	A. Kuznetsov et al., "Linux documentation/networking/ipsysctls.txt."
	2	M. Allman, TCP Congestion Control with Appropriate Byte Counting (ABC), RFC Editor, 2003
	3	M. Allman , V. Paxson , W. Stevens, TCP Congestion Control, RFC Editor, 1999
	4	"Anue Network Emulators," http://www.anuesystems.com/.
	5	"BIG TCP," http://www.csc.ncsu.edu/faculty/rhee/export/bitcp/.
	6	Lawrence S. Brakmo , Sean W. O'Malley , Larry L. Peterson, TCP Vegas: new techniques for congestion detection and avoidance, Proceedings of the conference on Communications architectures, protocols and applications, p.24-35, August 31-September 02, 1994, London, United Kingdom
	7	V. Cerf , Y. Dalal , C. Sunshine, Specification of Internet Transmission Control Program, RFC Editor, 1974
	8	D. D. Clark, Window and Acknowledgement Strategy in TCP, RFC Editor, 1982
	9	Force10 Networks, "White Paper - OC192c/STM-64c and 10 Gigabit Ethernet WAN PHY."
	10	"IEEE 802.3ae-2002," http://www.ieee802.org/3/.
	11	J. Postel (ed), "RFC 791 -- Internet Protocol," Sept. 1981.
	12	J. Postel (ed), "RFC 793 -- Transmission Control Protocol," Sept. 1981.
	13	V. Jacobson , R. Braden , D. Borman, TCP Extensions for High Performance, RFC Editor, 1992
	14	Hiroyuki Kamezawa , Makoto Nakamura , Junji Tamatsukuri , Nao Aoshima , Mary Inaba , Kei Hiraki, Inter-Layer Coordination for Parallel TCP Streams on Long Fat Pipe Networks, Proceedings of the 2004 ACM/IEEE conference on Supercomputing, p.24, November 06-12, 2004 [doi>10.1109/SC.2004.31]
	15	A. Kleen, "Linux manpage of tcp."
	16	"Internet2 Land Speed Record," http://www.internet2.edu/lsr/.
	17	"IPv6 Internet2 Land Speed Record Submission 2006/12/31," http://data-reservoir.adm.s.u-tokyo.ac.jp/lsr-200612-02/.
	18	M. Nakamura, M. Inaba, and K. Hiraki, "Packet Spacing of TCP streams on very high latency Gigabit Ethernets," http://data-reservoir.adm.s.u-tokyo.ac.jp/paper/ia2003.pdf.
	19	NLANR/DAST, "Iperf 1.7.0 - The TCP/UDP bandwidth measurement tool," http://dast.nlanr.net/Projects/Iperf/.
	20	S. Ravot, Y. Xia, D. Nae, X. Su, H. Newman, and J. Bunn, "A practical approach to tcp high speed wan data transfers," in Proceedings of PATHNets 2004 (First Workshop on Provisioning and Transport for Hybrid Networks) San José, Oct. 2004.
	21	Y. Sugawara, M. Inaba, and K. Hiraki, "Implementation and Evaluation of Fine-grain Packet Interval Control," in IPSJ Technical Report OS-100 (in Japanese). IPSJ, Aug. 2005, pp. 85--92.
	22	"T-LEX: Tokyo Lambda Exchange," http://www.t-lex.net/.
	23	R. Takano, T. Kudoh, Y. Kodama, M. Matsuda, H. Tezuka, and Y. Ishikawa, "Design and evaluation of precise software pacing mechanisms for fast long-distance networks," in Proceedings of PFLDnet 2005 (Third International Workshop on Protocols for Fast Long-Distance Networks, Feb. 2005.
	24	H. Xu, "GSO: Generic Segmentation Offload," http://marc.info/?l=linux-netdev&m=115079480721337&w=2.
	25	L. Xu, K. Harfoush, and I. Rhee, "Binary increase congestion control (bic) for fast long-distance networks," in Proceedings of Infocom 2004 (The 23rd Conference of the IEEE Communications Society), 2004.
	26	T. Yoshino, J. Tamatsukuri, K. Inagami, Y. Sugawara, M. Inaba, and K. Hiraki, "Analysis of 10 Gigabit Ethernet using Hardware Engine for Performance Tuning on Long Fat-pipe Network," in Proceedings of PFLDnet 2007 (Fifth International Workshop on Protocols for FAST Long-Distance Networks), Feb. 2007, pp. 43--48.