Exploiting task-level concurrency in a programmable network interface

ABSTRACT

Programmable network interfaces provide the potential to extend the functionality of network services but lead to instruction processing overheads when compared to application-specific network interfaces. This paper aims to offset those performance disadvantages by exploiting task-level concurrency in the workload to parallelize the network interface firmware for a programmable controller with two processors. By carefully partitioning the handler procedures that process various events related to the progress of a packet, the system can minimize sharing, achieve load balance, and efficiently utilize on-chip storage. Compared to the uniprocessor firmware released by the manufacturer, the parallelized network interface firmware increases throughput by 65% for bidirectional UDP traffic of maximum-sized packets, 157% for bidirectional UDP traffic of minimum-sized packets, and 32--107% for real network services. This parallelization results in performance within 10--20% of a modern ASIC-based network interface for real network services.

REFERENCES

• 1: Alteon WebSystems. Gigabit Ethernet/PCI Network Interface Card: Host/NIC Software Interface Definition, July 1999. Revision 12.4.13.
• 2: Mats Björkman , Per Gunningberg, Locking effects in multiprocessor implementations of protocols, Conference proceedings on Communications architectures, protocols and applications, p.74-83, September 13-17, 1993, San Francisco, California, United States
• 3: Nanette J. Boden , Danny Cohen , Robert E. Felderman , Alan E. Kulawik , Charles L. Seitz , Jakov N. Seizovic , Wen-King Su, Myrinet: A Gigabit-per-Second Local Area Network, IEEE Micro, v.15 n.1, p.29-36, February 1995 [doi>10.1109/40.342015]
• 4: Philip Buonadonna , David Culler, Queue pair IP: a hybrid architecture for system area networks, Proceedings of the 29th annual international symposium on Computer architecture, p.247, May 25-29, 2002, Anchorage, Alaska
• 5: A. Gallatin, J. Chase, and K. Yocum. Trapeze/IP: TCP/IP at Near-Gigabit Speeds. In Proceedings of the FREENIX Track: 1999 USENIX Annual Technical Conference, June 1999.
• 6: Norman C. Hutchinson , Larry L. Peterson, The X-Kernel: An Architecture for Implementing Network Protocols, IEEE Transactions on Software Engineering, v.17 n.1, p.64-76, January 1991 [doi>10.1109/32.67579]
• 7: Hyong-youb Kim , Vijay S. Pai , Scott Rixner, Increasing web server throughput with network interface data caching, Proceedings of the 10th international conference on Architectural support for programming languages and operating systems, October 05-09, 2002, San Jose, California
• 8: Robert Morris , Eddie Kohler , John Jannotti , M. Frans Kaashoek, The click modular router, ACM SIGOPS Operating Systems Review, v.34 n.2, p.24-25, April, 2000 [doi>10.1145/346152.346198]
• 9: Trevor Mudge, Power: A First-Class Architectural Design Constraint, Computer, v.34 n.4, p.52-58, April 2001 [doi>10.1109/2.917539]
• 10: E. M. Nahum, D. J. Yates, J. F. Kurose, and D. F. Towsley. Performance Issues in Parallelized Network Protocols. In Proceedings of the Operating Systems Design and Implementation, pages 125--137, 1994.
• 11: J. Poskanzer. thttpd - tiny/turbo/throttling HTTP server. Acme Labs, Feb. 2000. Unix manual page.
• 12: I. Pratt and K. Fraser. Arsenic: A User-Accessible Gigabit Ethernet Interface. In Proceedings of IEEE INFOCOM '01, pages 67--76, 2001.
• 13: J. Satran, K. Meth, C. Sapuntzakis, M. Chadalapaka, and E. Zeidner. iSCSI. IETF Internet draft draft-ietf-ips-iscsi-14.txt, work in progress, July 2002.
• 14: Piyush Shivam , Pete Wyckoff , Dhabaleswar Panda, EMP: zero-copy OS-bypass NIC-driven gigabit ethernet message passing, Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), p.57-57, November 10-16, 2001, Denver, Colorado [doi>10.1145/582034.582091]
• 15: Piyush Shivam , Pete Wyckoff , Dhabaleswar K. Panda, Can User-Level Protocols Take Advantage of Multi-CPU NICs?, Proceedings of the 16th International Parallel and Distributed Processing Symposium, p.88, April 15-19, 2002

INDEX TERMS

Primary Classification:
  D. Software
  D.1 PROGRAMMING TECHNIQUES
      D.1.3 Concurrent Programming
          Subjects: Parallel programming

General Terms:
Experimentation, Performance

Keywords:
ethernet, firmware, parallel programming, programmable network interface