ASHs: Application-specific handlers for high-performance messaging

ABSTRACT

Application-specific safe message handlers (ASHs) are designed to provide applications with hardware-level network performance. ASHs are user-written code fragments that safely and efficiently execute in the kernel in response to message arrival. ASHs can direct message transfers (thereby eliminating copies) and send messages (thereby reducing send-response latency). In addition, the ASH system provides support for dynamic integrated layer processing (thereby eliminating duplicate message traversals) and dynamic protocol composition (thereby supporting modularity). ASHs provide this high degree of flexibility while still providing network performance as good as, or (if they exploit application-specific knowledge) even better than, hard-wired in-kernel implementations. A combination of user-level microbenchmarks and end-to-end system measurements using TCP demonstrate the benefits of the ASH system.

REFERENCES

• 1: Mark B. Abbott , Larry L. Peterson, Increasing network throughput by integrating protocol layers, IEEE/ACM Transactions on Networking (TON), v.1 n.5, p.600-610, Oct. 1993 [doi>10.1109/90.251918]
• 2: T. E. Anderson , M. D. Dahlin , J. M. Neefe , D. A. Patterson , D. S. Roselli , R. Y. Wang, Serverless network file systems, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.109-126, December 03-06, 1995, Copper Mountain, Colorado, United States
• 3: M.L. Bailey, B. Gopal, M.A. Pagels, L.L. Peterson, and P. Sarkar. PATHFINDER: A pattern-based packet classifier. In Proceedings of the First Symposium on Operating Systems Design and Implementation, pages 115-123, Monterey, CA, USA, November 1994.
• 4: B. N. Bershad , S. Savage , P. Pardyak , E. G. Sirer , M. E. Fiuczynski , D. Becker , C. Chambers , S. Eggers, Extensibility safety and performance in the SPIN operating system, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.267-283, December 03-06, 1995, Copper Mountain, Colorado, United States
• 5: Nina T. Bhatti , Richard D. Schlichting, A system for constructing configurable high-level protocols, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.138-150, August 28-September 01, 1995, Cambridge, Massachusetts, United States
• 6: R. Braden, D. Borman, and C. Partridge. Computing the Intemet checksum. RFC 1071.
• 7: Torsten Braun , Christophe Diot, Protocol implementation using integrated layer processing, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.151-161, August 28-September 01, 1995, Cambridge, Massachusetts, United States
• 8: David D. Clark, The structuring of systems using upcalls, Proceedings of the tenth ACM symposium on Operating systems principles, p.171-180, December 1985, Orcas Island, Washington, United States
• 9: D.D. Clark, V. Jacobson, J. Romkey, and H. Salwen. An analysis of TCP processing overhead. IEEE Communications Magazine, 27(6):23-29, June 1989.
• 10: D. D. Clark , D. L. Tennenhouse, Architectural considerations for a new generation of protocols, Proceedings of the ACM symposium on Communications architectures & protocols, p.200-208, September 26-28, 1990, Philadelphia, Pennsylvania, United States
• 11: A. Krishnamurthy , D. E. Culler , A. Dusseau , S. C. Goldstein , S. Lumetta , T. von Eicken , K. Yelick, Parallel programming in Split-C, Proceedings of the 1993 ACM/IEEE conference on Supercomputing, p.262-273, December 1993, Portland, Oregon, United States [doi>10.1145/169627.169724]
• 12: P. Deutsch and C.A. Grant. A flexible measurement tool for software systems. Information Processing 71,1971.
• 13: P. Druschel, M.B. Abbott, M.A. Pagels, and L.L. Peterson. Network subsystem design. IEEE Network, 7(4):8-17, July 1993.
• 14: Peter Druschel , Larry L. Peterson, Fbufs: a high-bandwidth cross-domain transfer facility, Proceedings of the fourteenth ACM symposium on Operating systems principles, p.189-202, December 05-08, 1993, Asheville, North Carolina, United States
• 15: Peter Druschel , Larry L. Peterson , Bruce S. Davie, Experiences with a high-speed network adaptor: a software perspective, Proceedings of the conference on Communications architectures, protocols and applications, p.2-13, August 31-September 02, 1994, London, United Kingdom
• 16: Aled Edwards , Greg Watson , John Lumley , David Banks , Costas Calamvokis , C. Dalton, User-space protocols deliver high performance to applications on a low-cost Gb/s LAN, Proceedings of the conference on Communications architectures, protocols and applications, p.14-23, August 31-September 02, 1994, London, United Kingdom
• 17: Dawson R. Engler, VCODE: a retargetable, extensible, very fast dynamic code generation system, Proceedings of the ACM SIGPLAN 1996 conference on Programming language design and implementation, p.160-170, May 21-24, 1996, Philadelphia, Pennsylvania, United States
• 18: Dawson R. Engler , M. Frans Kaashoek, DPF: fast, flexible message demultiplexing using dynamic code generation, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.53-59, August 28-30, 1996, Palo Alto, California, United States
• 19: D. R. Engler , M. F. Kaashoek , J. O'Toole, Jr., Exokernel: an operating system architecture for application-level resource management, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.251-266, December 03-06, 1995, Copper Mountain, Colorado, United States
• 20: D.R. Engler, D.A. Wallach, and M.F. Kaashoek. Design and implementation of a modular, flexible, and fast system for dynamic protocol composition. Technical Memorandum TM- 552, Massachusetts Institute of Technology Laboratory for Computer Science, May 1996.
• 21: M.E. Fiuczynski and B.N. Bershad. An extensible protocol architecture for application-specific networking. In Proceedings of USENIX, pages 55-64, San Diego, CA, USA, January 1996.
• 22: James Gosling, Java intermediate bytecodes: ACM SIGPLAN workshop on intermediate representations (IR'95), Papers from the 1995 ACM SIGPLAN workshop on Intermediate representations, p.111-118, January 23-25, 1995, San Francisco, California, United States
• 23: Robert Harper , Peter Lee, Advanced Languages for Systems Software: The Fox Project in 1994, Carnegie Mellon University, Pittsburgh, PA, 1994
• 24: Norman C. Hutchinson , Larry L. Peterson, The X-Kernel: An Architecture for Implementing Network Protocols, IEEE Transactions on Software Engineering, v.17 n.1, p.64-76, January 1991 [doi>10.1109/32.67579]
• 25: K. L. Johnson , M. F. Kaashoek , D. A. Wallach, CRL: high-performance all-software distributed shared memory, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.213-226, December 03-06, 1995, Copper Mountain, Colorado, United States
• 26: P. Keleher, S. Dwarkadas, A.L. Cox, and W. Zwaenepoel. Treadmarks: Distributed Shared Memory on Standard Workstations and Operating Systems. In Proc. of the Winter 1994 USENIX Conference, pages 115-132, San Francisco, CA, USA, January 1994.
• 27: S.J. Leffler, M.K. McKusick, M.J. Karels, and J.S. Quarterman. The design and implementation of the 4.3BSD UNIX operating system. Addison-Wesley, 1989.
• 28: K. Li. IVY: A shared virtual memory system for parallel computing. In International Conference on Parallel Computing, pages 94-101, University Park, PA, USA, August 1988.
• 29: Chris Maeda , Brian N. Bershad, Protocol service decomposition for high-performance networking, Proceedings of the fourteenth ACM symposium on Operating systems principles, p.244-255, December 05-08, 1993, Asheville, North Carolina, United States
• 30: R.P. Martin. HPAM: An Active Message layer for a network of HP workstations. In Proceedings of Hot Interconnects H, August 1994.
• 31: J. Mogul , R. Rashid , M. Accetta, The packer filter: an efficient mechanism for user-level network code, Proceedings of the eleventh ACM Symposium on Operating systems principles, p.39-51, November 08-11, 1987, Austin, Texas, United States
• 32: David Mosberger , Larry L. Peterson , Patrick G. Bridges , Sean O''Malley, Analysis of Techniques to Improve Protocol Processing Latency, University of Arizona, Tucson, AZ, 1996
• 33: Todd A. Proebsting , Scott A. Watterson, Filter fusion, Proceedings of the 23rd ACM SIGPLAN-SIGACT symposium on Principles of programming languages, p.119-130, January 21-24, 1996, St. Petersburg Beach, Florida, United States [doi>10.1145/237721.237760]
• 34: Daniel J. Scalesk , Michael Burrows , Chandramohan A. Thekkath, Experience with Parallel Computing on the AN2 Network, Proceedings of the 10th International Parallel Processing Symposium, p.94-103, April 15-19, 1996
• 35: C. Small and M. Seltzer. A comparison of OS extension technologies. In Proceedings of USENIX, pages 41-54, San Diego, CA, USA, January 1996.
• 36: T. von Eicken , A. Basu , V. Buch , W. Vogels, U-Net: a user-level network interface for parallel and distributed computing (includes URL), Proceedings of the fifteenth ACM symposium on Operating systems principles, p.40-53, December 03-06, 1995, Copper Mountain, Colorado, United States
• 37: D.L. Tennenhouse and D.J. Wetherall. Towards an active network architecture. In Proc. Multimedia, Computing, and Networking 96, January 1996.
• 38: Chandramohan A. Thekkath , Henry M. Levy, Limits to low-latency communication on high-speed networks, ACM Transactions on Computer Systems (TOCS), v.11 n.2, p.179-203, May 1993 [doi>10.1145/151244.151247]
• 39: Chandramohan A. Thekkath , Henry M. Levy , Edward D. Lazowska, Separating data and control transfer in distributed operating systems, Proceedings of the sixth international conference on Architectural support for programming languages and operating systems, p.2-11, October 05-07, 1994, San Jose, California, United States
• 40: Chandramohan A. Thekkath , Thu D. Nguyen , Evelyn Moy , Edward D. Lazowska, Implementing network protocols at user level, Conference proceedings on Communications architectures, protocols and applications, p.64-73, September 13-17, 1993, San Francisco, California, United States
• 41: Christian Tschudin, Flexible protocol stacks, Proceedings of the conference on Communications architecture & protocols, p.197-205, September 03-06, 1991, Zurich, Switzerland
• 42: Robbert van Renesse , Kenneth P. Birman , Roy Friedman , Mark Hayden , David A. Karr, A framework for protocol composition in Horus, Proceedings of the fourteenth annual ACM symposium on Principles of distributed computing, p.80-89, August 20-23, 1995, Ottowa, Ontario, Canada [doi>10.1145/224964.224974]
• 43: Thorsten von Eicken , David E. Culler , Seth Copen Goldstein , Klaus Erik Schauser, Active messages: a mechanism for integrated communication and computation, Proceedings of the 19th annual international symposium on Computer architecture, p.256-266, May 19-21, 1992, Queensland, Australia
• 44: Robert Wahbe , Steven Lucco , Thomas E. Anderson , Susan L. Graham, Efficient software-based fault isolation, Proceedings of the fourteenth ACM symposium on Operating systems principles, p.203-216, December 05-08, 1993, Asheville, North Carolina, United States
• 45: I. Wakeman, A. Ghosh, J. Crowcroft, V. Jacobson, and S. Floyd. Implementing real time packet forwarding policies using Streams. In Proceedings USENIX Winter 1995 Technical Conference, pages 71-82, New Orleans, LA, USA, January 1995.
• 46: Deborah A. Wallach , Wilson C. Hsieh , Kirk L. Johnson , M. Frans Kaashoek , William E. Weihl, Optimistic active messages: a mechanism for scheduling communication with computation, Proceedings of the fifth ACM SIGPLAN symposium on Principles and practice of parallel programming, p.217-226, July 19-21, 1995, Santa Barbara, California, United States
• 47: M. Yuhara, B.N. Bershad, C. Maeda, and J.E.B. Moss. Efficient packet demultiplexing for multiple endpoints and large messages. In Proceedings of the Winter 1994 USENIX Conference, San Francisco, CA, USA, January 1994.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Distributed networks

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Performance attributes

  D. Software
  D.4 OPERATING SYSTEMS
      D.4.4 Communications Management
          Subjects: Message sending

General Terms:
Algorithms, Design, Performance