Measuring the performance of communication middleware on high-speed networks

ABSTRACT

Conventional implementations of communication middleware (such as CORBA and traditional RPC toolkits) incur considerable over-head when used for performance-sensitive applications over high-speed networks. As gigabit networks become pervasive, inefficient middleware will force programmers to use lower-level mechanisms to achieve the necessary transfer rates. This is a serious problem for mission/life-critical applications (such as satellite surveillance and medical imaging).This paper compares the performance of several widely used communication middleware mechanisms on a high-speed ATM network. The middleware ranged from lower-level mechanisms (such as socket-based C interfaces and C++ wrappers for sockets) to higher-level mechanisms (such as RPC, hand-optimized RPC and two implementations of CORBA - Orbix and ORBeline). These measurements reveal that the lower-level C and C++ implementations outperform the CORBA implementations significantly (the best CORBA throughput for remote transfer was roughly 75 to 80 percent of the best C/C++ throughput for sending scalar data types and only around 33 percent for sending structs containing binary fields), and the hand-optimized RPC code performs slightly better than the CORBA implementations. Our goal in precisely pinpointing the sources of overhead for communication middleware is to develop scalable and flexible CORBA implementations that can deliver gigabit data rates to applications.

REFERENCES

• 1: Mark B. Abbott , Larry L. Peterson, Increasing network throughput by integrating protocol layers, IEEE/ACM Transactions on Networking (TON), v.1 n.5, p.600-610, Oct. 1993 [doi>10.1109/90.251918]
• 2: Kenneth Birman and Robbert van Renesse. RPC Considered Inadequate. In Reliable Distributed Computing with the Isis Toolkit, pages 68-78. IEEE Computer Society Press, Los Alamitos, 1994.
• 3: G.J Blaine, M.E. Boyd, and S.M. Crider. Project Spectrum: Scalable Bandwidth for the BJC Health System. HIMSS, Health Care Communications, pages 71-81,1994.
• 4: Isabelle Chrisment. Impact of ALF on Communication Subsystems Design and Performance. In First International Workshop on High Performance Protocol Architectures, HIPPARCH '94, Sophia Antipolis, France, December 1994. INRIA France.
• 5: D. D. Clark , D. L. Tennenhouse, Architectural considerations for a new generation of protocols, Proceedings of the ACM symposium on Communications architectures & protocols, p.200-208, September 26-28, 1990, Philadelphia, Pennsylvania, United States
• 6: Sudheer Dharanikota , Kurt Maly , C. M. Overstreet, Performance evaluation of TCP (UDP)/IP over ATM networks, Old Dominion University, Norfolk, VA, 1994
• 7: Minh DoVan, Louis Humphrey, Geri Cox, and Carl Ravin. Initial Experience with Asynchronous Transfer Mode for Use in a Medical Imaging Network. Journal of Digital Imaging, 8(1):43-48, February 1995.
• 8: Erich Gamma , Richard Helm , Ralph Johnson , John Vlissides, Design patterns: elements of reusable object-oriented software, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 9: Atanu Ghosh, Jon Crowcroft, Michael Fry, and Mark Handley. Integrated Layer Video Decoding and Application Layer Framed Secure Login: General Lessons from Two or Three Very Different Applications. In First International Workshop on High Performance Protocol Architectures, HIPPARCH '94, Sophia Antipolis, France, December 1994. INRIA France.
• 10: Philipp Hoschka , Christian Huitema, Automatic Generation of Optimized Code for Marshalling Routines, Proceedings of the IFIP TC6/WG6.5 International Conference on Upper Layer Protocols, Architectures and Applications, p.135-150, June 01-03, 1994
• 11: K. Modeklev, E. Klovning, and O. Kure. TCP/IP Behavior in a High- Speed Local ATM Network Environment. In Proceedings of the 19tn Conference on Local ComputerNetworks, pages 176-185, Minneapolis, MN, October 1994. IEEE.
• 12: Object Management Group. CORBAServices: Common Object Services Specification, Revised Edition, 95-3-31 edition, March 1994.
• 13: Object Management Group. The Common Object Request Broker: Architecture and Specification, 2.0 edition, July 1995.
• 14: Sean O'Malley , Todd Proebsting , Allen Brady Montz, USC: a universal stub compiler, Proceedings of the conference on Communications architectures, protocols and applications, p.295-306, August 31-September 02, 1994, London, United Kingdom
• 15: Graham Parrington. A Stub Generation System for C++. Computing Systems, 8(2):135-170, Spring 1995.
• 16: Guru Parulkar , Douglas C. Schmidt , Jonathan S. Turner, aItPm: a strategy for integrating IP with ATM, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.49-59, August 28-September 01, 1995, Cambridge, Massachusetts, United States
• 17: Joseph Pasquale , Eric W. Anderson , Kevin Fall , Jonathan S. Kay, High-performance I/O and networking software in Sequoia 2000, Digital Technical Journal, v.7 n.3, p.84-94, 1995
• 18: Irfan Pyarali, Douglas C. Schmidt, and Timothy H. Harrison. Design and Performance of an Object-Oriented Framework for High- Performance Electronic Medical Imaging. In Proceedings of the 2~a Conference on Object-Oriented Technologies and Systems, Toronto, Canada, June 1996. USENIX.
• 19: Sanjay Radia, Graham Hamilton, Peter Kessler, and Michael Powell. The Spring Object Model. In Proceedings of the Conference on Object- Oriented Technologies, Monterey, CA, June 1995. USENIX.
• 20: Antony Richards, Ranil De Silva, Anne Fladenmuller, Aruna Seneviratne, and Michael Fry. The Application of ILP/ALF to Configurable Protocols. In First International Workshop on High Performance Protocol Architectures, HIPPARCH '94, Sophia Antipolis, France, December 1994. INRIA France.
• 21: Dennis Ritchie. A Stream Input-Output System. AT&T Bell Labs Technical Journal, 63(8):311-324, October 1984.
• 22: Douglas C. Schmidt. ACE: an Object-Oriented Framework for Developing Distributed Applications. In Proceedings of the 6th USENIX C++ Technical Conference, Cambridge, Massachusetts, April 1994. USENIX Association.
• 23: Douglas C. Schmidt, Timothy H. Harrison, and Ehab A1-Shaer. Object- Oriented Components for High-speed Network Programming. In Proceedings of the 1 st Conference on Object-Oriented Technologies and Systems, Monterey, CA, June 1995. USENIX.
• 24: Sun Microsystems. XDR: External Data Representation Standard. Network Information Center RFC 1014, June 1987.
• 25: Sun Microsystems. Open Network Computing: Transport lndependent RPC, June 1995.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Network communications

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Distributed networks

  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

          Nouns: C

General Terms:
Experimentation, Languages, Measurement, Performance