ARMI: an adaptive, platform independent communication library

ABSTRACT

ARMI is a communication library that provides a framework for expressing fine-grain parallelism and mapping it to a particular machine using shared-memory and message passing library calls. The library is an advanced implementation of the RMI protocol and handles low-level details such as scheduling incoming communication and aggregating outgoing communication to coarsen parallelism when necessary. These details can be tuned for different platforms to allow user codes to achieve the highest performance possible without manual modification. ARMI is used by STAPL, our generic parallel library, to provide a portable, user transparent communication layer. We present the basic design as well as the mechanisms used in the current Pthreads/OpenMP, MPI implementations and/or a combination thereof. Performance comparisons between ARMI and explicit use of Pthreads or MPI are given on a variety of machines, including an HP V2200, SGI Origin 3800, IBM Regatta-HPC and IBM RS6000 SP cluster.

REFERENCES

• 1: Peter H. Beckman , Dennis Gannon, Tulip: A Portable Run-Time System for Object-Parallel Systems, Proceedings of the 10th International Parallel Processing Symposium, p.532-536, April 15-19, 1996
• 2: Guy E. Blelloch , Charles E. Leiserson , Bruce M. Maggs , C. Greg Plaxton , Stephen J. Smith , Marco Zagha, A comparison of sorting algorithms for the connection machine CM-2, Proceedings of the third annual ACM symposium on Parallel algorithms and architectures, p.3-16, July 21-24, 1991, Hilton Head, South Carolina, United States [doi>10.1145/113379.113380]
• 3: S. Bova, R. Eigenmann, H. Gabb, G. Gaertner, B. Kuhn, B. Magro, S. Salvini, and V. Vatsa. Combining message-passing and directives in parallel applications. SIAM News, 32(9):10--14, 1999.
• 4: Franck Cappello , Daniel Etiemble, MPI versus MPI+OpenMP on IBM SP for the NAS benchmarks, Proceedings of the 2000 ACM/IEEE conference on Supercomputing (CDROM), p.12-es, November 04-10, 2000, Dallas, Texas, United States
• 5: David E. Culler , Anoop Gupta , Jaswinder Pal Singh, Parallel Computer Architecture: A Hardware/Software Approach, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
• 6: Ian Foster , Jonathan Geisler , Carl Kesselman , Steven Tuecke, Managing multiple communication methods in high-performance networked computing systems, Journal of Parallel and Distributed Computing, v.40 n.1, p.35-48, Jan. 10, 1997 [doi>10.1006/jpdc.1996.1266]
• 7: Ian Foster , Carl Kesselman , Steven Tuecke, The Nexus approach to integrating multithreading and communication, Journal of Parallel and Distributed Computing, v.37 n.1, p.70-82, Aug. 25, 1996 [doi>10.1006/jpdc.1996.0108]
• 8: Madhusudhan Govindaraju , Aleksander Slominski , Venkatesh Choppella , Randall Bramley , Dennis Gannon, Requirements for and evaluation of RMI protocols for scientific computing, Proceedings of the 2000 ACM/IEEE conference on Supercomputing (CDROM), p.61-es, November 04-10, 2000, Dallas, Texas, United States
• 9: William Gropp , Ewing Lusk , Nathan Doss , Anthony Skjellum, A high-performance, portable implementation of the MPI message passing interface standard, Parallel Computing, v.22 n.6, p.789-828, Sept. 1996 [doi>10.1016/0167-8191(96)00024-5]
• 10: CORPORATE IEEE, Inc. Staff, Information Technology-Portable Operating System Interface, IEEE Standards Office, New York, NY, 1990
• 11: William Mclendon, III , Bruce Hendrickson , Steve Plimpton , Lawrence Rauchwerger, Finding strongly connected components in parallel in particle transport sweeps, Proceedings of the thirteenth annual ACM symposium on Parallel algorithms and architectures, p.328-329, July 2001, Crete Island, Greece [doi>10.1145/378580.378751]
• 12: B. Joy, G. Steele, J. Gosling, and G. Bracha. Java(TM) Language Specification (2nd Edition). Reading, MA: Addison-Wesley Pub Co, 2000.
• 13: Laxmikant V. Kale , Sanjeev Krishnan, CHARM++: a portable concurrent object oriented system based on C++, Proceedings of the eighth annual conference on Object-oriented programming systems, languages, and applications, p.91-108, September 26-October 01, 1993, Washington, D.C., United States
• 14: D. Kumar, Development of a Class of Distributed Termination Detection Algorithms, IEEE Transactions on Knowledge and Data Engineering, v.4 n.2, p.145-155, April 1992 [doi>10.1109/69.134251]
• 15: Steven S. Lumetta , Alan M. Mainwaring , David E. Culler, Multi-protocol active messages on a cluster of SMP's, Proceedings of the 1997 ACM/IEEE conference on Supercomputing (CDROM), p.1-22, November 15-21, 1997, San Jose, CA [doi>10.1145/509593.509596]
• 16: Message Passing Interface Forum. MPI: A Message-Passing Interface Standard, June 1995. www.mpi-forum.org.
• 17: Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface, May 1998. www.mpi-forum.org.
• 18: S. Microsystems. Java remote method invocation (RMI). http://java.sun.com/products/jdk/rmi/, 1995--2002.
• 19: Jarek Nieplocha , Bryan Carpenter, ARMCI: A Portable Remote Memory Copy Libray for Ditributed Array Libraries and Compiler Run-Time Systems, Proceedings of the 11 IPPS/SPDP'99 Workshops Held in Conjunction with the 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing, p.533-546, April 12-16, 1999
• 20: Jarek Nieplocha , Jialin Ju , Tjerk P. Straatsma, A Multiprotocol Communication Support for the Global Address Space Programming Model on the IBM SP, Proceedings from the 6th International Euro-Par Conference on Parallel Processing, p.718-728, August 29-September 01, 2000
• 21: Dimitrios S. Nikolopoulos , Eduard Ayguadé , Theodore S. Papatheodorou , Constantine D. Polychronopoulos , Jesús Labarta, The trade-off between implicit and explicit data distribution in shared-memory programming paradigms, Proceedings of the 15th international conference on Supercomputing, p.23-37, June 2001, Sorrento, Italy [doi>10.1145/377792.377801]
• 22: OpenMP Architecture Review Board. OpenMP - C and C++ Application Program Interface, October 1998. Document DN 004-2229-001, www.openmp.org.
• 23: A. Ping, A. Jula, S. Rus, S. Saunders, T. Smith, G. Tanase, N. Thomas, N. Amato, and L. Rauchwerger. STAPL: An adaptive, generic parallel C++ library. In Int. Workshop on Languages and Compilers for Parallel Computing, 2001.
• 24: G. Shah , C. Bender, Performance and Experience with LAPI -- A New High-Performance Communication Library for the IBM RS/6000 SP, Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium, p.260, March 30-April 03, 1998
• 25: Hongzhang Shan , Jaswinder Pal Singh, A comparison of MPI, SHMEM and cache-coherent shared address space programming models on the SGI Origin2000, Proceedings of the 13th international conference on Supercomputing, p.329-338, June 20-25, 1999, Rhodes, Greece [doi>10.1145/305138.305210]
• 26: L. Smith. Mixed mode MPI/OpenMP programming. UK High-End Computing Technology Report, http://www.ukhec.ac.uk/publications/, 2000.
• 27: Bjarne Stroustrup, The C++ Programming Language, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2000
• 28: Thorsten von Eicken , David E. Culler , Seth Copen Goldstein , Klaus Erik Schauser, Active messages: a mechanism for integrated communication and computation, Proceedings of the 19th annual international symposium on Computer architecture, p.256-266, May 19-21, 1992, Queensland, Australia

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

General Terms:
Languages

Keywords:
MPI, OpenMP, Pthreads, RMI, RPC, communication library, parallel programming, run-time system