ParADE: An OpenMP Programming Environment for SMP Cluster Systems

ABSTRACT

Demand for programming environments to exploit clusters of symmetric multiprocessors (SMPs) is increasing. In this paper, we present a new programming environment, called ParADE, to enable easy, portable, and high-performance programming on SMP clusters. It is an OpenMP programming environment on top of a multi-threaded software distributed shared memory (SDSM) system with a variant of home-based lazy release consistency protocol. To boost performance, the runtime system provides explicit message-passing primitives to make it a hybrid-programming environment. Collective communication primitives are used for the synchronization and work-sharing directives associated with small data structures, lessening the synchronization overhead and avoiding the implicit barriers of work-sharing directives. The OpenMP translator bridges the gap between the OpenMP abstraction and the hybrid programming interfaces of the runtime system. The experiments with several NAS benchmarks and applications on a Linux-based cluster show promising results that ParADE overcomes the performance problem of the conventional SDSM-based OpenMP environment.

REFERENCES

• 1: David E. Culler , Anoop Gupta , Jaswinder Pal Singh, Parallel Computer Architecture: A Hardware/Software Approach, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
• 2: [2] Message-passing Interface Forum, "MPI: A Message-Passing Interface Standard," International Journal of Supercomputer Applications and High Performance Computing, vol. 8, no. 3/4, Fall/Winter 1994, pp. 159-416.
• 3: [3] OpenMP C and C++ Application Programming Interface, Version 1.0, http://www.openmp.org, Oct. 1998.
• 4: Kai Li , Paul Hudak, Memory coherence in shared virtual memory systems, ACM Transactions on Computer Systems (TOCS), v.7 n.4, p.321-359, Nov. 1989 [doi>10.1145/75104.75105]
• 5: [5] Mitsuhisa Sato, Shigehisa Satoh, Kazuhiro Kusano, and Yoshio Tanaka, Design of OpenMP Compiler for an SMP Cluster, In Proceedings of European Workshop on OpenMP (EWOMP'99), Sep. 1999.
• 6: Ayon Basumallik , Seung-Jai Min , Rudolf Eigenmann, Towards OpenMP Execution on Software Distributed Shared Memory Systems, Proceedings of the 4th International Symposium on High Performance Computing, p.457-468, May 15-17, 2002
• 7: Y. Charlie Hu , Honghui Lu , Alan L. Cox , Willy Zwaenepoel, OpenMP for networks of SMPs, Journal of Parallel and Distributed Computing, v.60 n.12, p.1512-1530, Dec. 2000 [doi>10.1006/jpdc.2000.1658]
• 8: Hongzhang Shan , Jaswinder P. Singh , Leonid Oliker , Rupak Biswas, Message passing and shared address space parallelism on an SMP cluster, Parallel Computing, v.29 n.2, p.167-186, February 2003 [doi>10.1016/S0167-8191(02)00222-3]
• 9: Franck Cappello , Daniel Etiemble, MPI versus MPI+OpenMP on IBM SP for the NAS benchmarks, Proceedings of the 2000 ACM/IEEE conference on Supercomputing (CDROM), p.12-es, November 04-10, 2000, Dallas, Texas, United States
• 10: [10] Lorna Smith and Paul Kent, "Development and Performance of a Mixed OpenMP/MPI Quantum Monte Carlo Code," Concurrency: Practice and Experience, vol. 12, no. 12, Dec. 2000, pp. 1121-1129.
• 11: Dave Dunning , Greg Regnier , Gary McAlpine , Don Cameron , Bill Shubert , Frank Berry , Anne Marie Merritt , Ed Gronke , Chris Dodd, The Virtual Interface Architecture, IEEE Micro, v.18 n.2, p.66-76, March 1998 [doi>10.1109/40.671404]
• 12: [12] http://www.mpi-softtech.com
• 13: Liviu Iftode, Home-based shared virtual memory, Princeton University, Princeton, NJ, 1998
• 14: [14] Frank Mueller, "Distributed Shared-Memory Threads: DSM-Threads," Workshop on RunTime systems for Parallel Programming, Apr. 1997, pp. 31-40.
• 15: [15] Markus Pizka and Christian Rehn, "Murks-A POSIX Threads Based DSM System," In Proceedings of The International Conference on Parallel and Distributed Computing Systems, Aug. 2001. pp. 642-648.
• 16: [16] Yang-Suk Kee, Jin-Soo Kim, and Soonhoi Ha, "Atomic Page Update Methods for OpenMP-Aware Software DSM," submitted for publication.
• 17: Brian N. Bershad , Matthew J. Zekauskas , Wayne A. Sawdon, The Midway Distributed Shared Memory System, Carnegie Mellon University, Pittsburgh, PA, 1993
• 18: Liviu Iftode , Jaswinder Pal Singh , Kai Li, Scope consistency: a bridge between release consistency and entry consistency, Proceedings of the eighth annual ACM symposium on Parallel algorithms and architectures, p.277-287, June 24-26, 1996, Padua, Italy [doi>10.1145/237502.237567]
• 19: [19] J. M. Bull, "Measuring Synchronization and Scheduling Overheads in OpenMP," In Proceedings of European Workshop on OpenMP (EWOMP'99), Sep. 1999.
• 20: Hee-Chul Yun , Sang-Kwon Lee , Joonwon Lee , Seungryoul Maeng, An Efficient Lock Protocol for Home-Based Lazy Release Consistency, Proceedings of the 1st International Symposium on Cluster Computing and the Grid, p.527, May 15-18, 2001
• 21: [21] David Bailey, TimHarris, William Saphir, Rob van der Wijngaart, Alex Woo, and Maurice Yarrow, "The NAS Parallel Benchmarks". Technical Report, NAS-95-020, 1995.
• 22: [22] Joseph Robicheaux, http://www.openmp.org/samples/jacobi.f, 1998.
• 23: [23] Bill Magro, Kuck, and Associates, http://www.openmp.org/samples/md.f, 1998.

INDEX TERMS

Keywords:
programming environment, SMP cluster, software distributedshared memory, hybrid programming, OpenMP, MPI