A performance analysis of the Berkeley UPC compiler

ABSTRACT

Unified Parallel C (UPC) is a parallel language that uses a Single Program Multiple Data (SPMD) model of parallelism within a global address space. The global address space is used to simplify programming, especially on applications with irregular data structures that lead to fine-grained sharing between threads. Recent results have shown that the performance of UPC using a commercial compiler is comparable to that of MPI [7]. In this paper we describe a portable open source compiler for UPC. Our goal is to achieve a similar performance while enabling easy porting of the compiler and runtime, and also provide a framework that allows for extensive optimizations. We identify some of the challenges in compiling UPC and use a combination of micro-benchmarks and application kernels to show that our compiler has low overhead for basic operations on shared data and is competitive, and sometimes faster than, the commercial HP compiler. We also investigate several communication optimizations, and show significant benefits by hand-optimizing the generated code.

REFERENCES

• 1: D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, D. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, H. D. Simon, V. Venkatakrishnan, and S. K. Weeratunga. The NAS Parallel Benchmarks. The International Journal of Supercomputer Applications, 5(3):63--73, Fall 1991.
• 2: Christian Bell , Dan Bonachea , Yannick Cote , Jason Duell , Paul Hargrove , Parry Husbands , Costin Iancu , Michael Welcome , Katherine Yelick, An Evaluation of Current High-Performance Networks, Proceedings of the 17th International Symposium on Parallel and Distributed Processing, p.28.1, April 22-26, 2003
• 3: The Berkeley UPC Compiler, 2002. http://upc.lbl.gov.
• 4: Dan Bonachea, GASNet Specification, v1.1, University of California at Berkeley, Berkeley, CA, 2002
• 5: Soumen Chakrabarti , Manish Gupta , Jong-Deok Choi, Global communication analysis and optimization, Proceedings of the ACM SIGPLAN 1996 conference on Programming language design and implementation, p.68-78, May 21-24, 1996, Philadelphia, Pennsylvania, United States
• 6: Compaq UPC version 2.0 for Tru64 UNIX. http://www.tru64unix.compaq.com/upc.
• 7: Tarek El-Ghazawi , Francois Cantonnet, UPC performance and potential: a NPB experimental study, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, p.1-26, November 16, 2002, Baltimore, Maryland
• 8: T. El-Ghazawi, W. Carlson, and J. Draper. UPC Language Specifications, version 1.1, 2003. http://www.gwu.edu/upc/documentation.html.
• 9: Tarek A. El-Ghazawi , Sébastien Chauvin, UPC Benchmarking Issues, Proceedings of the 2001 International Conference on Parallel Processing, p.365-372, September 03-07, 2001
• 10: Paul N. Hilfinger , Dan Bonachea , David Gay , Susan Graham , Ben Liblit , Geoff Pike , Katherine Yelick, Titanium Language Reference Manual, University of California at Berkeley, Berkeley, CA, 2001
• 11: Arvind Krishnamurthy , Katherine Yelick, Analyses and optimizations for shared address space programs, Journal of Parallel and Distributed Computing, v.38 n.2, p.130-144, Nov. 1, 1996 [doi>10.1006/jpdc.1996.0136]
• 12: Jaejin Lee , David A. Padua, Hiding Relaxed Memory Consistency with Compilers, Proceedings of the 2000 International Conference on Parallel Architectures and Compilation Techniques, p.111, October 15-19, 2000
• 13: Lemieux. http://www.psc.edu/machines/tcs/lemieux.html.
• 14: Ben Liblit , Alexander Aiken, Type systems for distributed data structures, Proceedings of the 27th ACM SIGPLAN-SIGACT symposium on Principles of programming languages, p.199-213, January 19-21, 2000, Boston, MA, USA [doi>10.1145/325694.325717]
• 15: Chi-Keung Luk , Todd C. Mowry, Compiler-based prefetching for recursive data structures, Proceedings of the seventh international conference on Architectural support for programming languages and operating systems, p.222-233, October 01-04, 1996, Cambridge, Massachusetts, United States
• 16: Matrix market. http://gams.nist.gov/MatrixMarket/.
• 17: MPICH-A Portable Implementation of MPI. http://www-unix.mcs.anl.gov/mpi/mpich.
• 18: R. Numwich and J. Reid. Co-Array Fortran for parallel programming. Technical Report RAL-TR-1998-060, Rutherford Appleton Laboratory, 1998.
• 19: OpenMP: Simple, Portable, Scalable SMP Programming. http://www.openmp.org.
• 20: The Message Passing Interface (MPI) standard. http://www-unix.mcs.anl.gov/mpi/.
• 21: R. S. Tuminaro, M. Heroux, S. A. Hutchinson, and J. N. Shadid. Official aztec user's guide version 2.1. Technical Report SAND99-8801J, Sandia National Laboratories, 1999.
• 22: Yingchun Zhu , Laurie J. Hendren, Communication optimizations for parallel C programs, Journal of Parallel and Distributed Computing, v.58 n.2, p.301-332, Aug. 1999 [doi>10.1006/jpdc.1999.1554]

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.4 Processors
          Subjects: Compilers

General Terms:
Languages, Measurement, Performance

Keywords:
UPC, global address space, parallel, performance