An integrated compilation and performance analysis environment for data parallel programs

ABSTRACT

Supporting source-level performance analysis of programs written in data-parallel languages requires a unique degree of integration between compilers and performance analysis tools. Compilers for languages such as High Performance Fortran infer parallelism and communication from data distribution directives, thus, performance tools cannot meaningfully relate measurements about these key aspects of execution performance to source-level constructs without substantial compiler support. This paper describes an integrated system for performance analysis of data-parallel programs based on the Rice Fortran 77D compiler and the Illinois Pablo performance analysis toolkit. During code generation, the Fortran D compiler records mapping information and semantic analysis results describing the relationship between performance instrumentation and the original source program. An integrated performance analysis system based on the Pablo toolkit uses this information to correlate the program's dynamic behavior with the data parallel source code. The integrated system provides detailed source-level performance feedback to programmers via a pair of graphical interfaces. Our strategy serves as a model for integration of data-parallel compilers and performance tools.

REFERENCES

• 1: Applied Parallel Research. Forge 90 Distributed Memory Parallelizer: User's Guide, version 8.0 ed. Placerville, CA, 1992.
• 2: Aydt, R. A. SDDF: The Pablo Self-Describing Data Format. Tech. rep., Department of Computer Science, University of Illinois, Apr. 1994.
• 3: C.-W. Tseng , S. Hiranandani , K. Kennedy, Preliminary experiences with the Fortran D compiler, Proceedings of the 1993 ACM/IEEE conference on Supercomputing, p.338-350, December 1993, Portland, Oregon, United States [doi>10.1145/169627.169747]
• 4: Irvin, R. B., and Miller, B. P. A Performance Tool for High-Level Parallel Programming Languages. In Programming Environments for Massively Parallel Distributed Systems (Basel, Switzerland, 1994), Birkhauser Verlag.
• 5: Charles H. Koelbel , David B. Loveman , Robert S. Schreiber , Guy L. Steele, Jr. , Mary E. Zosel, The high performance Fortran handbook, MIT Press, Cambridge, MA, 1994
• 6: Mellor-Crummey, J. M., Adve, V. S., and Koelbel, C. The Compiler's Role in Analysis and Tuning of Data-Parallel Programs. In Proceedings of The Second Workshop on Environments and Tools for Parallel Scientific Computing (Townsend, TN, May 1994), pp. 211-220. Also available via anonymous ftp from softlib.cs.rice.edu in pub/CRPC-TRs/reports/CRPC-TR94405.ps.
• 7: B. P. Miller , M. Clark , J. Hollingsworth , S. Kierstead , S. S. Lim , T. Torzewski, IPS-2: The Second Generation of a Parallel Program Measurement System, IEEE Transactions on Parallel and Distributed Systems, v.1 n.2, p.206-217, April 1990 [doi>10.1109/71.80132]
• 8: Pase, D. Personal communication, Aug. 1995.
• 9: Daniel A. Reed, Performance Instrumentation Techniques for Parallel Systems, Performance Evaluation of Computer and Communication Systems, Joint Tutorial Papers of Performance '93 and Sigmetrics '93, p.463-490, May 10-14, 1993
• 10: Daniel A. Reed, Experimental analysis of parallel systems: techniques and open problems, Proceedings of the 7th international conference on Computer performance evaluation : modelling techniques and tools: modelling techniques and tools, p.25-51, June 1994, Vienna, Austria
• 11: Reed, D. A., Aydt, R. A., Noe, R. J., Roth, P. C., Shields, K. A., Schwartz, B. W., and Tavera, L. F. Scalable Performance Analysis: The Pablo Performance Analysis Environment. In Proceedings of the Scalable Parallel Libraries Conference, A. Skjellum, Ed. IEEE Computer Society, 1993, pp. 104-113.
• 12: B. Ries , R. Anderson , W. Auld , D. Breazeal , K. Callaghan , E. Richards , W. Smith, The paragon performance monitoring environment, Proceedings of the 1993 ACM/IEEE conference on Supercomputing, p.850-859, December 1993, Portland, Oregon, United States [doi>10.1145/169627.169851]
• 13: TMC. Prism User's Guide, V1.2. Thinking Machines Corporation, Cambridge, Massachusetts, Mar. 1993.
• 14: Williams, W., Hoel, T., and Pase, D. The MPP Apprentice Performance Tool: Delivering the Performance of the Cray T3D. In Programming Environments for Massively Parallel Distributed Systems (Basel, Switzerland, 1994), Birkhauser Verlag.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING

Additional Classification:
  C. Computer Systems Organization
  C.1 PROCESSOR ARCHITECTURES
      C.1.3 Other Architecture Styles
          Subjects: Data-flow architectures
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.1 Large and Medium ("Mainframe") Computers
          Subjects: Super (very large) computers

  D. Software
  D.2 SOFTWARE ENGINEERING
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications
          Subjects: Concurrent, distributed, and parallel languages

General Terms:
Design, Languages, Performance