Performance of the CM-5 scalable file system

ABSTRACT

Assessing the performance and software interactions of emerging parallel input/output systems is a critical first step in input/output software tuning. Moreover, understanding the system response to well-understood, synthetic input/output patterns is itself a prelude to analysis of more complex application input/output patterns. We have conducted a series of experiments to measure the performance of the CM-5's new Scalable Disk Array (SDA) and Scalable Parallel File System (SFS) using the file system interfaces provided by the data parallel CM Fortran and message passing CMMD programming models. The results of these experiments suggest that the CM-5's parallel input/output systems is an improvement over its predecessor, the CM-2 Data Vault. However, network bandwidth can be a bottleneck for the data reordering phase of input/output operations.

REFERENCES

• 1: BATCHER, K. E. Deign of a Massively Parallel Processor. IEEE Transactions on Computers C-29, (Sept. 1980), 836-842.
• 2: BEST, M. Personal Communication.
• 3: Rajesh R. Bordawekar , Alok N. Choudhary , Juan Miguel del Rosario, An experimental performance evaluation of Touchstone Delta Concurrent File System, Proceedings of the 7th international conference on Supercomputing, p.367-376, July 19-23, 1993, Tokyo, Japan [doi>10.1145/165939.166013]
• 4: R. Bordawekar , J. M. del Rosario , A. Choudhary, Design and Evaluation of primitives for Parallel I/O, Proceedings of the 1993 ACM/IEEE conference on Supercomputing, p.452-461, December 1993, Portland, Oregon, United States [doi>10.1145/169627.169782]
• 5: FINBBERG, S. A. Implementing the NHT- 1 Application I/O Benchmark. In Workshop on I/O in Parallel Computer Systems (April 1993).
• 6: HPFF. High-Peformance Fortran Language Specification, version 1.0. Tech. rep., High Performance Fortran Forum, May 1993.
• 7: INTEL SUPERCOMPUTER SYSTEMS DIVI- SION. Paragon User's Guide, Oct 1993.
• 8: KWAN, T. T. Performance Evaluation of the CM-5. Master's thesis, University of Illinois at Urbana-Champaign, Department of Computer Science, April 1994.
• 9: T. T. Kwan , B. K. Totty , D. A. Reed, Communication and computation performance of the CM-5, Proceedings of the 1993 ACM/IEEE conference on Supercomputing, p.192-201, December 1993, Portland, Oregon, United States [doi>10.1145/169627.169691]
• 10: Charles E. Leiserson , Zahi S. Abuhamdeh , David C. Douglas , Carl R. Feynman , Mahesh N. Ganmukhi , Jeffrey V. Hill , Daniel Hillis , Bradley C. Kuszmaul , Margaret A. St. Pierre , David S. Wells , Monica C. Wong , Shaw-Wen Yang , Robert Zak, The network architecture of the Connection Machine CM-5 (extended abstract), Proceedings of the fourth annual ACM symposium on Parallel algorithms and architectures, p.272-285, June 29-July 01, 1992, San Diego, California, United States [doi>10.1145/140901.141883]
• 11: LoVERSO, S. J., ISMAN, M., NANOPOU- LOS, A., NESHEIM, W., MILNE, E. D., AND WHEELER, R. sfs: A Parallel File System for the CM-5. In Proceedings of the 1993 Summer Usenix Conference (1993), pp. 291-305.
• 12: REEDD, D. A., AYDT, R. A., NOE, R. J., ROTH, P. C., SHIELDS, K. A., SCHWARTZ, B. W., AND TAVERA, L. F. Scalable Performance Analysis: The Pablo Performance Analysis Environment. In Proceedings of the Scalable Parallel Libraries Conference (1993), A. Skjellum, Ed., IEEE Computer Society.
• 13: THINKING MA- CHINES CORPORATION. CMMD Reference Manual Version, 3.0 Beta, Dec 1992.
• 14: THINKING MACHINES CORPORATION. CM- 5 I/O System Programming Guide, Version 7.2, September 1993.
• 15: THINKING MACHINES CORPORATION. CM Fortran Utility Library Reference Manual, Version 2.0 Beta, January 1993.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS

General Terms:
Design, Measurement, Performance, Theory