Parallel simulation of parallel file systems and I/O programs

ABSTRACT

Efficient I/O implementations can have a significant impact on the performance of parallel applications. This paper describes the design and implementation of PIOSIM, a parallel simulation library for MPI-IO programs. The simulator can be used to predict the performance of existing MPI-IO programs as a function of architectural characteristics, caching algorithms, and alternative implementations of collective I/O operations. This paper describes the simulator and presents the results of a number of performance studies to evaluate the impact of the preceding factors on a set of MPI-IO benchmarks, including programs from the NAS benchmark suite.

REFERENCES

• 1: {BBB94} Sandra Johnson Baylor, Caroline Benveniste, and Leo J. Beolhouwer. A methodology for evaluating parallel I/O performance for massively parallel processors. In Proceedings of the 27th Annual Simulation Symposium, pages 31-40, April 1994.
• 2: {BBH96} Sandra Johnson Baylor, Caroline Benveniste, and Yarsun Hsu. Performance evaluation of a massively parallel I/O subsystem. In Ravi Jain, John Werth, and James C. Browne, editors, Input/Output in Parallel and Distributed Computer Systems, volume 362 of The Kluwer International Series in Engineering and Computer Science, chapter 13, pages 293-311. Kluwer Academic Publishers, 1996.
• 3: E. A. Brewer , C. N. Dellarocas , A. Colbrook , W. E. Weihl, PROTEUS: A HIGH-PERFORMANCE PARALLEL-ARCHITECTURE SIMULATOR, Massachusetts Institute of Technology, Cambridge, MA, 1991
• 4: {BHS+95} D. Bailey, T. Harris, W. Saphir, R. v. d. Wijngaart, A. Woo, and M. Yarrow. The nas parallel benchmarks 2.0. Technical report nas-95-020, NASA Ames Research Center, Moffet Field, CA 94035-1000, December 1995.
• 5: {CDJ+91} R. G. Covington, S. Dwarkadas, J. R. Jump, J. B. Sinclair, and S. Madala. The efficient simulation of parallel computer systems. International Journal in Computer Simulation, 1:31-58, 1991.
• 6: Peter F. Corbett , Dror G. Feitelson, The Vesta parallel file system, ACM Transactions on Computer Systems (TOCS), v.14 n.3, p.225-264, Aug. 1996 [doi>10.1145/233557.233558]
• 7: P. F. Corbett , D. G. Feltelson , J.-P. Prost , G. S. Almasi , S. J. Baylor , A. S. Bolmarcich , Y. Hsu , J. Satran , M. Snir , R. Colao , B. D. Herr , J. Kavaky , T. R. Morgan , A. Ziotek, Parallel file systems for the IBM SP computers, IBM Systems Journal, v.34 n.2, p.222-248, 1995
• 8: Toni Cortes , Sergi Girona , Jesús Labarta, Avoiding the Cache-Coherence Problem in a Parallel/Distributed File System, Proceedings of the International Conference and Exhibition on High-Performance Computing and Networking, p.860-869, April 28-30, 1997
• 9: Juan Miguel del Rosario , Rajesh Bordawekar , Alok Choudhary, Improved parallel I/O via a two-phase run-time access strategy, ACM SIGARCH Computer Architecture News, v.21 n.5, p.31-38, Dec. 1993 [doi>10.1145/165660.165667]
• 10: {DGH91} H. Davis, S. R. Goldschmidt, and Hennessey. Multiprocessor simulation and tracing using Tango. In Proceedings of the 1991 International Conference on Parallel Processing (ICPP'91), pages II99-II107, August 1991.
• 11: Phillip M. Dickens , Philip Heidelberger , David M. Nicol, A distributed memory LAPSE: parallel simulation of message-passing programs, Proceedings of the eighth workshop on Parallel and distributed simulation, p.32-38, July 06-08, 1994, Edinburgh, Scotland, United Kingdom
• 12: {DWAP94} M. D. Dahlin, R. Y. Wang, T. E. Anderson, and D. A. Patterson. Cooperative Caching: Using Remote Client Memory to Improve File System Performance. In Proceedings of the 1994 Symposium on Operating Systems Design and Implementation, pages 61-74, November 1994.
• 13: CORPORATE The MPI Forum, MPI: a message passing interface, Proceedings of the 1993 ACM/IEEE conference on Supercomputing, p.878-883, December 1993, Portland, Oregon, United States [doi>10.1145/169627.169855]
• 14: David Kotz, Tuning STARFISH, Dartmouth College, Hanover, NH, 1996
• 15: David Kotz, Disk-directed I/O for MIMD multiprocessors, ACM Transactions on Computer Systems (TOCS), v.15 n.1, p.41-74, Feb. 1997 [doi>10.1145/244764.244766]
• 16: Ulana Legedza , William E. Weihl, Reducing synchronization overhead in parallel simulation, Proceedings of the tenth workshop on Parallel and distributed simulation, p.86-95, May 22-24, 1996, Philadelphia, Pennsylvania, United States
• 17: {MPI96} MPI-IO: a parallel file I/O interface for MPI. The MPI-IO Committee, April 1996. Version 0.5. See WWW http://lovelace.nas.nasa.gov/MPI-IO/mpi-io-report.0.5.ps.
• 18: {Nit92} Bill Nitzberg. Performance of the iPSC/860 Concurrent File System. Technical Report RND-92-020, NAS Systems Division, NASA Ames, December 1992.
• 19: Nils Nieuwejaar , David Kotz, The galley parallel file system, Proceedings of the 10th international conference on Supercomputing, p.374-381, May 25-28, 1996, Philadelphia, Pennsylvania, United States [doi>10.1145/237578.237639]
• 20: S. A. Fineberg , P. Wong , B. Nitzberg , C. Kuszmaul, PMPIO - A Portable Implementation of MPI-IO, Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation, p.188, March 27-31, 1996
• 21: {Pra96} Sundeep Prakash. Performance Prediction of Parallel Programs. Ph.d. dissertation, Computer Science Dept, UCLA, Los Angeles, CA, November 1996.
• 22: Steven K. Reinhardt , Mark D. Hill , James R. Larus , Alvin R. Lebeck , James C. Lewis , David A. Wood, The Wisconsin Wind Tunnel: virtual prototyping of parallel computers, Proceedings of the 1993 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.48-60, May 10-14, 1993, Santa Clara, California, United States
• 23: K. E. Seamons , Y. Chen , P. Jones , J. Jozwiak , M. Winslett, Server-directed collective I/O in Panda, Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM), p.57-es, December 04-08, 1995, San Diego, California, United States [doi>10.1145/224170.224371]
• 24: {SPB96} Darren Sanders, Yoonho Park, and Maciej Brodowicz. Implementation and performance of MPI-IO file access using MPI datatypes. Technical Report UH-CS-96-12, University of Houston, November 1996.