MPI-IO/GPFS, an optimized implementation of MPI-IO on top of GPFS

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

MPI-IO/GPFS, an optimized implementation of MPI-IO on top of GPFS

Full text

Pdf (168 KB)

Source

Conference on High Performance Networking and Computing archive
Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM) table of contents

Denver, Colorado

Pages: 17 - 17

Year of Publication: 2001

ISBN:1-58113-293-X

Authors

Jean-Pierre Prost	IBM T.J. Watson Research Center, Yorktown Heights, NY
Richard Treumann	IBM Poughkeepsie, Poughkeepsie, NY
Richard Hedges	Lawrence Livermore National Laboratory, Livermore, CA
Bin Jia	IBM Poughkeepsie, Poughkeepsie, NY
Alice Koniges	Lawrence Livermore National Laboratory, Livermore, CA

Sponsors

ACM: Association for Computing Machinery
SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS\DATC : IEEE Computer Society

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 5, Downloads (12 Months): 53, Citation Count: 11

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/582034.582051 What is a DOI?

ABSTRACT

MPI-IO/GPFS is an optimized prototype implementation of the I/O chapter of the Message Passing Interface (MPI) 2 standard. It uses the IBM General Parallel File System (GPFS) Release 3 as the underlying file system. This paper describes optimization features of the prototype that take advantage of new GPFS programming interfaces. It also details how collective data access operations have been optimized by minimizing the number of messages exchanged in sparse accesses and by increasing the overlap of communication with file access. Experimental results show a performance gain. A study of the impact of varying the number of tasks running on the same node is also presented.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	{Mpif-97} Message Passing Interface Forum, MPI-2: Extensions to the Message-Passing Interface, July 18, 1997. http://www.mpi-forum.org/docs/docs.html.
	2	{GPFS-00} IBM General Parallel File System for AIX: Installation and Administration Guide, IBM Document SA22-7278-03, July 2000. http://www.rs6000.ibm.com/resource/aix_resource/sp_books/gpfs/insta ll_admin/install_admin_v1r/gpfs1mst.html.
	3	Jean-Pierre Prost , Richard Treumann , Richard Hedges , Alice E. Koniges , Alison White, Towards a High-Performance Implementation of MPI-IO on Top of GPFS, Proceedings from the 6th International Euro-Par Conference on Parallel Processing, p.1253-1262, August 29-September 01, 2000
	4	Rajeev Thakur , William Gropp , Ewing Lusk, Data Sieving and Collective I/O in ROMIO, Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation, p.182, February 21-25, 1999
	5	Rajeev Thakur , William Gropp , Ewing Lusk, On implementing MPI-IO portably and with high performance, Proceedings of the sixth workshop on I/O in parallel and distributed systems, p.23-32, May 05-05, 1999, Atlanta, Georgia, United States [doi>10.1145/301816.301826]

CITED BY 11

	H. Wang , S. Parthasarathy , A. Ghoting , S. Tatikonda , G. Buehrer , T. Kurc , J. Saltz, Design of a next generation sampling service for large scale data analysis applications, Proceedings of the 19th annual international conference on Supercomputing, June 20-22, 2005, Cambridge, Massachusetts
	Wei-Keng Liao , Kenin Coloma , Alok Choudhary , Lee Ward, Cooperative Client-Side File Caching for MPI Applications, International Journal of High Performance Computing Applications, v.21 n.2, p.144-154, May 2007
	Avery Ching , Wei-keng Liao , Alok Choudhary , Robert Ross , Lee Ward, Noncontiguous locking techniques for parallel file systems, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada
	Robert Latham , Robert Ross , Rajeev Thakur, Implementing MPI-IO Atomic Mode and Shared File Pointers Using MPI One-Sided Communication, International Journal of High Performance Computing Applications, v.21 n.2, p.132-143, May 2007
	Wei-keng Liao , Avery Ching , Kenin Coloma , Arifa Nisar , Alok Choudhary , Jacqueline Chen , Ramanan Sankaran , Scott Klasky, Using MPI file caching to improve parallel write performance for large-scale scientific applications, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada
	Joachim Worringen , Jesper Larsson Traff , Hubert Ritzdorf, Fast Parallel Non-Contiguous File Access, Proceedings of the 2003 ACM/IEEE conference on Supercomputing, p.60, November 15-21, 2003
	Yu-Heng Tseng , Chris Ding, Efficient Parallel I/O in Community Atmosphere Model (CAM), International Journal of High Performance Computing Applications, v.22 n.2, p.206-218, May 2008
	David E. Singh , Florin Isaila , Juan C. Pichel , Jesús Carretero, A collective I/O implementation based on inspector---executor paradigm, The Journal of Supercomputing, v.47 n.1, p.53-75, January 2009
	Wei-keng Liao , Alok Choudhary, Dynamically adapting file domain partitioning methods for collective I/O based on underlying parallel file system locking protocols, Proceedings of the 2008 ACM/IEEE conference on Supercomputing, November 15-21, 2008, Austin, Texas
	Ramya Prabhakar , Christina Patrick , Mahmut Kandemir, MPISec I/O: Providing Data Confidentiality in MPI-I/O, Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, p.388-395, May 18-21, 2009
	Florin Isaila , Javier Garcia Blas , Jesus Carretero , Robert Latham , Samuel Lang , Robert Ross, Latency Hiding File I/O for Blue Gene Systems, Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, p.212-219, May 18-21, 2009