Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark

Full text

Pdf (682 KB)

Source

Conference on High Performance Networking and Computing archive
Proceedings of the 2008 ACM/IEEE conference on Supercomputing - Volume 00 table of contents

Austin, Texas

SECTION: Papers table of contents

Article No. 42

Year of Publication: 2008

ISBN:978-1-4244-2835-9

Authors

Hongzhang Shan	Lawrence Berkeley National Laboratory, Berkeley, CA
Katie Antypas	Lawrence Berkeley National Laboratory, Berkeley, CA
John Shalf	Lawrence Berkeley National Laboratory, Berkeley, CA

Publisher

IEEE Press Piscataway, NJ, USA

Bibliometrics

Downloads (6 Weeks): 51, Downloads (12 Months): 221, Citation Count: 1

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

ABSTRACT

The unprecedented parallelism of new supercomputing platforms poses tremendous challenges to achieving scalable performance for I/O intensive applications. Performance assessments using traditional I/O system and component benchmarks are difficult to relate back to application I/O requirements. However, the complexity of full applications motivates development of simpler synthetic I/O benchmarks as proxies to the full application. In this paper we examine the I/O requirements of a range of HPC applications and describe how the LLNL IOR synthetic benchmark was chosen as suitable proxy for the diverse workload. We show a procedure for selecting IOR parameters to match the I/O patterns of the selected applications and show it can accurately predict the I/O performance of the full applications. We conclude that IOR is an effective replacement for full-application I/O benchmarks and can bridge the gap of understanding that typically exists between stand-alone benchmarks and the full applications they intend to model.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	K. Antypas, A. C. Calder, A. Dubey, R. Fisher, M. K. Ganapathy, J. B. Gallagher, L. B. Reid, K. Reid, K. Riley, D. Sheeler, and N. Taylor. Scientific applications on the massively parallel BG/L machines. http://ww1.ucmss.com/books/LFS/CSREA2006/PDP4125.pdf.
	2	Julian Borrill , Leonid Oliker , John Shalf , Hongzhang Shan, Investigation of leading HPC I/O performance using a scientific-application derived benchmark, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada [doi>10.1145/1362622.1362636]
	3	A. Ching, A. Choudhary, W. Liao, R. Ross, and W. Gropp. Efficient structured data access in parallel file systems. In Cluster 2003 Conference, Dec 4, 2003.
	4	FLASH3 code. http://flash.uchicago.edu/.
	5	FLASH2 io-benchmark. http://www.astro.sunysb.edu/mzingale/software/.
	6	High-performance I/O. http://cholera.ece.northwestern.edu/~aching/research_webpage/hpio.html.
	7	The ASCI I/O stress benchmark. https://computing.llnl.gov/?set=code&page=sio_downloads.
	8	IOzone file system benchmark. http://www.iozone.org.
	9	MADBench2. https://crd.lbl.gov/~borrill/MADbench2/.
	10	R. McDougall and J. Mauro. FileBench. http://www.solarisinternals.com/si/tools/filebench.
	11	The PIORAW Test. http://www.nersc.gov/nusers/systems/bassi/code_profiles.php.
	12	Rolf Rabenseifner , Alice E. Koniges, Effective File-I/O Bandwidth Benchmark, Proceedings from the 6th International Euro-Par Conference on Parallel Processing, p.1273-1283, August 29-September 01, 2000
	13	H. Shan and J. Shalf. Using IOR to analyze the I/O performance of HPC platforms. In Cray Users Group Meeting (CUG) 2007, Seattle, Washington, May 7--10, 2007.
	14	SPIOBENCH: Streaming Parallel I/O Benchmark. http://www.nsf.gov/pubs/2006/nsf0605/spiobench.tar.gz, 2005.
	15	MPI-Tile-I/O. http://www-unix.mcs.anl.gov/pio-benchmark/.
	16	VORPAL, versatile plasma simulation code. http://www.txcorp.com/products/VORPAL/.
	17	P. Wong and R. F. Wijngaart. NAS parallel benchmarks I/O version 2.4. In Technical Report NAS-03-002, Computer Sciences Corporation, NASA Arms Research Center, Moffett Field, CA 94035--1000, Jan, 2003.