Advanced collective communication in aspen

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Advanced collective communication in aspen

Full text

Pdf (496 KB)

Source

International Conference on Supercomputing archive
Proceedings of the 22nd annual international conference on Supercomputing table of contents

Island of Kos, Greece

SESSION: Communication & synchronization 1 table of contents

Pages 83-93

Year of Publication: 2008

ISBN:978-1-60558-158-3

Authors

Qasim Ali	Purdue University, West Lafayette, IN, USA
Vijay S. Pai	Purdue University, West Lafayette, IN, USA
Samuel P. Midkiff	Purdue University, West Lafayette, IN, USA

Sponsors

ACM: Association for Computing Machinery
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 5, Downloads (12 Months): 59, Citation Count: 0

Additional Information:

abstract references index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1375527.1375543 What is a DOI?

ABSTRACT

Aspen is a programming language that relies on high-level messaging to support communication among different program tasks executing in parallel. Unlike MPI, the computational logic of Aspen tasks is specified and developed independently of the global communication structure of the program. A root module specifies the communication structure of the program. The semantics and generality of these specifications enable novel forms of collective communication, including asynchronous and concurrent collective operations and reduction type operations with subsets of the participants being receivers of the reduced data, and with receivers that do not provide data to the reduction. This paper describes efficient implementations of these and other collective communication operations in Aspen. We demonstrate the ease-of-use of these features using several code examples and quantify their performance impact through both microbenchmarks and a quantum chemistry code used in rubber chemistry. Aspen's performance is competitive with, or slightly better than, the performance of MPI implementations for both the chemistry application and the microbenchmarks.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	29th TOP500 List, June 2007.
	2	K. Arvind , Rishiyur S. Nikhil, Executing a Program on the MIT Tagged-Token Dataflow Architecture, IEEE Transactions on Computers, v.39 n.3, p.300-318, March 1990 [doi>10.1109/12.48862]
	3	Robert D. Blumofe , Christopher F. Joerg , Bradley C. Kuszmaul , Charles E. Leiserson , Keith H. Randall , Yuli Zhou, Cilk: an efficient multithreaded runtime system, Proceedings of the fifth ACM SIGPLAN symposium on Principles and practice of parallel programming, p.207-216, July 19-21, 1995, Santa Barbara, California, United States
	4	Ron Brightwell , Sue P. Goudy , Arun Rodrigues , Keith D. Underwood, Implications of application usage characteristics for collective communication offload, International Journal of High Performance Computing and Networking, v.4 n.3/4, p.104-116, August 2006 [doi>10.1504/IJHPCN.2006.010633]
	5	Ian Buck , Tim Foley , Daniel Horn , Jeremy Sugerman , Kayvon Fatahalian , Mike Houston , Pat Hanrahan, Brook for GPUs: stream computing on graphics hardware, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
	6	Brendan Burns , Kevin Grimaldi , Alexander Kostadinov , Emery D. Berger , Mark D. Corner, Flux: a language for programming high-performance servers, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, p.13-13, May 30-June 03, 2006, Boston, MA
	7	Nicholas Carriero , David Gelernter, Linda in context, Communications of the ACM, v.32 n.4, p.444-458, April 1989 [doi>10.1145/63334.63337]
	8	E. W. Chan , M. F. Heimlich , A. Purkayastha , R. A. van de Geijn, On optimizing collective communication, Proceedings of the 2004 IEEE International Conference on Cluster Computing, p.145-155, September 20-23, 2004
	9	Ernie Chan , Robert van de Geijn , William Gropp , Rajeev Thakur, Collective communication on architectures that support simultaneous communication over multiple links, Proceedings of the eleventh ACM SIGPLAN symposium on Principles and practice of parallel programming, March 29-31, 2006, New York, New York, USA [doi>10.1145/1122971.1122975]
	10	M. S. DeBergalis. A parallel file I/O API for Cilk. Master's thesis, Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science, May 2000.
	11	A. Goyal, J. Cao, P. Patkar, G. Medvedev, S. P. Midkiff, V. Venkatasubramanian, and J. M. Caruthers. Population balance kinetic model for interaction of 2-bisbenzothiazole-2-2 disulfide (mbts) with sulfur. Rubber Chemistry and Technology , 2007. In press.
	12	J. Gurd and W. Bohm. Implicit parallel processing: SISAL on the Manchester dataflow computer. In Proceedings of the IBM-Europe Institute on Parallel Programming, Aug. 1987.
	13	Anthony Danalis , Ki-Yong Kim , Lori Pollock , Martin Swany, Transformations to Parallel Codes for Communication-Computation Overlap, Proceedings of the 2005 ACM/IEEE conference on Supercomputing, p.58, November 12-18, 2005 [doi>10.1109/SC.2005.75]
	14	Torsten Hoefler , Andrew Lumsdaine , Wolfgang Rehm, Implementation and performance analysis of non-blocking collective operations for MPI, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada [doi>10.1145/1362622.1362692]
	15	J. Hoeflinger. Extending OpenMP to clusters, 2006.
	16	http://cachewww.intel.com/cd/00/00/28/58/285865/285865.pdf , last checked Oct. 8, 2007.
	17	Ken Kennedy , Charles Koelbel , Hans Zima, The rise and fall of High Performance Fortran: an historical object lesson, Proceedings of the third ACM SIGPLAN conference on History of programming languages, p.7-1-7-22, June 09-10, 2007, San Diego, California [doi>10.1145/1238844.1238851]
	18	Charles Koelbel, An overview of High Performance Fortran, ACM SIGPLAN Fortran Forum, v.11 n.4, p.9-16, Dec. 1992 [doi>10.1145/140734.140736]
	19	David L. Kuck, Structure of Computers and Computations, John Wiley & Sons, Inc., New York, NY, 1978
	20	Robert W. Numrich , John Reid, Co-array Fortran for parallel programming, ACM SIGPLAN Fortran Forum, v.17 n.2, p.1-31, Aug. 1998 [doi>10.1145/289918.289920]
	21	Jelena Pješivac-Grbović , Thara Angskun , George Bosilca , Graham E. Fagg , Edgar Gabriel , Jack J. Dongarra, Performance analysis of MPI collective operations, Cluster Computing, v.10 n.2, p.127-143, June 2007 [doi>10.1007/s10586-007-0012-0]
	22	R. Rabenseifner. Optimization of Collective Reduction Operations. In Proceedings of the International Conference on Computational Science , June 2004.
	23	R. Thakur and W. Gropp. Improving the performance of collective operations in mpich. In 10th European PVM/MPI Users Group Conference (Euro PVN/MPI 2003) , September 2003.
	24	Gautam Upadhyaya , Vijay S. Pai , Samuel P. Midkiff, Expressing and exploiting concurrency in networked applications with aspen, Proceedings of the 12th ACM SIGPLAN symposium on Principles and practice of parallel programming, March 14-17, 2007, San Jose, California, USA [doi>10.1145/1229428.1229433]
	25	UPC Consortium. UPC Language Specification (Version 1.2), June 2005.
	26	N. Harvey and J. Morris. NL: A general purpose visual dataflow language. Australian Computer Journal, 12(1):2--12, 199622, 2007.
	27	C. A. R. Hoare, Communicating sequential processes, Communications of the ACM, v.21 n.8, p.666-677, Aug. 1978 [doi>10.1145/359576.359585]
	28	Roberto Salama , Wentai Liu , Ronald S. Gyurcsik, Software experience with concurrent C and LISP in a distributed system, Proceedings of the 1988 ACM sixteenth annual conference on Computer science, p.329-334, February 1988, Atlanta, Georgia, United States [doi>10.1145/322609.322662]
	29	William Thies , Michal Karczmarek , Saman P. Amarasinghe, StreamIt: A Language for Streaming Applications, Proceedings of the 11th International Conference on Compiler Construction, p.179-196, April 08-12, 2002
	30	William Thies , Michal Karczmarek , Janis Sermulins , Rodric Rabbah , Saman Amarasinghe, Teleport messaging for distributed stream programs, Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, June 15-17, 2005, Chicago, IL, USA [doi>10.1145/1065944.1065975]
	31	P. H. Welch, An OCCAM approach to transputer engineering, Proceedings of the third conference on Hypercube concurrent computers and applications: Architecture, software, computer systems, and general issues, p.138-147, January 19-20, 1988, Pasadena, California, United States [doi>10.1145/62297.62315]
	32	Matt Welsh , David Culler , Eric Brewer, SEDA: an architecture for well-conditioned, scalable internet services, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
	33	Torsten Hoefler , Peter Gottschling , Andrew Lumsdaine , Wolfgang Rehm, Optimizing a conjugate gradient solver with non-blocking collective operations, Parallel Computing, v.33 n.9, p.624-633, September, 2007 [doi>10.1016/j.parco.2007.06.006]
	34	Jun Cao and Ayush Goyal and Samuel P. Midkiff and James M. Caruthers An Optimizing Compiler for Parallel Chemistry Simulations In 21th International Parallel and Distributed Processing Symposium (IPDPS 2007).