The design and implementation of SOLAR, a portable library for scalable out-of-core linear algebra computations

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

The design and implementation of SOLAR, a portable library for scalable out-of-core linear algebra computations

Full text

Pdf (1.63 MB)

Source

Workshop on I/O in Parallel and Distributed Systems archive
Proceedings of the fourth workshop on I/O in parallel and distributed systems: part of the federated computing research conference table of contents

Philadelphia, Pennsylvania, United States

Pages: 28 - 40

Year of Publication: 1996

ISBN:0-89791-813-4

Authors

Sivan Toledo	IBM T.J. Watson Research Center
Fred G. Gustavson	IBM T.J. Watson Research Center

Sponsors

SIGACT: ACM Special Interest Group on Algorithms and Computation Theory
SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS\TCOS : TC on Operating Systems & Application Environments
SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 3, Downloads (12 Months): 30, Citation Count: 22

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/236017.236029 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	T. Agerwala , J. L. Martin , J. H. Mirza , D. C. Sadler , D. M. Dias, SP2 system architecture, IBM Systems Journal, v.34 n.2, p.152-184, 1995
	2	E. Anderson , Z. Bai , C. Bischof , J. Demmel , J. Dongarra , J. Du Croz , A. Greenbaum , S. Hammarling , A. McKenney , S. Ostrouchov , D. Sorensen, LAPACK's user's guide, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1992
	3	D.W. Barron and H. P. F. Swinnerton-Dyerm. Solution of simultaneous linear equations using a magnetic tape store. Computer Journal, 3:28-33, 1960.
	4	Jean-Philippe Brunet, Palle Pedersen, and S. Lennart Johnsson. Load-balanced LU and QR factor and solve routines for scalable processors with scalable I/O. In Proceedings of the 17th IMA CS World Congress, Atlanta, Georgia, July 1994. Also available as Harvard University Computer Science Technical Report TR-20- 94.
	5	J. Choi , J. Dongarra , S. Ostrouchov , A. Petitet , D. Walker, A Proposal for a Set of Parallel Basic Linear Algebra Subprograms, University of Tennessee, Knoxville, TN, 1995
	6	Jaeyoung Choi , Jack J. Dongarra , Roldan Pozo , David W. Walker, LAPACK Working Note 55: ScaLAPACK: A Scalable Linear Algebra Library for Distributed Memory Concurrent Computers, University of Tennessee, Knoxville, TN, 1992
	7	P. F. Corbett , D. G. Feltelson , J.-P. Prost , G. S. Almasi , S. J. Baylor , A. S. Bolmarcich , Y. Hsu , J. Satran , M. Snir , R. Colao , B. D. Herr , J. Kavaky , T. R. Morgan , A. Ziotek, Parallel file systems for the IBM SP computers, IBM Systems Journal, v.34 n.2, p.222-248, 1995
	8	Thomas H. Cormen , David Kotz, Integrating Theory and Practice in Parallel File Systems, Dartmouth College, Hanover, NH, 1993
	9	J. J. Dongarra , Jeremy Du Croz , Sven Hammarling , I. S. Duff, A set of level 3 basic linear algebra subprograms, ACM Transactions on Mathematical Software (TOMS), v.16 n.1, p.1-17, March 1990 [doi>10.1145/77626.79170]
	10	Jack J. Dongarra , Jeremy Du Croz , Sven Hammarling , Richard J. Hanson, An extended set of FORTRAN basic linear algebra subprograms, ACM Transactions on Mathematical Software (TOMS), v.14 n.1, p.1-17, March 1988 [doi>10.1145/42288.42291]
	11	J. J. Du Croz , S. M. Nugent , J. K. Reid , D. B. Taylor, Solving Large Full Sets of Linear Equations in a Paged Virtual Store, ACM Transactions on Mathematical Software (TOMS), v.7 n.4, p.527-536, Dec. 1981 [doi>10.1145/355972.355980]
	12	Charbel Farhat. Large out-of-core calculation runs on the IBM SP2. NAS News, 2(11), August 1995.
	13	Nikolaus Geers and Roland Klees. Out-of-core solver for large dense nonsymmet:dc linear systems. Manuscripta Geodetica, 18(6):331-342, 1993.
	14	Roger G. Grimes , Horst D. Simon, Solution of large, dense symmetric generalized eigenvalue problems using secondary storage, ACM Transactions on Mathematical Software (TOMS), v.14 n.3, p.241-256, Sept. 1988 [doi>10.1145/44128.44130]
	15	Kenneth Klimkowski and Robert van de Geijn. Anatomy of an out-of-core dense linear solver. In Proceedings of the 1995 International Conference on Parallel Processing, 1995. To appear.
	16	D. Kotz, Disk-directed I/O for an out-of-core computation, Proceedings of the Fourth IEEE International Symposium on High Performance Distributed Computing - HPDC '95, p.159, August 02-04, 1995
	17	C. L. Lawson , R. J. Hanson , D. R. Kincaid , F. T. Krogh, Basic Linear Algebra Subprograms for Fortran Usage, ACM Transactions on Mathematical Software (TOMS), v.5 n.3, p.308-323, Sept. 1979 [doi>10.1145/355841.355847]
	18	David A. Patterson , John L. Hennessy, Computer architecture: a quantitative approach, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1990
	19	Hans Riesel. A note on large linear systems. Mathematical Tables and Other Aids to Computation, 10:226--227, 1956.
	20	H. Rubinstein , J. D. Rutledge, High order matrix computations on the UNIVAC, Proceedings of the 1952 ACM national meeting (Pittsburgh), p.181-186, May 02-02, 1952, Pittsburgh, Pennsylvania [doi>10.1145/609784.609807]
	21	Joseph Rutledge and Harvey Rubinstein. Matrix algebra programs for the UNIVAC. Presented at the Wayne Conference on Automatic Computing Machinery and Applications, March 1951.
	22	M. M. Stabrowski. A block equation solver for large un#symmetric linear equation systems with dense coefficient matrices. International Journal for Numerical Methods in Engineering, 24:289-300, 1982.
	23	Rajeev Thakur and Alok Choudhary. An extended two-phase method for accessing sections of out-of-core arrays. Technical Report CACR-103, Scalable I/O Initiative, Center for Adwmced Computing Research, Caltech, June 1995. Submitted to a special issue of Scientific Programming on implementations of HPF.
	24	Sivan Toledo. Locality of reference in LU decomposition with partial pivoting. Technical Report RC20344, IBM T.J. Watson Research Center, Yorktown Heights, NY, January 1996.
	25	David Womble, David Greenberg, Stephen Wheat, and Rolf Riesen. Beyond core: Making parallel computer I/O practical. In Proceeings of the 1993 DAGS/PC Symposium, pages 56-63, Hanover, NH, June 1993. Dartmouth Institute for Advanced Graduate Studies. Also available online from ht tp: //www. cs. sandia, gov/~dewombl.

CITED BY 22

	X. Shen , W. Liao , A. Choudhary , G. Memik , M. Kandemir , S. More , G. Thiruvathukal , A. Singh, A novel application development environment for large-scale scientific computations, Proceedings of the 14th international conference on Supercomputing, p.274-283, May 08-11, 2000, Santa Fe, New Mexico, United States
	Jeffrey Scott Vitter, External memory algorithms, Proceedings of the seventeenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.119-128, June 01-04, 1998, Seattle, Washington, United States
	Nils Nieuwejaar , David Kotz, The galley parallel file system, Proceedings of the 10th international conference on Supercomputing, p.374-381, May 25-28, 1996, Philadelphia, Pennsylvania, United States
	Emilia Rosti , Giuseppe Serazzi , Evgenia Smirni , Mark S. Squillante, Models of Parallel Applications with Large Computation and I/O Requirements, IEEE Transactions on Software Engineering, v.28 n.3, p.286-307, March 2002
	Meenakshi A. Kandaswamy , Mahmut Kandemir , Alok Choudhary , David Bernholdt, An Experimental Evaluation of I/O Optimizations on Different Applications, IEEE Transactions on Parallel and Distributed Systems, v.13 n.7, p.728-744, July 2002
	Rajesh Bordawekar, Implementation of collective I/O in the Intel Paragon parallel file system: initial experiences, Proceedings of the 11th international conference on Supercomputing, p.20-27, July 07-11, 1997, Vienna, Austria
	Jack Dongarra , Ian Foster , Geoffrey Fox , William Gropp , Ken Kennedy , Linda Torczon , Andy White, References, Sourcebook of parallel computing, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2003
	David Kotz, Disk-directed I/O for MIMD multiprocessors, ACM Transactions on Computer Systems (TOCS), v.15 n.1, p.41-74, Feb. 1997
	Mahmut Kandemir, Compiler-Directed Collective-I/O, IEEE Transactions on Parallel and Distributed Systems, v.12 n.12, p.1318-1331, December 2001
	Anshul Gupta , Fred G. Gustavson , Mahesh Joshi , Sivan Toledo, The design, implementation, and evaluation of a symmetric banded linear solver for distributed-memory parallel computers, ACM Transactions on Mathematical Software (TOMS), v.24 n.1, p.74-101, March 1998
	Meenakshi A. Kandaswamy , Mahmut Kandemir , Alok Choudhary , David Bernholdt, An Experimental Evaluation of I/O Optimizations on Different Applications, IEEE Transactions on Parallel and Distributed Systems, v.13 n.12, p.1303-1319, December 2002
	Sivan Toledo , Eran Rabani, Very large electronic structure calculations using an out-of-core filter-diagonalization method, Journal of Computational Physics, v.180 n.1, p.256-269, July 20, 2002
	Mahmut Kandemir , Alok Choudhary , J. Ramanujam, An I/O-Conscious Tiling Strategy for Disk-Resident Data Sets, The Journal of Supercomputing, v.21 n.3, p.257-284, March 2002
	Eddy Caron , Gil Utard, On the performance of parallel factorization of out-of-core matrices, Parallel Computing, v.30 n.3, p.357-375, March 2004
	Brian C. Gunter , Robert A. Van De Geijn, Parallel out-of-core computation and updating of the QR factorization, ACM Transactions on Mathematical Software (TOMS), v.31 n.1, p.60-78, March 2005
	Xiaoyang Gao , Swarup Kumar Sahoo , Chi-Chung Lam , J. Ramanujam , Qingda Lu , Gerald Baumgartner , P. Sadayappan, Performance modeling and optimization of parallel out-of-core tensor contractions, Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, June 15-17, 2005, Chicago, IL, USA
	Vladimir Rotkin , Sivan Toledo, The design and implementation of a new out-of-core sparse cholesky factorization method, ACM Transactions on Mathematical Software (TOMS), v.30 n.1, p.19-46, March 2004
	Enrique S. Quintana-Ortí , Robert A. Van De Geijn, Updating an LU Factorization with Pivoting, ACM Transactions on Mathematical Software (TOMS), v.35 n.2, p.1-16, July 2008
	Gokhan Memik , Mahmut T. Kandemir , Wei-Keng Liao , Alok Choudhary, Multicollective I/O: A technique for exploiting inter-file access patterns, ACM Transactions on Storage (TOS), v.2 n.3, p.349-369, August 2006
	Murali Vilayannur , Anand Sivasubramaniam , Mahmut Kandemir , Rajeev Thakur , Robert Ross, Discretionary Caching for I/O on Clusters, Cluster Computing, v.9 n.1, p.29-44, January 2006
	David Kotz , Nils Nieuwejaar, Flexibility and performance of parallel file systems, ACM SIGOPS Operating Systems Review, v.30 n.2, p.63-73, April 1996
	A. Choudhary , M. Kandemir , J. No , G. Memik , X. Shen , W. Liao , H. Nagesh , S. More , V. Taylor , R. Thakur , R. Stevens, Data management for large-scale scientific computations in high performance distributed systems, Cluster Computing, v.3 n.1, p.45-60, 2000