Adaptive performance prediction for distributed data-intensive applications

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Adaptive performance prediction for distributed data-intensive applications

Full text

Pdf (292 KB)

Source

Conference on High Performance Networking and Computing archive
Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM) table of contents

Portland, Oregon, United States

Article No. 36

Year of Publication: 1999

ISBN:1-58113-091-0

Authors

Marcio Faerman	Department of Computer Science and Engineering, University of California, San Diego, La Jolla, CA
Alan Su	Department of Computer Science and Engineering, University of California, San Diego, La Jolla, CA
Richard Wolski	Department of Computer Science, University of Tennessee, Knoxville, TN
Francine Berman	Department of Computer Science and Engineering, University of California, San Diego, La Jolla, CA

Sponsors

IEEE-CS\TCCA : TC on Computer Arhitecture
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 6, Downloads (12 Months): 22, Citation Count: 14

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/331532.331568 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Alexandria Digital Library Project webpage at http://alexandria.sdc.ucsb.edu/.
	2	Art museum image consortium (amico) webpage at http://www.amico.org/home.html and http://www.npaci.edu/DICE/AMICO/.
	3	A. Amoroso , K. Marzullo , A. Ricciardi, Wide-Area Nile: A Case Study of a Wide-Area Data-Parallel Application, Proceedings of the The 18th International Conference on Distributed Computing Systems, p.506, May 26-29, 1998
	4	Daniel Andresen , Tao Yang , Oscar H. Ibarra , Ömer Eğecioǧlu, Adaptive partitioning and scheduling for enhancing WWW application performance, Journal of Parallel and Distributed Computing, v.49 n.1, p.57-85, Feb. 1998 [doi>10.1006/jpdc.1998.1423]
	5	AppLeS webpage at http://www-cse.ucsd.edu/groups/hpcl/ apples.
	6	Chaitanya Baru , Reagan Moore , Arcot Rajasekar , Michael Wan, The SDSC storage resource broker, Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research, p.5, November 30-December 03, 1998, Toronto, Ontario, Canada
	7	S. Basu, A. Mukherjee, and S. Klivansky. Time Series Models for Internet Traffic. IEEE Comput. Soc. Press, 1996.
	8	Francine D. Berman , Rich Wolski , Silvia Figueira , Jennifer Schopf , Gary Shao, Application-level scheduling on distributed heterogeneous networks, Proceedings of the 1996 ACM/IEEE conference on Supercomputing (CDROM), p.39-es, January 01-01, 1996, Pittsburgh, Pennsylvania, United States [doi>10.1145/369028.369109]
	9	George Edward Pelham Box , Gwilym M. Jenkins, Time Series Analysis: Forecasting and Control, Prentice Hall PTR, Upper Saddle River, NJ, 1994
	10	Robert Carter , Mark Crovella, Dynamic Server Selection using Bandwidth Probing in Wide-Area Networks, Boston University, Boston, MA, 1996
	11	S. Chatterjee and B. Price. Regression Analysis by Example. John Wiley & Sons, Inc., 1991.
	12	T. DeWitt, T. Gross, B. Lowekamp, N. Miller, P. Steenkiste, J. Subhlok, and D. Sutherland. ReMoS: A resource monitoring system for network-aware applications. Technical Report CMU-CS-97-194-REVISED, School of Computer Science, Carnegie Mellon University, December 1998.
	13	Peter A. Dinda , David R. O'Hallaron, An Evaluation of Linear Models for Host Load Prediction, Proceedings of the The Eighth IEEE International Symposium on High Performance Distributed Computing, p.10, August 03-06, 1999
	14	A. L. Edwards. An Introduction to Linear Regression and Correlation. W. H. Freeman and Company, 1984.
	15	UC Berkeley Digital Library Project webpage at http://elib.cs.berkeley.edu/.
	16	Usama Fayyad , Ramasamy Uthurusamy, Data mining and knowledge discovery in databases, Communications of the ACM, v.39 n.11, p.24-26, Nov. 1996 [doi>10.1145/240455.240463]
	17	R. Ferreira, B. Moon, J. Humphries, A. Sussman, J. Saltz, R. Miller, and A. Demarzo. The Virtual Microscope. In Proc. of the 1997 AMIA Annual Fall Symposium, 1997.
	18	Ian Foster , Carl Kesselman, The grid: blueprint for a new computing infrastructure, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
	19	GloPerf webpage at http://www-fp.globus.org/details/ gloperf.html.
	20	R. Grossman, S. Kasif, R. Moore, D. Rocke, and J. Ullman. Data Mining Research: Opportunities and Challenges - A Report of three NSF Workshops on Mining Large, Massive, and Distributed Data, 1998. Available at http://www.ncdm.uic.edu/M3D-finalreport. htm.
	21	High Performance Storage System webpage at http://www.sdsc.edu/hpss/hpss1.html.
	22	Lennart Ljung, System identification (2nd ed.): theory for the user, Prentice Hall PTR, Upper Saddle River, NJ, 1999
	23	Bruce Lowekamp , David O'Hallaron , Thomas Gross, Direct Queries for Discovering Network Resource Properties in a Distributed Environment, Proceedings of the The Eighth IEEE International Symposium on High Performance Distributed Computing, p.5, August 03-06, 1999
	24	NARA Project webpage at http://www.sdsc.edu/NARA/.
	25	Bruce R. Schatz, High-Performance Distributed Digital Libraries: Building the Interspace on the Grid, Proceedings of the The Seventh IEEE International Symposium on High Performance Distributed Computing, p.224, July 28-31, 1998
	26	Performance Prediction in Production Environments, Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium, p.647, March 30-April 03, 1998
	27	Jennifer Melinda Schopf, Performance prediction and scheduling for parallel applications on multi-user clusters, University of California at San Diego, La Jolla, CA, 1998
	28	Jennifer M. Schopf , Francine Berman, Stochastic scheduling, Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM), p.48-es, November 14-19, 1999, Portland, Oregon, United States [doi>10.1145/331532.331580]
	29	Neil Spring , Rich Wolski, Application level scheduling of gene sequence comparison on metacomputers, Proceedings of the 12th international conference on Supercomputing, p.141-148, July 1998, Melbourne, Australia [doi>10.1145/277830.277860]
	30	SDSC's Storage Resource Broker project webpage at http://www.npaci.edu/DICE/SRB/ index.html.
	31	Alan Su , Francine Berman , Richard Wolski , Michelle Mills Strout, Using Apples to Schedule Simple SARA on the Computational Grid, International Journal of High Performance Computing Applications, v.13 n.3, p.253-262, August 1999 [doi>10.1177/109434209901300308]
	32	Rajeev Thakur , William Gropp , Ewing Lusk, A case for using MPI's derived datatypes to improve I/O performance, Proceedings of the 1998 ACM/IEEE conference on Supercomputing (CDROM), p.1-10, November 07-13, 1998, San Jose, CA
	33	Brian Tierney , William Johnston , Brian Crowley , Gary Hoo , Chris Brooks , Dan Gunter, The NetLogger Methodology for High Performance Distributed Systems Performance Analysis, Proceedings of the The Seventh IEEE International Symposium on High Performance Distributed Computing, p.260, July 28-31, 1998
	34	Mustafa Uysal , Tahsin M. Kurç , Alan Sussman , Joel H. Saltz, A Performance Prediction Framework for Data Intensive Applications on Large Scale Parallel Machines, Selected Papers from the 4th International Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers, p.243-258, May 28-30, 1998
	35	R. Williams. Caltech's Synthetic Aperture Radar Atlas project webpage at http://www.cacr.caltech.edu/~roy/sara/ index.html.
	36	R. Wolski, Forecasting network performance to support dynamic scheduling using the network weather service, Proceedings of the 6th International Symposium on High Performance Distributed Computing (HPDC '97), p.316, August 05-08, 1997
	37	Rich Wolski , Neil T. Spring , Jim Hayes, The network weather service: a distributed resource performance forecasting service for metacomputing, Future Generation Computer Systems, v.15 n.5-6, p.757-768, Oct. 1999 [doi>10.1016/S0167-739X(99)00025-4]
	38	D. Zagorodnov, F. Berman, and R. Wolski. Application Scheduling on the Information Power Grid. to appear in International Journal of High-Performance Computing, 1998.

CITED BY 14

	Chandra Krintz , Rich Wolski, JavaNws: the network weather service for the desktop, Proceedings of the ACM 2000 conference on Java Grande, p.116-125, June 03-04, 2000, San Francisco, California, United States
	Pascale Vicat-Blanc-Primet, Grid high performance networking in the DataGRID project, Future Generation Computer Systems, v.19 n.2, p.199-208, February 2003
	Mihai Surdeanu , Dan I. Moldovan , Sanda M. Harabagiu, Performance Analysis of a Distributed Question/Answering System, IEEE Transactions on Parallel and Distributed Systems, v.13 n.6, p.579-596, June 2002
	Oscar Ardaiz , Felix Freitag , Leandro Navarro, Estimating the service time of web clients using server logs, ACM SIGCOMM Computer Communication Review, v.31 n.2 supplement, April 2001
	Mohamed A. Kerasha , Ian Greenshields, Huskysim: a simulation toolkit for application scheduling in computational grids, Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters, May 19-21, 2004, New York, NY, USA
	Francine Berman , Richard Wolski , Henri Casanova , Walfredo Cirne , Holly Dail , Marcio Faerman , Silvia Figueira , Jim Hayes , Graziano Obertelli , Jennifer Schopf , Gary Shao , Shava Smallen , Neil Spring , Alan Su , Dmitrii Zagorodnov, Adaptive Computing on the Grid Using AppLeS, IEEE Transactions on Parallel and Distributed Systems, v.14 n.4, p.369-382, April 2003
	Tevfik Kosar , Miron Livny, A framework for reliable and efficient data placement in distributed computing systems, Journal of Parallel and Distributed Computing, v.65 n.10, p.1146-1157, October 2005
	Pascale Vicat-Blanc Primet , Robert Harakaly , Franck Bonnassieux, Grid Network Monitoring in the European Datagrid Project, International Journal of High Performance Computing Applications, v.18 n.3, p.293-304, August 2004
	Sudharshan Vazhkudai , Jennifer M. Schopf, Using Regression Techniques to Predict Large Data Transfers, International Journal of High Performance Computing Applications, v.17 n.3, p.249-268, August 2003
	Horacio González-Vélez, Self-adaptive skeletal task farm for computational grids, Parallel Computing, v.32 n.7, p.479-490, September 2006
	Leo T. Yang , Xiaosong Ma , Frank Mueller, Cross-Platform Performance Prediction of Parallel Applications Using Partial Execution, Proceedings of the 2005 ACM/IEEE conference on Supercomputing, p.40, November 12-18, 2005
	Baohua Wei , G. Fedak , F. Cappello, Scheduling Independent Tasks Sharing Large Data Distributed with BitTorrent, Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, p.219-226, November 13-14, 2005
	I-Hsin Chung , Jeffrey K. Hollingsworth, Using Information from Prior Runs to Improve Automated Tuning Systems, Proceedings of the 2004 ACM/IEEE conference on Supercomputing, p.30, November 06-12, 2004
	Reda Ammar , Abdulrahman Alhamdan, Scheduling real-time fork-join structures in cluster computing, International Journal of High Performance Computing and Networking, v.3 n.4, p.262-271, December 2005