Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Over the last few years the Grid Computing research community has become interested in developing data intensive applications for the Grid. These applications face significant challenges because their widely distributed nature makes it difficult to access data with reasonable speed. In order to address this problem, we feel that the Grid community needs to develop and explore data movement challenges that represent problems encountered in these applications. In this paper, we will identify two such problems that we have dubbed the Livny Problem and the Plank-Beck Problem. We will also present data movement scheduling techniques that we have developed to address these problems.

REFERENCES

• 1: [1] CERN homepage. http://public.web.cern.ch/ public/.
• 2: [2] Dr. James Plank's homepage. http://www.cs.utk. edu/~plank/.
• 3: [3] Dr. Micah Beck's homepage. http://www.cs.utk. edu/~mbeck/.
• 4: [4] Dr. Miron Livny's homepage. http://www.cs.wisc. edu/~miron/.
• 5: [5] European Data Grid Project homepage. http:// eu-datagrid.web.cern.ch/eu-datagrid/.
• 6: [6] Globus Data Grid homepage. http://www.globus. org/datagrid/.
• 7: [7] GrADS Project homepage. http://hipersoft.cs. rice.edu/grads/.
• 8: Matthew S. Allen , Rich Wolski , James S. Plank, Adaptive Timeout Discovery Using the Network Weather Service, Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, p.35, July 24-26, 2002
• 9: Todd Arbogast , Zhangxin Chen, On the implementation of mixed methods as nonconforming methods for second-order elliptic problems, Mathematics of Computation, v.64 n.211, p.943-972, July 1995 [doi>10.2307/2153478]
• 10: Scott Atchley , Stephen Soltesz , James S. Plank , Micah Beck , Terry Moore, Fault-Tolerance in the Network Storage Stack, Proceedings of the 16th International Parallel and Distributed Processing Symposium, p.154, April 15-19, 2002
• 11: [11] C. Baru, R. Moore, A. Rajasekar, and M. Wan. The sdsc storage resource broker, 1998.
• 12: Alessandro Bassi , Micah Beck , Terry Moore , James S. Plank, The Logistical Backbone: Scalable Infrastructure for Global Data Grids, Proceedings of the7th Asian Computing Science Conference on Advances in Computing Science: Internet Computing and Modeling, Grid Computing, Peer-to-Peer Computing, and Cluster, p.1-12, December 04-06, 2002
• 13: [13] M. Beynon, R. Ferreira, T. M. Kurc, A. Sussman, and J. H. Saltz. Datacutter: Middleware for filtering very large scientific datasets on archival storage systems. In IEEE Symposium on Mass Storage Systems, pages 119-134, 2000.
• 14: [14] A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke. The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets, 1999.
• 15: [15] Condor home page - http://www.cs.wisc.edu/condor/.
• 16: Ian Foster , Carl Kesselman, The grid: blueprint for a new computing infrastructure, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 17: James S.Plank , Micah Beck , Wael R. Elwasif, IBP: The Internet Backplane Protocol, University of Tennessee, Knoxville, TN, 1999
• 18: [18] J. Plank, M. Beck, W. Elwasif, T. Moore, M. Swany, and R. Wolski. The internet backplane protocol: Storage in the network, 1999.
• 19: [19] J. S. Plank, S. Atchley, Y. Ding, and M. Beck. Algorithms for high performance, wide-area, distributed file downloads. Technical Report UT-CS-02-485, Department of Computer Science, University of Tennessee, October 2002.
• 20: [20] A. Shoshani, L. M. Bernardo, H. Nordberg, D. Rotem, and A. Sim. Storage managementfor high energy physics applications. In Computing in High Energy Physics, 1998.
• 21: [21] T. Tannenbaum and M. Litzkow. The condor distributed processing system. Dr. Dobbs Journal, February 1995.
• 22: Se-Chang Son, The Kangaroo Approach to Data Movement on the Grid, Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, p.325, August 07-09, 2001
• 23: [23] R. F. V. D. Wijngaart and M. Frumkin. Nas grid benchmarks version 1.0. Technical Report NAS-02-005, NASA Advanced Supercomputing, July 2002.
• 24: Rich Wolski, Dynamically forecasting network performance using the Network Weather Service, Cluster Computing, v.1 n.1, p.119-132, 1998 [doi>10.1023/A:1019025230054]
• 25: Rich Wolski, Experiences with predicting resource performance on-line in computational grid settings, ACM SIGMETRICS Performance Evaluation Review, v.30 n.4, March 2003 [doi>10.1145/773056.773064]
• 26: Rich Wolski , Neil T. Spring , Jim Hayes, The network weather service: a distributed resource performance forecasting service for metacomputing, Future Generation Computer Systems, v.15 n.5-6, p.757-768, Oct. 1999 [doi>10.1016/S0167-739X(99)00025-4]