Amazon S3 for science grids

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Amazon S3 for science grids: a viable solution?

Full text

Pdf (423 KB)

Source

High Performance Distributed Computing archive
Proceedings of the 2008 international workshop on Data-aware distributed computing table of contents

Boston, MA, USA

Pages 55-64

Year of Publication: 2008

ISBN:978-1-60558-154-5

Authors

Mayur R. Palankar	University of South Florida, Tampa, FL, USA
Adriana Iamnitchi	University of South Florida, Tampa, FL, USA
Matei Ripeanu	University of British Columbia, Vancouver, BC, Canada
Simson Garfinkel	Harvard University, Cambridge, MA, USA

Sponsors

ACM: Association for Computing Machinery
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 29, Downloads (12 Months): 363, Citation Count: 4

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1383519.1383526 What is a DOI?

ABSTRACT

Amazon.com has introduced the Simple Storage Service (S3), a commodity-priced storage utility. S3 aims to provide storage as a low-cost, highly available service, with a simple 'pay-as-you-go' charging model. This article makes three contributions. First, we evaluate S3's ability to provide storage support to large-scale science projects from a cost, availability, and performance perspective. Second, we identify a set of additional functionalities that storage services targeting data-intensive science applications should support. Third, we propose unbundling the success metrics for storage utility performance as a solution, to reduce storage costs.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	The DZero Experiment. http://www-d0.fnal.gov
	2	The Large Hadron Collider. http://lcg.web.cern.ch/LCG
	3	The Stanford Linear Collider. http://www2.slac.stanford.edu/vvc/experiments/slc.html
	4	The Compact Muon Solenoid at CERN. http://cmsinfo.cern.ch
	5	Amazon Web Services. http:/s3.amazonaws.com
	6	PlanetLab Consortium. http://planet-lab.org
	7	Garfinkel, S. 2007. Commodity Grid Computing with Amazon's S3 and EC2, Login, USENIX, February 2007.
	8	Kirkpatrick, M. 2006. Amazon releases early info on S3 storage use, http://www.techcrunch.com/tag/s3, July 2006.
	9	Bezos, J. keynote talk at Web 2.0 Expo, April 2007.
	10	H. Krawczyk , M. Bellare , R. Canetti, HMAC: Keyed-Hashing for Message Authentication, RFC Editor, 1997
	11	W3C, Soap Version 1.2, June 2003, http://www.w3.org/TR/soap/
	12	Roy Thomas Fielding , Richard N. Taylor, Architectural styles and the design of network-based software architectures, University of California, Irvine, 2000
	13	BitTorrent. http://www.bittorrent.com
	14	Doraimani, S. 2007. Filecules: A New Granularity for Resource Management in Grids, Masters Thesis, University of South Florida, April 2007.
	15	Iamnitchi, A., Doraimani, S., and Garzoglio, G. 2006. Filecules in High-Energy Physics: Characteristics and Impact on Resource Management, 15th IEEE International Symposium on High Performance Distributed Computing (HPDC), June 2006.
	16	Oreily. REST vs. SOAP at Amazon. http://www.oreillynet.com/pub/wlg/3005?wlg=yes
	17	Vern Paxson, End-to-end routing behavior in the Internet, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.25-38, August 28-30, 1996, Palo Alto, California, United States
	18	Garfinkel, S. 2007. An Evaluation of Amazon's Grid Computing Services: EC2, S3 and SQS, Technical Report TR-08-07, School for Engineering and Applied Sciences, Harvard University, MA. July 2007.
	19	TeraGrid. http://www.teragrid.org
	20	Odlyzko, A. M. 2000. The Internet and other networks: Utilization rates and their implications, Information Economics & Policy, vol. 12, 2000.
	21	Odlyzko, A. M. 1999. The current state and likely evolution of the Internet, in Proceedings of Globecom'99, pp. 1869--1875, IEEE, 1999.
	22	Western Canada Research Grid. http://www.westgrid.ca
	23	Ripeanu, M. and Iamnitchi, A. 2007. S4: A Simple Storage Service for Sciences, 16th IEEE International Symposium on High Performance Distributed Computing (HPDC), Monterey Bay, CA, June 2007.
	24	Palankar, M., Onibokun, A., Iamnitchi, A., and Ripeanu, M. 2007. Amazon S3 for Science Grids: a Viable Solution?, poster, 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI'07), April 2007.

CITED BY 4

	Scott Hazelhurst, Scientific computing using virtual high-performance computing: a case study using the Amazon elastic computing cloud, Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology, p.94-103, October 06-08, 2008, Wilderness, South Africa
	Abdullah Gharaibeh , Matei Ripeanu, Exploring data reliability tradeoffs in replicated storage systems, Proceedings of the 18th ACM international symposium on High performance distributed computing, June 11-13, 2009, Garching, Germany
	Marcos Dias de Assuncao , Alexandre di Costanzo , Rajkumar Buyya, Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters, Proceedings of the 18th ACM international symposium on High performance distributed computing, June 11-13, 2009, Garching, Germany
	Nezih Yigitbasi , Alexandru Iosup , Dick Epema , Simon Ostermann, C-Meter: A Framework for Performance Analysis of Computing Clouds, Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, p.472-477, May 18-21, 2009