Data Reservoir

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Data Reservoir: utilization of multi-gigabit backbone network for data-intensive research

Full text

Pdf (290 KB)

Source

Conference on High Performance Networking and Computing archive
Proceedings of the 2002 ACM/IEEE conference on Supercomputing table of contents

Baltimore, Maryland

Pages: 1 - 9

Year of Publication: 2002

Authors

Kei Hiraki	University of Tokyo, Hongo, Bunkyo-ku, Tokyo, Japan
Mary Inaba	University of Tokyo, Hongo, Bunkyo-ku, Tokyo, Japan
Junji Tamatsukuri	University of Tokyo, Hongo, Bunkyo-ku, Tokyo, Japan
Ryutaro Kurusu	Fujitsu Program Laboratories, Miwata, Nagano-shi, Nagano, Japan
Yukichi Ikuta	Fujitsu Program Laboratories, Miwata, Nagano-shi, Nagano, Japan
Hisashi Koga	Fujitsu Laboratories, Odanaka, Nakahara-ku, Kawasaki, Kanagawa, Japan
Akira Zinzaki	Fujitsu Laboratories, Odanaka, Nakahara-ku, Kawasaki, Kanagawa, Japan

Sponsors

IEEE-CS\DATC : IEEE Computer Society
ACM: Association for Computing Machinery
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

IEEE Computer Society Press Los Alamitos, CA, USA

Bibliometrics

Downloads (6 Weeks): 3, Downloads (12 Months): 24, Citation Count: 1

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

ABSTRACT

We propose data sharing facility for data intensive scientific research, "Data Reservoir"; which is optimized to transfer huge amount of data files between distant places fully utilizing multi-gigabit backbone network. In addition, "Data Reservoir" can be used as an ordinary UNIX server in local network without any modification of server softwares. We use low-level protocol and hierarchical striping to realize (1) separation of bulk data transfer and local accesses by caching, (2) file-system transparency, i.e. interoperable whatever in higher layer than disk driver, including file system. (3) scalability for network and storage.This paper shows our design, implementation using iSCSI protocol[1] and their performances for both 1Gbps model in the real network and 10Gbps model in our laboratory.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	http://www.ietf.org/internet-drafts/draft-ietf-ips-iscsi-12.pdf
	2	IEEE Annals of the History of Computing, Special issue on the University of Cambridge, Vol. 14 (4), 1992
	3	http://data-reservoir.adm.s.u-tokyo.ac.jp/
	4	http://www.sinet.ad.jp/index-e.html
	5	http://ccweb.in2p3.fr/bbftp/
	6	http://www.slac.stanford.edu/abh/sfcp/
	7	http://www.globus.org/datagrid/gridftp.html
	8	http://www.transarc.com/
	9	http://www.microsoft.com/NTServer/techresources/file print/dfs
	10	http://www.coda.cs.cmu.edu/
	11	K. Hiraki, M. Inba, J. Tamatsukuri, R. Kurusu, Y. Ikuta, H. Koga, and A. Zinzaki, "Data Reservoir: A 4Gbps Long Distance File Sharing Facility for Science Data Processing", Poster session SC2001, Nov. 2001.
	12	K. Hiraki, M. Inaba, J. Tamatsukuri, R. Kurusu, A. Jinzaki, H. Koga, H. Sakai, Okamura, Y. Ikuta, Miyazawa, "Data Reservoir: Need of Network Infrustracture for Science" CPSY 2001. (In Japanese)
	13	Data Reservoir: A New Approach to Data-Intensive Scientific Computation, Proceedings of the 2002 International Symposium on Parallel Architectures, Algorithms and Networks, p.269, May 22-24, 2002
	14	M. Inaba, R. Kurusu, J. Tamatsukuri, H. Koga, A. Jinzaki, Y. Ikuta, H. Sakai and K. Hiraki, "Data Reservoir: A very high-speed Long distance file sharing facility for Scientific data processing," Proc. of the High Performance Computing Symposium 2002, IPSJ, pp. 81--88, Jan. 2002. In Japanese)
	15	M. Inaba, J. Tamatsukuri, R. Kurusu, A. Jinzaki, H. Koga, Y. Ikuta, and K. Hiraki, "Data Reservoir---Data Transfer facility, Our Approach and experimental result" CPSY 2001. (In Japanese)
	16	R. Kurusu, M. Sakamoto, Y. Ikuta, K. Hiraki, M. Inaba, J. Tamatsukuri, H. Koga, and A. Zinzaki, "Data Reservoir, Multi-Gigabit Data Transfer Facility, Its Design and Implementation" PDCAT industry session, Sept 2002.
	17	P.H. Carns, W.B. Ligon III, R.B. Ross and R. Thakur, "PVFS: A Parallel File System For Linux Cluster," Proc. of the 4th Annual Linux Showcase and Conference, pp. 317--327, Oct. 2000.
	18	James V. Huber, Jr. , Andrew A. Chien , Christopher L. Elford , David S. Blumenthal , Daniel A. Reed, PPFS: a high performance portable parallel file system, Proceedings of the 9th international conference on Supercomputing, p.385-394, July 03-07, 1995, Barcelona, Spain [doi>10.1145/224538.224638]
	19	J. Mostek, B. Earl, S. Levine, S. Lord, R. Cattelan, K. McDonell, T. Kline, B. Graffey, and R. Ananthanarayanan, "Porting the SGI XFS file system to Linux," Proc of FREENIX Track, 2000 USENIX Annual Technical Converence, 2000.
	20	Edward K. Lee , Chandramohan A. Thekkath, Petal: distributed virtual disks, Proceedings of the seventh international conference on Architectural support for programming languages and operating systems, p.84-92, October 01-04, 1996, Cambridge, Massachusetts, United States
	21	A. Savva, T. Kkashi, T. Shimizu, and M Kishimoto, "Distributed Shared Disk: Transparent and Efficient Disk Sharing in Cluster Systems," Proc. JSPP98, pp. 335--342, June 1998.