|
ABSTRACT
We propose a new paradigm for network file system design: serverless network file systems. While traditional network file systems rely on a central server machine, a serverless system utilizes workstations cooperating as peers to provide all file system services. Any machine in the system can store, cache, or control any block of data. Our approach uses this location independence, in combination with fast local area networks, to provide better performance and scalability than traditional file systems. Furthermore, because any machine in the system can assume the responsibilities of a failed component, our serverless design also provides high availability via redundatn data storage. To demonstrate our approach, we have implemented a prototype serverless network file system called xFS. Preliminary performance measurements suggest that our architecture achieves its goal of scalability. For instance, in a 32-node xFS system with 32 active clients, each client receives nearly as much read or write throughput as it would see if it were the only active client.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
|
| |
2
|
|
 |
3
|
Mary Baker , Satoshi Asami , Etienne Deprit , John Ouseterhout , Margo Seltzer, Non-volatile memory for fast, reliable file systems, Proceedings of the fifth international conference on Architectural support for programming languages and operating systems, p.10-22, October 12-15, 1992, Boston, Massachusetts, United States
|
 |
4
|
Mary G. Baker , John H. Hartman , Michael D. Kupfer , Ken W. Shirriff , John K. Ousterhout, Measurements of a distributed file system, Proceedings of the thirteenth ACM symposium on Operating systems principles, p.198-212, October 13-16, 1991, Pacific Grove, California, United States
|
 |
5
|
T. von Eicken , A. Basu , V. Buch , W. Vogels, U-Net: a user-level network interface for parallel and distributed computing (includes URL), Proceedings of the fifteenth ACM symposium on Operating systems principles, p.40-53, December 03-06, 1995, Copper Mountain, Colorado, United States
|
| |
6
|
BmaEt,I,, A., HISGEN, A., JERIAN, C, MANN, T., AND SWART, G. 1993. The Echo distributed file system. Tech. Rep. 111, Digital Equipment Corp., Systems Research Center, Palo Alto., CaliL
|
| |
7
|
BIACKWELI., T., HARRIS, J., AND SEI,TZER, n. 1995. Heuristic cleaning algorithms in log-structured file systems. In Proceedings of the 1995 Winter USENIX. USENIX Assoc., Berkeley, Calif., 277 288.
|
 |
8
|
M. Blaum , J. Brady , J. Bruck , J. Menon, EVENODD: an optimal scheme for tolerating double disk failures in RAID architectures, Proceedings of the 21ST annual international symposium on Computer architecture, p.245-254, April 18-21, 1994, Chicago, Illinois, United States
|
| |
9
|
|
| |
10
|
Nanette J. Boden , Danny Cohen , Robert E. Felderman , Alan E. Kulawik , Charles L. Seitz , Jakov N. Seizovic , Wen-King Su, Myrinet: A Gigabit-per-Second Local Area Network, IEEE Micro, v.15 n.1, p.29-36, February 1995
[doi> 10.1109/40.342015]
|
| |
11
|
CABRERA, L. AN1) LON(;, D. 1991. Swift: A storage architecture for large objects. In Proceedings of the l lth Symposium on Mass Storage Systems (Oct.). IEEE Computer Society Press, Los Alamitos, Calif., 123~ 128.
|
 |
12
|
Pei Cao , Swee Boon Lim , Shivakumar Venkataraman , John Wilkes, The TickerTAIP parallel RAID architecture, Proceedings of the 20th annual international symposium on Computer architecture, p.52-63, May 16-19, 1993, San Diego, California, United States
|
 |
13
|
David Chaiken , John Kubiatowicz , Anant Agarwal, LimitLESS directories: A scalable cache coherence scheme, Proceedings of the fourth international conference on Architectural support for programming languages and operating systems, p.224-234, April 08-11, 1991, Santa Clara, California, United States
|
 |
14
|
Peter M. Chen , Edward K. Lee , Garth A. Gibson , Randy H. Katz , David A. Patterson, RAID: high-performance, reliable secondary storage, ACM Computing Surveys (CSUR), v.26 n.2, p.145-185, June 1994
[doi> 10.1145/176979.176981]
|
 |
15
|
|
| |
16
|
CRISTIAN, F. 1991. Reaching agreement on processor group membership in synchronous distributed systems. Distrib. Comput. 4, 175 187.
|
 |
17
|
R. Cypher , A. Ho , S. Konstantinidou , P. Messina, Architectural requirements of parallel scientific applications with explicit communication, Proceedings of the 20th annual international symposium on Computer architecture, p.2-13, May 16-19, 1993, San Diego, California, United States
|
 |
18
|
Michael D. Dahlin , Clifford J. Mather , Randolph Y. Wang , Thomas E. Anderson , David A. Patterson, A quantitative analysis of cache policies for scalable network file systems, Proceedings of the 1994 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.150-160, May 16-20, 1994, Nashville, Tennessee, United States
|
| |
19
|
D^ltLIN, M., WANt;, R., ANDERSON, T., AN{~ PATTERSON, D. 1994b. Cooperative caching: Using remote client memory to improve file system performance. In Proceedings of the 1st Symposium on Operating Systems Design and Implementation (Nov.), 276 280.
|
 |
20
|
|
| |
21
|
|
| |
22
|
|
 |
23
|
|
 |
24
|
John H. Howard , Michael L. Kazar , Sherri G. Menees , David A. Nichols , M. Satyanarayanan , Robert N. Sidebotham , Michael J. West, Scale and performance in a distributed file system, ACM Transactions on Computer Systems (TOCS), v.6 n.1, p.51-81, Feb. 1988
[doi> 10.1145/35037.35059]
|
| |
25
|
KazA}t, M 1989. {~ik: Replicated servers made easy. In Proceedings of the 2rid Workshop on Workstation Operating Systems (Sept.). IEEE Computer Society Press, Los Alamitos, Calif., 60 67.
|
| |
26
|
KEETON, K., ANDERSON, T., AND PA}'rERSON, D. 1995. LogP quantified: The case for low-overhead local area networks. In Proceedings of Hot Interconnects (Aug.). IEEE Computer Society Press, Los Alamitos, Calif.
|
 |
27
|
|
 |
28
|
|
 |
29
|
J. Kuskin , D. Ofelt , M. Heinrich , J. Heinlein , R. Simoni , K. Gharachorloo , J. Chapin , D. Nakahira , J. Baxter , M. Horowitz , A. Gupta , M. Rosenblum , J. Hennessy, The Stanford FLASH multiprocessor, Proceedings of the 21ST annual international symposium on Computer architecture, p.302-313, April 18-21, 1994, Chicago, Illinois, United States
|
| |
30
|
|
| |
31
|
|
 |
32
|
Daniel Lenoski , James Laudon , Kourosh Gharachorloo , Anoop Gupta , John Hennessy, The directory-based cache coherence protocol for the DASH multiprocessor, Proceedings of the 17th annual international symposium on Computer Architecture, p.148-159, May 28-31, 1990, Seattle, Washington, United States
|
 |
33
|
Barbara Liskov , Sanjay Ghemawat , Robert Gruber , Paul Johnson , Liuba Shrira, Replication in the harp file system, Proceedings of the thirteenth ACM symposium on Operating systems principles, p.226-238, October 13-16, 1991, Pacific Grove, California, United States
|
| |
34
|
LITZKOW, M. AND SOLOMON, M. 1992. Supporting checkpointing and process migration outside the UNIX kernel. In Proceedings of the Winter 1992 USENIX (Jan.). USENIX Assoc., Berkeley, Calif., 283-290.
|
| |
35
|
Lo VERSo, S., ISMAN, M., NANOPOULOS, A., NESHEIM, W,, MILNE, E., AND WHEELER, R. 1993. sis: A parallel file system for the CM-5. In Proceedings of the Summer 1993 USENIX. USENIX Assoc., Berkeley, Calif., 291-305.
|
| |
36
|
MAJOR, D., MINSHALL, G., AND POWELL, K. 1994. An overview of the NetWare operating system. In Proceedings of the 1994 Winter USENIX (Jan.). USENIX Assoc., Berkeley, Calif., 355-372.
|
 |
37
|
|
 |
38
|
|
 |
39
|
David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States
|
| |
40
|
PmRCE, P. 1989. A concurrent file system for a highly parallel mass storage subsystem. In Proceedings of the 4th Conference on Hypercubes, Concurrent Computers, and Applications. Golden Gate Enterprises, LOs Altos, Calif., 155-160.
|
| |
41
|
POPES, G., GuY, R., PACE, T., AND HEtDEMANN, J. 1990. Replication in the Ficus distributed file system. In Proceedings of the Workshop on the Management of Replicated Data (Nov.). IEEE Computer Society Press, LOs Alamitos, Calif., 5-10.
|
| |
42
|
RASHID, R. 1994. MicrosolYs Tiger media server. In The 1st Networks of Workstations Workshop Record (Oct.). Presented at ASPLOS 1994 Conference (San Jose, Calif.).
|
 |
43
|
|
 |
44
|
|
 |
45
|
E. Rosti , E. Smirni , T. D. Wagner , A. W. Apon , L. W. Dowdy, The KSR1: experimentation and modeling of poststore, Proceedings of the 1993 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.74-85, May 10-14, 1993, Santa Clara, California, United States
|
| |
46
|
SANI~BERC, R., GOLDBERG, D., KLEIMAN, S., WALSH, D., A~O LYON, B. 1985. Design and implementation of the Sun network file system. In Proceedings of the Summer 1985 USENIX (June). USENIX Assoc, Berkeley, Calif., 119-130.
|
| |
47
|
SCHROEDER, M., BIRRELL, A., BURROWS, M., MURRAY, H., NEEDHAM, R., RODEHEFFER, T., SATTERTH- WAITE, E, AND TH^C~d;R, C. 1991. Autonet: A high-speed, self-configuring local area network using point-to-point links. IEEE J. Sel. Areas Commun. 9, 8 (Oct.), 1318 1335.
|
| |
48
|
SELTZER, M., BOSTIC, K., McKUslCK, M., AND STAELIN, C. 1993. An implementation of a log-structured file system for UNIX. In Proceedings of the 1993 Winter USENIX (Jan.). USENIX Assoc., Berkeley, Calif., 307-326.
|
| |
49
|
SELTZER, M., SMITH, K., BALAKRISHNAN, H., CHANG, J., McMAINS, S., AND PaDMANaSHAN, V. 1995. File system logging versus clustering: A performance comparison. In Proceedings of the 1995 Winter USENIX (Jan.). USENIX Assoc., Berkeley, Calif.
|
| |
50
|
SMITH, A. 1977. Two methods for the efficient analysis of memory address trace data. IEEE Trans. Softw. Eng. SE-3, 1 (Jan.), 94-101.
|
 |
51
|
Thorsten von Eicken , David E. Culler , Seth Copen Goldstein , Klaus Erik Schauser, Active messages: a mechanism for integrated communication and computation, Proceedings of the 19th annual international symposium on Computer architecture, p.256-266, May 19-21, 1992, Queensland, Australia
|
 |
52
|
Bruce Walker , Gerald Popek , Robert English , Charles Kline , Greg Thiel, The LOCUS distributed operating system, Proceedings of the ninth ACM symposium on Operating systems principles, p.49-70, October 10-13, 1983, Bretton Woods, New Hampshire, United States
|
| |
53
|
WANG, R. AND ANDERSON, T. 1993. xFS: A wide area mass storage file system. In the 4th Workshop on Workstation Operating Systems (Oct.). IEEE Computer Society Press, Los A}amitos, Calif., 71-78.
|
 |
54
|
J. Wilkes , R. Golding , C. Staelin , T. Sullivan, The HP AutoRAID hierarchical storage system, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.96-108, December 03-06, 1995, Copper Mountain, Colorado, United States
|
 |
55
|
|
CITED BY 51
|
|
|
|
|
|
|
|
Geoffrey M. Voelker , Eric J. Anderson , Tracy Kimbrel , Michael J. Feeley , Jeffrey S. Chase , Anna R. Karlin , Henry M. Levy, Implementing cooperative prefetching and caching in a globally-managed memory system, ACM SIGMETRICS Performance Evaluation Review, v.26 n.1, p.33-43, June 1998
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Alec Wolman , M. Voelker , Nitin Sharma , Neal Cardwell , Anna Karlin , Henry M. Levy, On the scale and performance of cooperative Web proxy caching, ACM SIGOPS Operating Systems Review, v.33 n.5, p.16-31, Dec. 1999
|
|
|
|
|
|
|
|
|
|
|
|
Jay J. Wylie , Michael W. Bigrigg , John D. Strunk , Gregory R. Ganger , Han Kiliççöte , Pradeep K. Khosla, Survivable Information Storage Systems, Computer, v.33 n.8, p.61-68, August 2000
|
|
|
|
|
|
Sotiris Ioannidis , Athanasios E. Papathanasiou , Grigorios I. Magklis , Evangelos P. Markatos , Dionisios N. Pnevmatikatos , Julia Sevaslidou, On using reliable network RAM in networks of workstations, Cluster computing, Nova Science Publishers, Inc., Commack, NY, 2001
|
|
|
|
|
|
Garth A. Gibson , David F. Nagle , Khalil Amiri , Jeff Butler , Fay W. Chang , Howard Gobioff , Charles Hardin , Erik Riedel , David Rochberg , Jim Zelenka, A cost-effective, high-bandwidth storage architecture, ACM SIGOPS Operating Systems Review, v.32 n.5, p.92-103, Dec. 1998
|
|
|
|
|
|
Robert Grimm , Janet Davis , Eric Lemar , Adam Macbeth , Steven Swanson , Thomas Anderson , Brian Bershad , Gaetano Borriello , Steven Gribble , David Wetherall, System support for pervasive applications, ACM Transactions on Computer Systems (TOCS), v.22 n.4, p.421-486, November 2004
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Sumeet Sobti , Nitin Garg , Fengzhou Zheng , Junwen Lai , Yilei Shao , Chi Zhang , Elisha Ziskind , Arvind Krishnamurthy , Randolph Y. Wang, Segank: A Distributed Mobile Storage System, Proceedings of the 3rd USENIX Conference on File and Storage Technologies, March 31-31, 2004, San Francisco, CA
|
|
|
|
|
|
|
|
|
|
|
|
Satish Chandra , Michael Dahlin , Bradley Richards , Randolph Y. Wang , Thomas E. Anderson , James R. Larus, Experience with a language for writing coherence protocols, Proceedings of the Conference on Domain-Specific Languages on Conference on Domain-Specific Languages (DSL), 1997, p.5-5, October 15-17, 1997, Santa Barbara, California
|
|
|
|
|
|
|
|
|
|
|
|
Michael Abd-El-Malek , William V. Courtright, II , Chuck Cranor , Gregory R. Ganger , James Hendricks , Andrew J. Klosterman , Michael Mesnier , Manish Prasad , Brandon Salmon , Raja R. Sambasivan , Shafeeq Sinnamohideen , John D. Strunk , Eno Thereska , Matthew Wachs , Jay J. Wylie, Ursa minor: versatile cluster-based storage, Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies, p.5-5, December 13-16, 2005, San Francisco, CA
|
|
|
|
|
|
|
|
|
Hyunbin Lee , YongJoo Song , Kyungbaek Kim , Donggook Kim , Daeyeon Park, CriStore: dynamic storage system for heterogeneous devices in off-site ubiquitous communities, Proceedings of the 2007 ACM symposium on Applied computing, March 11-15, 2007, Seoul, Korea
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Minkyong Kim , Landon Cox , Brian Noble, Safety, Visibility, and Performance in a Wide-Area File System, Proceedings of the 1st USENIX Conference on File and Storage Technologies, January 28-30, 2002, Monterey, CA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Alvise Dorigo , Peter Elmer , Fabrizio Furano , Andrew Hanushevsky, XROOTD/TXNetFile: a highly scalable architecture for data access in the ROOT environment, Proceedings of the 4th WSEAS International Conference on Telecommunications and Informatics, p.1-6, March 13-15, 2005, Prague, Czech Republic
|
|
|
|
|
|
|
|
|
|
|
|
|
INDEX TERMS
Primary Classification:
D.
Software
D.4
OPERATING SYSTEMS
D.4.3
File Systems Management
Subjects:
Access methods
Additional Classification:
C.
Computer Systems Organization
C.2
COMPUTER-COMMUNICATION NETWORKS
C.2.4
Distributed Systems
Subjects:
Network operating systems
D.
Software
D.4
OPERATING SYSTEMS
D.4.2
Storage Management
Subjects:
Allocation/deallocation strategies;
Secondary storage
D.4.3
File Systems Management
Subjects:
Directory structures;
File organization;
Distributed file systems
D.4.5
Reliability
Subjects:
Checkpoint/restart;
Fault-tolerance
D.4.8
Performance
Subjects:
Simulation;
Measurements
E.
Data
E.5
FILES
Subjects:
Organization/structure
H.
Information Systems
H.3
INFORMATION STORAGE AND RETRIEVAL
H.3.2
Information Storage
Subjects:
File organization
General Terms:
Algorithms,
Design,
Measurement,
Performance,
Reliability
Keywords:
RAID,
log cleaning,
log structured,
log-based striping,
logging,
redundant data storage,
scalable performance
|