Studies on striping and buffer caching issues for the software RAID file system

ABSTRACT

A software RAID file system is defined as a system that distributes data redundantly across an array of disks attached to each of the workstations connected on a high-speed network. This configuration provides higher throughput and availability compared to conventional file systems. In this paper, we consider two specific issues regarding the distribution of data among the cluster, namely, striping and buffer caching for such an environment. Through simulation studies we compare the performance of various striping methods and show that for effective striping in software RAID file systems, it must take advantage of its flexible nature. Further, for buffer caching, we show that conventional caching schemes developed for distributed systems are insufficient, and that the Exclusively Old Data and Parity scheme that is presented in this paper, overcomes the limitations of the previously proposed schemes.

REFERENCES

• 1: Thomas E. Anderson , David E. Culler , David A. Patterson , and the NOW team, A Case for NOW (Networks of Workstations), IEEE Micro, v.15 n.1, p.54-64, February 1995 [doi>10.1109/40.342018]
• 2: Thomas E. Anderson , Michael D. Dahlin , Jeanna M. Neefe , David A. Patterson , Drew S. Roselli , Randolph Y. Wang, Serverless network file systems, ACM Transactions on Computer Systems (TOCS), v.14 n.1, p.41-79, Feb. 1996 [doi>10.1145/225535.225537]
• 3: Mary G. Baker , John H. Hartman , Michael D. Kupfer , Ken W. Shirriff , John K. Ousterhout, Measurements of a distributed file system, Proceedings of the thirteenth ACM symposium on Operating systems principles, p.198-212, October 13-16, 1991, Pacific Grove, California, United States
• 4: Nanette J. Boden , Danny Cohen , Robert E. Felderman , Alan E. Kulawik , Charles L. Seitz , Jakov N. Seizovic , Wen-King Su, Myrinet: A Gigabit-per-Second Local Area Network, IEEE Micro, v.15 n.1, p.29-36, February 1995 [doi>10.1109/40.342015]
• 5: {5} L.-F. Cabrera, Swift: using distributed disk striping to provide high I/O data rates, Comput. Syst. 4 (4) (1991) 405-436.
• 6: Peter M. Chen , Edward K. Lee , Garth A. Gibson , Randy H. Katz , David A. Patterson, RAID: high-performance, reliable secondary storage, ACM Computing Surveys (CSUR), v.26 n.2, p.145-185, June 1994 [doi>10.1145/176979.176981]
• 7: {7} B. Eklundh, K. Sällberg, B. Stavenow, Asynchronous transfer modes-options and characteristics, in: Proceedings of the 12th International Teletraffic Congress, 1-8 June 1988, p. 1.3A3.
• 8: John H. Hartman , John K. Ousterhout, The Zebra striped network file system, ACM Transactions on Computer Systems (TOCS), v.13 n.3, p.274-310, Aug. 1995 [doi>10.1145/210126.210131]
• 9: John H. Hartman , John K. Ousterhout, The Zebra striped network file system, ACM Transactions on Computer Systems (TOCS), v.13 n.3, p.274-310, Aug. 1995 [doi>10.1145/210126.210131]
• 10: {10} K. Keeton, T.E. Anderson, D.A. Patterson. LogP quantified: the case for low-overhead local area networks, in: Proceedings of the 1995 Hot Interconnects III Conference, 1995.
• 11: David Kotz , Song B Toh , Sriram Radhakrishnan, A Detailed Simulation Model of the HP 97560 Disk Drive, Dartmouth College, Hanover, NH, 1994
• 12: Edward K. Lee , Chandramohan A. Thekkath, Petal: distributed virtual disks, Proceedings of the seventh international conference on Architectural support for programming languages and operating systems, p.84-92, October 01-04, 1996, Cambridge, Massachusetts, United States
• 13: Avraham Leff , Joel L. Wolf , Philip S. Yu, Efficient LRU-Based Buffering in a LAN Remote Caching Architecture, IEEE Transactions on Parallel and Distributed Systems, v.7 n.2, p.191-206, February 1996 [doi>10.1109/71.485508]
• 14: {14} S.J. Leffer, M.K. McKusick, M.J. Karels, J.S. Quarterman, 4.3 BSD UNIX Operating System, Addison-Wesley, Wokingham, UK, 1990.
• 15: {15} R.P. Martin, HPAM: an active message layer for a network of HP workstations, in: Proceedings of the Hot Interconnects, 1994.
• 16: David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States
• 17: Mendel Rosenblum , John K. Ousterhout, The design and implementation of a log-structured file system, ACM Transactions on Computer Systems (TOCS), v.10 n.1, p.26-52, Feb. 1992 [doi>10.1145/146941.146943]
• 18: {18} R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, B. Lyon. Design and implementation of the SUN Network File System, in: Proceedings of the USENIX Conference and Exhibition, Portland, Oregon, USENIX, 1985.

INDEX TERMS

Primary Classification:
  B. Hardware
  B.3 MEMORY STRUCTURES
      B.3.2 Design Styles
          Subjects: Mass storage (e.g., magnetic, optical, RAID)

Additional Classification:
  B. Hardware
  B.3 MEMORY STRUCTURES
      B.3.2 Design Styles
          Subjects: Cache memories

  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Design studies

General Terms:
Algorithms, Design, Performance

Keywords:
caching, clustering, software RAID, striping