Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

File system I/O is increasingly becoming a performance bottleneck in large distributed computer systems. This is due to the increased file I/O demands of new applications, the inability of any single storage structure to respond to these demands, and the slow decline of, disk access times (latency and seek) relative to the rapid increase in CPU speeds, memory size, and network bandwidth.We present a multi-structured file system designed for high bandwidth I/O and fast response. Our design is based on combining disk caching with three different file storage structures, each implemented on an independent and isolated disk array. Each storage structure is designed to optimize a different set of file system access characteristics such as cache writes, directory searches, file attribute requests or large sequential reads/writes.As part of our study, we analyze the performance of an existing file system using trace data from UNIX disk I/O-intensive workloads. Using trace driven simulations, we show how performance is improved by using separate storage structures as implemented by a multi-structured file system.

REFERENCES

• 1: Dina Bitton , Jim Gray, Disk Shadowing, Proceedings of the 14th International Conference on Very Large Data Bases, p.331-338, August 29-September 01, 1988
• 2: R. Finlayson , D. Cheriton, Log files: an extended file service exploiting write-once storage, Proceedings of the eleventh ACM Symposium on Operating systems principles, p.139-148, November 08-11, 1987, Austin, Texas, United States [doi>10.1145/41457.37516]
• 3: Ferrari, D., "Computer Systems Performance Evaluation.", Prentice Hall, 1981.
• 4: R. A. Floyd , C. Schlatter Ellis, Directory Reference Patterns in Hierarchical File Systems, IEEE Transactions on Knowledge and Data Engineering, v.1 n.2, p.238-247, June 1989 [doi>10.1109/69.87963]
• 5: Fujitsu M2361A Mini-Disk Drive Customer Engineering Manual.
• 6: Jason Gait, The Optical File Cabinet: A Random-Access File System for Write-Once Optical Disks, Computer, v.21 n.6, p.11-22, June 1988 [doi>10.1109/2.947]
• 7: Kenneth Salem , Hector Garcia-Molina, Disk Striping, Proceedings of the Second International Conference on Data Engineering, p.336-342, February 05-07, 1986
• 8: R. Hagmann, Reimplementing the Cedar file system using logging and group commit, Proceedings of the eleventh ACM Symposium on Operating systems principles, p.155-162, November 08-11, 1987, Austin, Texas, United States [doi>10.1145/41457.37518]
• 9: Randy H. Katz , Garth A. Gibson , David A. Patterson, Disk System Architectures for High Performance Computing, University of California at Berkeley, Berkeley, CA, 1989
• 10: M Y Kim, Synchronized disk interleaving, IEEE Transactions on Computers, v.35 n.11, p.978-988, Nov. 1986 [doi>10.1109/TC.1986.1676699]
• 11: Edward D. Lazowska , John Zahorjan , David R. Cheriton , Willy Zwaenepoel, File access performance of diskless workstations, ACM Transactions on Computer Systems (TOCS), v.4 n.3, p.238-268, Aug. 1986 [doi>10.1145/6420.6423]
• 12: Miron Livny , Setrag Khoshafian , Haran Boral, Multi-disk management algorithms, Proceedings of the 1987 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.69-77, May 11-14, 1987, Banff, Alberta, Canada [doi>10.1145/29903.29914]
• 13: Marshall K. McKusick , William N. Joy , Samuel J. Leffler , Robert S. Fabry, A fast file system for UNIX, ACM Transactions on Computer Systems (TOCS), v.2 n.3, p.181-197, Aug. 1984 [doi>10.1145/989.990]
• 14: Sape J. Mullender , Andrew S. Tanenbaum, Immediate files, Software—Practice & Experience, v.14 n.4, p.365-368, April 1984 [doi>10.1002/spe.4380140407]
• 15: Michael Newell Nelson, Physical memory management in a network operating system, 1988
• 16: Michael N. Nelson , Brent B. Welch , John K. Ousterhout, Caching in the Sprite network file system, ACM Transactions on Computer Systems (TOCS), v.6 n.1, p.134-154, Feb. 1988 [doi>10.1145/35037.42183]
• 17: Ohta, M,, and Tezuka, H., "A Fast/tmp File System by Delay Mount Option", USEN1X. Summer '90 Technical Conference, June 1990, pp. 145-150.
• 18: John K. Ousterhout , Hervé Da Costa , David Harrison , John A. Kunze , Mike Kupfer , James G. Thompson, A trace-driven analysis of the UNIX 4.2 BSD file system, Proceedings of the tenth ACM symposium on Operating systems principles, p.15-24, December 1985, Orcas Island, Washington, United States [doi>10.1145/323647.323631]
• 19: John Ousterhout , Fred Douglis, Beating the I/O bottleneck: a case for log-structured file systems, ACM SIGOPS Operating Systems Review, v.23 n.1, p.11-28, Jan. 1989 [doi>10.1145/65762.65765]
• 20: David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States [doi>10.1145/50202.50214]
• 21: Michael L. Powell, The DEMOS file system, Proceedings of the sixth ACM symposium on Operating systems principles, p.33-42, November 16-18, 1977, West Lafayette, Indiana, United States [doi>10.1145/800214.806545]
• 22: Reddy, A., and Banerjee, P., "Performance Evaluation of Multiple-Disk I/O Systems.", 1989 International Conference of Parallel Processing, June 1989, pp. 315-318.
• 23: Rosenblum, M,, and Ousterhout, J., "The LFS Storage Manager", USENIX-Summer '90 Technical Conference, June 1990, pp. 315-324.
• 24: M. Satyanarayanan, A study of file sizes and functional lifetimes, Proceedings of the eighth ACM symposium on Operating systems principles, p.96-108, December 14-16, 1981, Pacific Grove, California, United States [doi>10.1145/800216.806597]
• 25: Alan J. Smith, Disk cache—miss ratio analysis and design considerations, ACM Transactions on Computer Systems (TOCS), v.3 n.3, p.161-203, Aug. 1985 [doi>10.1145/3959.3961]
• 26: Liba Svobodova, A reliable object-oriented data repository for a distributed computer system, Proceedings of the eighth ACM symposium on Operating systems principles, p.47-58, December 14-16, 1981, Pacific Grove, California, United States [doi>10.1145/800216.806591]
• 27: Van Renesse, R., Tanenbaum, A. S., and Wilschut, A., "The Design of a High-Performance File Server", IEEE Transactions on Knowledge and Data Engineering, Volume 1, Number 2, june 1989, pp. 22-27.
• 28: Yokoyama, S. and Yamada, S., "A Contiguous High Performance File System", EUUG Spring '89, April 1989, pp. 197-206.

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.3 File Systems Management
          Subjects: Directory structures

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.2 Storage Management
          Subjects: Storage hierarchies

General Terms:
Design, Management, Performance