Overview of the Vesta parallel file system

ABSTRACT

The Vesta parallel file system provides parallel access from compute nodes to files distributed across I/O nodes in a massively parallel computer. Vesta is intended to solve the I/O problems of massively parallel computers executing numerically intensive scientific applications. Vesta has three interesting characteristics: First, it provides a user defined parallel view of file data, and allows user defined partitioning and repartitioning of files without moving data among I/O nodes. The parallel file access semantics of Vesta directly support the operations required by parallel language I/O libraries. Second, Vesta is scalable to a very large number (many hundreds) of I/O and compute nodes and does not contain any sequential bottlenecks in the data-access path. Third, it provides user-directed checkpointing of files during continuing program execution with very little processing overhead.

REFERENCES

• 1: Peter M. Chen , Garth A. Gibson , Randy H. Katz , David A. Patterson, An evaluation of redundant arrays of disks using an Amdahl 5890, Proceedings of the 1990 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.74-85, April 1990, Univ. of Colorado, Boulder, Colorado, United States
• 2: Peter M. Chen , David A. Patterson, Maximizing performance in a striped disk array, Proceedings of the 17th annual international symposium on Computer Architecture, p.322-331, May 28-31, 1990, Seattle, Washington, United States
• 3: Ann L. Chervenak , Randy H. Katz, Performance of a disk array protype, Proceedings of the 1991 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.188-197, May 21-24, 1991, San Diego, California, United States
• 4: [4] E. DeBenedictis and J. M. del Rosario, "nCUBE parallel I/O software". In 11th Intl. Phoenix Conf. Computers & Communications , pp. 117-124, Apr 1992.
• 5: [5] P. C. Dibble, M. L. Scott, and C. S. Ellis, "Bridge: a high-performance file system [or parallel processors". In 8th Intl. Conf. Distributed Comput. Syst., pp. 154-161, 1988.
• 6: [6] J. Edler, J. Lipkis, and E. Schonberg, "Memory management in Symunix II: a design for large-scale shared memory multiprocessors ". In Proc. Workshop on UNIX and Supercomputers, pp. 151-168, USENIX, Sep 1988.
• 7: Maurice P. Herlihy , Jeannette M. Wing, Linearizability: a correctness condition for concurrent objects, ACM Transactions on Programming Languages and Systems (TOPLAS), v.12 n.3, p.463-492, July 1990 [doi>10.1145/78969.78972]
• 8: [8] R. H. Katz, G. A. Gibson, and D. A. Patterson, "Disk system architectures for high performance computing". Proc. IEEE 77(12), pp. 1842-1858, Dec 1989.
• 9: M Y Kim, Synchronized Disk Interleaving, IEEE Transactions on Computers, v.35 n.11, p.978-988, November 1986 [doi>10.1109/TC.1986.1676699]
• 10: James J. Kistler , M. Satyanarayanan, Disconnected operation in the Coda File System, ACM Transactions on Computer Systems (TOCS), v.10 n.1, p.3-25, Feb. 1992 [doi>10.1145/146941.146942]
• 11: C. Koelbel , P. Mehrotra, Compiling Global Name-Space Parallel Loops for Distributed Execution, IEEE Transactions on Parallel and Distributed Systems, v.2 n.4, p.440-451, October 1991 [doi>10.1109/71.97901]
• 12: D. F. Kotz , C. S. Ellis, Prefetching in File Systems for MIMD Multiprocessors, IEEE Transactions on Parallel and Distributed Systems, v.1 n.2, p.218-230, April 1990 [doi>10.1109/71.80133]
• 13: [13] L. Lamport, "How to make a multiprocessor computer that correctly executes multiprocess programs". IEEE Trans. Comput. C-28(9), pp. 690-691, Sep 1979.
• 14: Edward K. Lee , Randy H. Katz, Performance consequences of parity placement in disk arrays, Proceedings of the fourth international conference on Architectural support for programming languages and operating systems, p.190-199, April 08-11, 1991, Santa Clara, California, United States
• 15: Michael N. Nelson , Brent B. Welch , John K. Ousterhout, Caching in the Sprite network file system, ACM Transactions on Computer Systems (TOCS), v.6 n.1, p.134-154, Feb. 1988 [doi>10.1145/35037.42183]
• 16: S. Ng , D. Lang , R. Selinger, Trade-offs between devices and paths in achieving disk interleaving, Proceedings of the 15th Annual International Symposium on Computer architecture, p.196-201, May 30-June 02, 1988, Honolulu, Hawaii, United States
• 17: David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States
• 18: [18] P. Pierce, "A concurrent file system for a highly parallel mass storage subsystem". In 4th Conf. Hypercubes, Concurrent Comput., & Appl., vol. I, pp. 155-160, Mar 1989.
• 19: Richard Rashid , Avadis Tevanin, Jr. , Michael Young , David Golub , Robert Baron, Machine-Independent Virtual Memory Management for Paged Uniprocessor and Multiprocessor Architectures, IEEE Transactions on Computers, v.37 n.8, p.896-908, August 1988 [doi>10.1109/12.2242]
• 20: A. L. Reddy , P. Banerjee, An Evaluation of Multiple-Disk I/O Systems, IEEE Transactions on Computers, v.38 n.12, p.1680-1690, December 1989 [doi>10.1109/12.40846]
• 21: Kenneth Salem , Hector Garcia-Molina, Disk Striping, Proceedings of the Second International Conference on Data Engineering, p.336-342, February 05-07, 1986
• 22: Mahadev Satyanarayanan, Scalable, Secure, and Highly Available Distributed File Access, Computer, v.23 n.5, p.9-18, 20-21, May 1990 [doi>10.1109/2.53351]
• 23: Mahadev Satyanarayanan , James J. Kistler , Puneet Kumar , Maria E. Okasaki , Ellen H. Siegel , David C. Steere, Coda: A Highly Available File System for a Distributed Workstation Environment, IEEE Transactions on Computers, v.39 n.4, p.447-459, April 1990 [doi>10.1109/12.54838]
• 24: [24] D.C. Stokes, "DCE DIS vs. AFS: a disrtributed file system comparison". In UNITE! 92, pp. 1-12, 1992.

INDEX TERMS

Primary Classification:
  F. Theory of Computation
  F.1 COMPUTATION BY ABSTRACT DEVICES
      F.1.2 Modes of Computation
          Subjects: Parallelism and concurrency

Additional Classification:
  C. Computer Systems Organization
  C.1 PROCESSOR ARCHITECTURES

  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces
  D.4 OPERATING SYSTEMS

General Terms:
Design, Human Factors, Performance, Theory