File concepts for parallel I/O

ABSTRACT

The subject of I/O has often been neglected in the design of parallel computer systems, although for many problems I/O rates will limit the speedup attainable. The I/O problem is addressed here by considering the role of files in parallel systems. The notion of parallel files is introduced. Parallel files provide for concurrent access by multiple processes, and utilize parallelism in the I/O system to improve performance. Parallel files can also be used conventionally by sequential programs. A set of standard parallel file organizations is proposed, based on common data partitioning techniques. Implementation strategies for the proposed organizations are suggested, using multiple storage devices. Problem areas are also identified and discussed.

REFERENCES

• 1: Kenneth Salem , Hector Garcia-Molina, Disk Striping, Proceedings of the Second International Conference on Data Engineering, p.336-342, February 05-07, 1986
• 2: Miron Livny , Setrag Khoshafian , Haran Boral, Multi-disk management algorithms, Proceedings of the 1987 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.69-77, May 11-14, 1987, Banff, Alberta, Canada
• 3: M Y Kim, Synchronized disk interleaving, IEEE Transactions on Computers, v.35 n.11, p.978-988, Nov. 1986 [doi>10.1109/TC.1986.1676699]
• 4: M. Kim and A. Tantawi, "Asynchronous Disk Interleaving," RC 12497, IBM T. J. Watson Research Center, Yorktown Heights, NY, Feb. 1987.
• 5: T. Crockett and J. Knott, "System Software for the Finire Element Machine," CR 3870, National Aeronautics and Space Administration, Washington, DC, Feb. 1985.
• 6: P. Dibble, M. Scott, and C. Ellis, "Bridge: A High- Performance File System for Parallel Processors," Proceedings of the 1988 International Conference on Distributed Computing Systems, pp. 154-16 I.
• 7: P. Pierce, "A Concurrent File System for a Highly Parallel Mass Storage Subsystem", Fourth Conference on Hypercubes, Concurrent Computers, and Applications, March 1989.
• 8: David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.4 Communications Management
          Subjects: Input/output

Additional Classification:
  C. Computer Systems Organization
  C.1 PROCESSOR ARCHITECTURES
      C.1.3 Other Architecture Styles
          Subjects: Stack-oriented processors**

  D. Software
  D.4 OPERATING SYSTEMS
      D.4.1 Process Management
          Subjects: Concurrency
      D.4.3 File Systems Management
          Subjects: File organization

General Terms:
Design