Distributed parallel data storage systems: a scalable approach to high speed image servers

ABSTRACT

We have designed, built, and analyzed a distributed parallel storage system that will supply image streams fast enough to permit multi-user, “real-time”, video-like applications in a wide-area ATM network-based Internet environment. We have based the implementation on user-level code in order to secure portability; we have characterized the performance bottlenecks arising from operating system and hardware issues, and based on this have optimized our design to make the best use of the available performance. Although at this time we have only operated with a few classes of data, the approach appears to be capable of providing a scalable, high-performance, and economical mechanism to provide a data storage system for several classes of data (including mixed multimedia streams), and for applications (clients) that operate in a high-speed network environment.

REFERENCES

• 1: Ling Tony Chen , Doron Rotem, Declustering Objects for Visualization, Proceedings of the 19th International Conference on Very Large Data Bases, p.85-96, August 24-27, 1993
• 2: S. Ghandeharizadeh , L. Ramos, Continuous Retrieval of Multimedia Data Using Parallelism, IEEE Transactions on Knowledge and Data Engineering, v.5 n.4, p.658-669, August 1993 [doi>10.1109/69.234777]
• 3: Hartman, J. H. and Ousterhout, J. K., "Zebra: A Striped Network File System", Proceedings of the USENIX Workshop on File Systems, May 1992.
• 4: Langberg, M., "Silicon Graphics Lands Cable Deal with Time Warner Inc.", San Jose Mercury News, June 8, 1993.
• 5: Leclerc, Y.G. and Lau, S.Q., Jr.,"TerraVision: A Terrain Visualization System", SRI International, Technical Note #540, Menlo Park, CA, 1994.
• 6: Mills, D., "Simple Network Time Protocol (SNTP)", RFC 1361, University of Delaware, August 1992.
• 7: Parvin, B., Peng, C., Johnston, W., and Maestre, M.,"Tracking of Tubular Objects for Scientific Applications'', IEEE Conf. on Computer Vision and Pattern Recognition, June 1994, pp. 295- 30 I
• 8: David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States
• 9: Richer, I and Fuller, B.B, "An Overview of the MAGIC Project," M93B0000173, The MITRE Corp., Bedford, MA, I Dec. 1993.
• 10: Lawrence A. Rowe , Brian C. Smith, A Continuous Media Player, Proceedings of the Third International Workshop on Network and Operating System Support for Digital Audio and Video, p.376-386, November 12-13, 1992
• 11: Tierney, B., Johnston, W., Herzog, H., Hoo, G., Jin, G., Lee, J., "System issues in Implementing High Speed Distributed Parallel Storage Systems", Proceedings of the USENIX Symposium on High Speed Networking, Aug. 1994, LBL-35775.
• 12: Brian L. Tierney , William E. Johnston , Hanan Herzog , Gary Hoo , Guojun Jin , Jason Lee , Ling Tony Chen , Doron Rotem, Using high speed networks to enable distributed parallel image server systems, Proceedings of the 1994 conference on Supercomputing, p.610-619, December 1994, Washington, D.C., United States

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  C. Computer Systems Organization
  C.1 PROCESSOR ARCHITECTURES
      C.1.2 Multiple Data Stream Architectures (Multiprocessors)
          Subjects: Parallel processors**
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design

          Nouns: Internet
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Performance attributes

General Terms:
Design, Performance