|
ABSTRACT
This paper describes the Network-Attached Secure Disk (NASD) storage architecture, prototype implementations oj NASD drives, array management for our architecture, and three, filesystems built on our prototype. NASD provides scalable storage bandwidth without the cost of servers used primarily, for transferring data from peripheral networks (e.g. SCSI) to client networks (e.g. ethernet). Increasing datuset sizes, new attachment technologies, the convergence of peripheral and interprocessor switched networks, and the increased availability of on-drive transistors motivate and enable this new architecture. NASD is based on four main principles: direct transfer to clients, secure interfaces via cryptographic support, asynchronous non-critical-path oversight, and variably-sized data objects. Measurements of our prototype system show that these services can be cost-effectively integrated into a next generation disk drive ASK. End-to-end measurements of our prototype drive andfilesysterns suggest that NASD cun support conventional distributed filesystems without performance degradation. More importantly, we show scaluble bandwidth for NASD-specialized filesystems. Using a parallel data mining application, NASD drives deliver u linear scaling of 6.2 MB/s per clientdrive pair, tested with up to eight pairs in our lab.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
 |
Acharya98
|
Anurag Acharya , Mustafa Uysal , Joel Saltz, Active disks: programming model, algorithms and evaluation, Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, p.81-91, October 02-07, 1998, San Jose, California, United States
|
| |
Agrawal94
|
|
 |
Anderson96
|
Thomas E. Anderson , Michael D. Dahlin , Jeanna M. Neefe , David A. Patterson , Drew S. Roselli , Randolph Y. Wang, Serverless network file systems, ACM Transactions on Computer Systems (TOCS), v.14 n.1, p.41-79, Feb. 1996
[doi> 10.1145/225535.225537]
|
 |
Anderson97
|
Jennifer M. Anderson , Lance M. Berc , Jeffrey Dean , Sanjay Ghemawat , Monika R. Henzinger , Shun-Tak A. Leung , Richard L. Sites , Mark T. Vandevoorde , Carl A. Waldspurger , William E. Weihl, Continuous profiling: where have all the cycles gone?, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.1-14, October 05-08, 1997, Saint Malo, France
|
| |
Anderson98a
|
Anderson, D. Network Attached Storage Research, www. nsic. org/nasd/meetings, html, March 1998.
|
| |
Anderson98b
|
Anderson, D. Network Attached Storage Research, www. nsic. org/nasd/meetings, html, June 1998.
|
| |
Anderson98c
|
Anderson, D., et al. Cheating the I/O Bottleneck: Network Storage with Trapeze/Myrinet, USENIX, June 1998.
|
 |
Baker91
|
Mary G. Baker , John H. Hartman , Michael D. Kupfer , Ken W. Shirriff , John K. Ousterhout, Measurements of a distributed file system, Proceedings of the thirteenth ACM symposium on Operating systems principles, p.198-212, October 13-16, 1991, Pacific Grove, California, United States
|
| |
Bellare96
|
|
 |
Benner96
|
|
| |
Birrell80
|
Birell, A.D. and Needham, R.M., A Universal File Server, IEEE TSE 6 (5), Sept1980.
|
| |
Boden95
|
Nanette J. Boden , Danny Cohen , Robert E. Felderman , Alan E. Kulawik , Charles L. Seitz , Jakov N. Seizovic , Wen-King Su, Myrinet: A Gigabit-per-Second Local Area Network, IEEE Micro, v.15 n.1, p.29-36, February 1995
[doi> 10.1109/40.342015]
|
| |
Cabrera91
|
Cabrera, L. and Long, D., Swift: Using Distributed Disk Striping to Provide High I/O Data Rates, Computing Systems 4:4, Fall 1991.
|
 |
Cao93
|
Pei Cao , Swee Boon Lim , Shivakumar Venkataraman , John Wilkes, The TickerTAIP parallel RAID architecture, Proceedings of the 20th annual international symposium on Computer architecture, p.52-63, May 16-19, 1993, San Diego, California, United States
|
| |
Corbett96
|
Corbett, P., et al., Proposal for a Common Parallel File System Programming Language, Scalable I/0 Initiative CalTech CACR 130, Nov 1996.
|
| |
Deering95
|
Deering, S. and Hinden, R., Intemet Protocol Version 6 Specification, RFC 1883, Dec 1995.
|
 |
deJonge93
|
Wiebren de Jonge , M. Frans Kaashoek , Wilson C. Hsieh, The logical disk: a new approach to improving file systems, Proceedings of the fourteenth ACM symposium on Operating systems principles, p.15-28, December 05-08, 1993, Asheville, North Carolina, United States
|
 |
Dennis66
|
|
 |
Drapeau94
|
A. L. Drapeau , K. W. Shirriff , J. H. Hartman , E. L. Miller , S. Seshan , R. H. Katz , K. Lutz , D. A. Patterson , E. K. Lee , P. M. Chen , G. A. Gibson, RAID-II: a high-bandwidth network file server, Proceedings of the 21ST annual international symposium on Computer architecture, p.234-244, April 18-21, 1994, Chicago, Illinois, United States
|
 |
Gibson97a
|
Garth A. Gibson , David F. Nagle , Khalil Amiri , Fay W. Chang , Eugene M. Feinberg , Howard Gobioff , Chen Lee , Berend Ozceri , Erik Riedel , David Rochberg , Jim Zelenka, File server scaling with network-attached secure disks, Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.272-284, June 15-18, 1997, Seattle, Washington, United States
|
| |
Gibson97b
|
Gibson, G., et al. Filesystems for Network- Attached Secure Disks, TR CMU-CS-97-118, July 1997.
|
| |
Gobioff97
|
Gobioff, H., Gibson, G. and Tygar, D., Security for Network Attached Storage Devices, TR CMU-CS-97- 185, Oct 1997.
|
| |
Golding95
|
Golding, R., Shriver, E., Sullivan, T., and Wilkes, J., "Attribute-managed storage," Workshop on Modeling and Specification of I/O, San Antonio, TX, Oct 1995.
|
| |
Gong89
|
Gong, L., A Secure Identity-Based Capability System IEEE Syrup. on Security and Privacy, May 1989.
|
| |
Grochowski96
|
Grochowski, E.G. and Hoyt, R.F., Future Trends in Hard Disk Drives, IEEE Trans. on Magnetics 32 (3), May 1996.
|
 |
Hartman93
|
|
| |
Hitz90
|
Hitz, D. et al., Using UNIX as One Component of a Lightweight Distributed Kernel for Multiprocessor File Servers, Winter USENIX, 1990.
|
| |
Hitz94
|
Hitz, D., Lau, J. and Malcolm, M. File Systems Design for an NFS File Server Appliance, Winter USENIX, January 1994.
|
| |
Horst95
|
|
 |
Howard88
|
John H. Howard , Michael L. Kazar , Sherri G. Menees , David A. Nichols , M. Satyanarayanan , Robert N. Sidebotham , Michael J. West, Scale and performance in a distributed file system, ACM Transactions on Computer Systems (TOCS), v.6 n.1, p.51-81, Feb. 1988
[doi> 10.1145/35037.35059]
|
| |
IEEE95
|
IEEE P1244. "Reference Model for Open Storage Systems Interconnection-Mass Storage System Reference Model Version 5", Sept 1995
|
| |
Intel97
|
Intel Corporation, Virtual Interface (VI) Architecture, www. viarch.org, Dec 1997.
|
| |
Karger88
|
Karger, RA., "Improving Security and Performance for Capability Systems", University of Cambridge Computer Laboratory Technical Report No. 149, Oct 1988.
|
| |
Knudsen96
|
|
 |
Lee96
|
|
| |
Long94
|
|
 |
Maeda93
|
|
 |
McKusick84
|
|
| |
Miller88
|
|
 |
Mitchell81
|
|
| |
MPI95
|
The MPI Forum, The Message-Passing Interface Standard, www. mcs. anl. gov/mpi/standard, html, May 1995.
|
| |
Neuman94
|
Neuman, B.C. and Ts'o, T., Kerberos: An Authentication Service for Computer Networks, IEEE Communications 32,9, Sept 1994.
|
 |
Patterson88
|
David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States
|
| |
Pricewatch98
|
www. pricewatch, com, July 1998.
|
| |
Riedel98
|
|
| |
Sachs94
|
|
| |
Sandberg85
|
Sandberg, R. et al., Design and Implementation of the Sun Network Filesystem, Summer USENIX, June 1985, pp. 119-130.
|
| |
Srivastava94
|
Srivastava, A., and Eustace, A., ATOM: A system for building customized program analysis tools, WRL Technical Report TN-41, 1994.
|
| |
Tanenbaum86
|
Tanenbaum, A.S., Mullender, S.J. and van Renesse, R., Using Sparse Capabilities in a Distributed System, Sixth Conference on Distributed Computing, 1986.
|
 |
Thekkath97
|
|
| |
TPC98
|
Transaction Performance Council TPC-C Executive Summaries, URL: www. tpc. org, Mar 1998.
|
| |
TriCore97
|
TriCore News Release, Siemens' New 32-bit Embedded Chip Architecture Enables Next Level of Performance in Real-Time Electronics Design, www. tri-core, com, Sept 1997.
|
| |
VanMeter96
|
Van Meter, R., Hotz, S. and Finn, G., Derived Virtual Devices: A Secure Distributed File System Mechanism, Fifth NASA Goddard Conference on Mass Storage Systems and Technologies, Sep 1996.
|
 |
VanMeter98
|
Rodney Van Meter , Gregory G. Finn , Steve Hotz, VISA: Netstation's virtual Internet SCSI adapter, Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, p.71-80, October 02-07, 1998, San Jose, California, United States
|
| |
Verbauwhede87
|
Verbauwhede, I. et al., H. Security Considerations in the Design and Implementation of a New DES Chip, EUROCRYPT, 1987.
|
 |
vonEicken95
|
T. von Eicken , A. Basu , V. Buch , W. Vogels, U-Net: a user-level network interface for parallel and distributed computing (includes URL), Proceedings of the fifteenth ACM symposium on Operating systems principles, p.40-53, December 03-06, 1995, Copper Mountain, Colorado, United States
|
| |
Watson95
|
|
| |
Wilkes79
|
|
| |
Wilkes92
|
Wilkes, J. Hamlyn - An Interface for Senderbased Communications, Hewlett-Packard Laboratories Technical Report HPL-OSR-92-13, Nov 1992.
|
 |
Wulf74
|
W. Wulf , E. Cohen , W. Corwin , A. Jones , R. Levin , C. Pierson , F. Pollack, HYDRA: the kernel of a multiprocessor operating system, Communications of the ACM, v.17 n.6, p.337-345, June 1974
[doi> 10.1145/355616.364017]
|
CITED BY 66
|
|
Mark Oskin , Justin Hensley , Diana Keen , Frederic T. Chong , Matthew Farrens , Aneet Chopra, Exploiting ILP in page-based intelligent memory, Proceedings of the 32nd annual ACM/IEEE international symposium on Microarchitecture, p.208-218, November 16-18, 1999, Haifa, Israel
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Anindya Neogi , Ashish Raniwala , Tzi-cker Chiueh, Phoenix: a low-power fault-tolerant real-time network-attached storage device, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.447-456, October 30-November 05, 1999, Orlando, Florida, United States
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Jay J. Wylie , Michael W. Bigrigg , John D. Strunk , Gregory R. Ganger , Han Kiliççöte , Pradeep K. Khosla, Survivable Information Storage Systems, Computer, v.33 n.8, p.61-68, August 2000
|
|
|
|
|
|
Peter Radkov , Li Yin , Pawan Goyal , Prasenjit Sarkar , Prashant Shenoy, A Performance Comparison of NFS and iSCSI for IP-Networked Storage, Proceedings of the 3rd USENIX Conference on File and Storage Technologies, March 31-31, 2004, San Francisco, CA
|
|
|
Yun Fu , Jeffrey Chase , Brent Chun , Stephen Schwab , Amin Vahdat, SHARP: an architecture for secure resource peering, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
|
|
|
|
|
|
Tara M. Madhyastha , Garth A. Gibson , Christos Faloutsos, Informed prefetching of collective input/output requests, Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM), p.13-es, November 14-19, 1999, Portland, Oregon, United States
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Yuanyuan Zhou , Angelos Bilas , Suresh Jagannathan , Dimitrios Xinidis , Cezary Dubnicki , Kai Li, VI-Attached Database Storage, IEEE Transactions on Parallel and Distributed Systems, v.16 n.1, p.35-50, January 2005
|
|
|
|
|
|
Marcos K. Aguilera , Minwen Ji , Mark Lillibridge , John MacCormick , Erwin Oertli , Dave Andersen , Mike Burrows , Timothy Mann , Chandramohan A. Thekkath, Block-Level Security for Network-Attached Disks, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
|
|
|
|
|
|
|
|
|
Wee Teck Ng , Hao Sun , Bruce Hillyer , Elizabeth Shriver , Eran Gabber , Banu Ozden, Obtaining High Performance for Storage Outsourcing, Proceedings of the 1st USENIX Conference on File and Storage Technologies, January 28-30, 2002, Monterey, CA
|
|
|
|
|
|
Amar Phanishayee , Elie Krevat , Vijay Vasudevan , David G. Andersen , Gregory R. Ganger , Garth A. Gibson , Srinivasan Seshan, Measurement and analysis of TCP throughput collapse in cluster-based storage systems, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-14, February 26-29, 2008, San Jose, California
|
|
|
Mark W. Storer , Kevin M. Greenan , Ethan L. Miller , Kaladhar Voruganti, Pergamum: replacing tape with energy efficient, reliable, disk-based archival storage, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-16, February 26-29, 2008, San Jose, California
|
|
|
Brent Welch , Marc Unangst , Zainul Abbasi , Garth Gibson , Brian Mueller , Jason Small , Jim Zelenka , Bin Zhou, Scalable performance of the Panasas parallel file system, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-17, February 26-29, 2008, San Jose, California
|
|
|
Zoe Sebepou , Kostas Magoutis , Manolis Marazakis , Angelos Bilas, A comparative experimental study of parallel file systems for large-scale data processing, First USENIX Workshop on Large-Scale Computing, p.1-10, June 22-27, 2008, Boston, MA
|
|
|
|
|
|
|
|
|
|
|
|
John MacCormick , Nick Murphy , Marc Najork , Chandramohan A. Thekkath , Lidong Zhou, Boxwood: abstractions as the foundation for storage infrastructure, Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, p.8-8, December 06-08, 2004, San Francisco, CA
|
|
|
|
|
|
|
|
|
Kostas Magoutis , Salimah Addetia , Alexandra Fedorova , Margo I. Seltzer , Jeffrey S. Chase , Andrew J. Gallatin , Richard Kisley , Rajiv Wickremesinghe , Eran Gabber, Structure and Performance of the Direct Access File System, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.1-14, June 10-15, 2002
|
|
|
|
|
|
Peng Xia , Dan Feng , Hong Jiang , Lei Tian , Fang Wang, FARMER: a novel approach to file access correlation mining and evaluation reference model for optimizing peta-scale file system performance, Proceedings of the 17th international symposium on High performance distributed computing, June 23-27, 2008, Boston, MA, USA
|
|
|
Zheng Zhang , Qiao Lian , Shiding Lin , Wei Chen , Yu Chen , Chao Jin, BitVault: a highly reliable distributed data retention platform, ACM SIGOPS Operating Systems Review, v.41 n.2, p.27-36, April 2007
|
|
|
Muthian Sivathanu , Vijayan Prabhakaran , Florentina I. Popovici , Timothy E. Denehy , Andrea C. Arpaci-Dusseau , Remzi H. Arpaci-Dusseau, Semantically-Smart Disk Systems, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Sage A. Weil , Andrew W. Leung , Scott A. Brandt , Carlos Maltzahn, RADOS: a scalable, reliable storage service for petabyte-scale storage clusters, Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07, November 11-11, 2007, Reno, Nevada
|
|
|
Elie Krevat , Vijay Vasudevan , Amar Phanishayee , David G. Andersen , Gregory R. Ganger , Garth A. Gibson , Srinivasan Seshan, On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems, Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07, November 11-11, 2007, Reno, Nevada
|
|
|
|
|
|
Ananth Devulapalli , Dennis Dalessandro , Pete Wyckoff , Nawab Ali , P. Sadayappan, Integrating parallel file systems with object-based storage devices, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada
|
|
|
Sage A. Weil , Scott A. Brandt , Ethan L. Miller , Darrell D. E. Long , Carlos Maltzahn, Ceph: a scalable, high-performance distributed file system, Proceedings of the 7th symposium on Operating systems design and implementation, November 06-08, 2006, Seattle, Washington
|
|
|
|
|
|
D. Nagle , M. E. Factor , S. Iren , D. Naor , E. Riedel , O. Rodeh , J. Satran, The ANSI T10 object-based storage standard and current implementations, IBM Journal of Research and Development, v.52 n.4, p.401-411, July 2008
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|