Let's put NetApp and CacheFlow out of business!

ABSTRACT

We believe that a lightweight and portable specialized file system library can provide applications with performance close to that of special-built appliances running on closed proprietary operating systems. Moreover, the application may execute on commodity hardware with a general-purpose operating system, and with minimal changes to the application source code. Such a file system would allow anyone to build cheap, high-performance appliances. We present the design of Hummingbird, a file system for caching web proxies. Hummingbird is 6-11 times faster than a general-purpose file system when serving a web proxy cache.

REFERENCES

• 1: {Brustoloni99} José Carlos Brustoloni. Interoperation of copy avoidance in network and file I/O. Proceedings of the INFOCOM'99 Conference (New York, NY), pages 534-542, March 1999.
• 2: {CacheFlow98} High-performance web caching white paper. Technical report. CacheFlow, 1998. Available at http://www.cacheflow.com/technology/wp/hp_cache.html.
• 3: {Danzig98} Peter Danzig. NetCache architecture and deployment. Technical report. Network Appliance, 1998. Available at http://www.netapp.com/technology/level3/3029.html.
• 4: {Ganger94} Gregory R. Ganger and Yale N. Patt. Metadata update performance in file systems. Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation (OSDI) (Monterey, CA), pages 49-60, November 1994.
• 5: {Ganger97} Gregory R. Ganger and M. Frans Kaashoek. Embedded inodes and explicit grouping: exploiting disk bandwidth for small files. Proceedings of the USENIX 1997 Annual Technical Conference (Anaheim, CA), pages 1-17, January 1997.
• 6: R. Hagmann, Reimplementing the Cedar file system using logging and group commit, Proceedings of the eleventh ACM Symposium on Operating systems principles, p.155-162, November 08-11, 1987, Austin, Texas, United States
• 7: {Hitz94} Dave Hitz, James Lau, and Michael Malcolm. File system design for an NFS file server appliance. Proceedings of the USENIX 1994 Winter Technical Conference (San Francisco, CA), pages 235-246, January 1994.
• 8: {IBM93} IBM VSE/Virtual Storage Access Method User's Guide. IBM Corp., 1993.
• 9: M. Frans Kaashoek , Dawson R. Engler , Gregory R. Ganger , Deborah A. Wallach, Server operating systems, Proceedings of the 7th workshop on ACM SIGOPS European workshop: Systems support for worldwide applications, September 09-11, 1996, Connemara, Ireland [doi>10.1145/504450.504478]
• 10: {Martin96} Cliff Martin, P. S. Narayan, Banu Ozden, Rajeev Rastogi, and Avi Silberschatz. The Fellini multimedia storage system. In Soon M. Chung, editor, Multimedia Information Storage and Management. Kluwer Academic Publishers, August 1996.
• 11: Marshall K. McKusick , William N. Joy , Samuel J. Leffler , Robert S. Fabry, A fast file system for UNIX, ACM Transactions on Computer Systems (TOCS), v.2 n.3, p.181-197, Aug. 1984 [doi>10.1145/989.990]
• 12: {Novell} The Novell ICS Advantage: Competitive White Paper. Technical report. Novell. Available at http://www.novell.com/advantage/nics/nics-compwp.html.
• 13: Vivek S. Pai , Peter Druschel , Willy Zwaenepoel, IO-lite: a unified I/O buffering and caching system, Proceedings of the third symposium on Operating systems design and implementation, p.15-28, February 1999, New Orleans, Louisiana, United States
• 14: Alex Rousskov , Valery Soloviev, A performance study of the Squid proxy on HTTP/1.0, World Wide Web, v.2 n.1-2, p.47-67, 1999 [doi>10.1023/A:1019240520661]