Squirrel: a decentralized peer-to-peer web cache

ABSTRACT

This paper presents a decentralized, peer-to-peer web cache called Squirrel. The key idea is to enable web browsers on desktop machines to share their local caches, to form an efficient and scalable web cache, without the need for dedicated hardware and the associated administrative cost. We propose and evaluate decentralized web caching algorithms for Squirrel, and discover that it exhibits performance comparable to a centralized web cache in terms of hit ratio, bandwidth usage and latency. It also achieves the benefits of decentralization, such as being scalable, self-organizing and resilient to node failures, while imposing low overhead on the participating nodes.

REFERENCES

• 1: F. 180-1. Secure hash standard. Technical Report Publication 180-1, Federal Information Processing Standard (FIPS), National Institute of Standards and Technology, US Department of Commerce, Washington D.C., Apr. 1995.
• 2: William J. Bolosky , John R. Douceur , David Ely , Marvin Theimer, Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs, Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.34-43, June 18-21, 2000, Santa Clara, California, United States
• 3: C. Mic Bowman , Peter B. Danzig , Darren R. Hardy , Udi Manber , Michael F. Schwartz, The Harvest information discovery and access system, Computer Networks and ISDN Systems, v.28 n.1-2, p.119-125, Dec. 1995 [doi>10.1016/0169-7552(95)00098-5]
• 4: M. Busari and C. Williamson. On the sensitivity of web proxy cache performance to workload characteristics. In Proceedings of IEEE INFOCOM, Anchorage, Alaska, Apr. 2001.
• 5: R. Caceres, F. Douglis, A. Feldmann, G. Glass, and M. Rabinovich. Web proxy caching: the devil is in the details. In Proceedings of the Workshop on Internet Server Performance, Madison, WI, May 1999.
• 6: A. Chankhunthod, P. Danzig, C. Neerdaels, M. F. Schwartz, and K. J. Worrell. A hierarchical Internet object cache. In Proceedings of the 1996 Usenix Technical Conference, San Diego, CA, Jan. 1996.
• 7: Frank Dabek , M. Frans Kaashoek , David Karger , Robert Morris , Ion Stoica, Wide-area cooperative storage with CFS, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 8: Adam Dingle , Tomáš Pártl, Web cache coherence, Proceedings of the fifth international World Wide Web conference on Computer networks and ISDN systems, p.907-920, May 1996, Paris, France
• 9: S. Gadde, J. Chase, and M. Rabinovich. A taste of crispy Squid. In Proceedings of the Workshop on Internet Server Performance, Madison, WI, June 1998.
• 10: Michal Kurcewicz , Wojtek Sylwestrzak , Adam Wierzbicki, A distributed WWW cache, Computer Networks and ISDN Systems, v.30 n.22-23, p.2261-2267, Nov. 25, 1998 [doi>10.1016/S0169-7552(98)00243-8]
• 11: M. Nottingham. Caching tutorial for web authors and webmasters. http://www.mnot.net/cache_docs/.
• 12: Venkata N. Padmanabhan , Kunwadee Sripanidkulchai, The Case for Cooperative Networking, Revised Papers from the First International Workshop on Peer-to-Peer Systems, p.178-190, March 07-08, 2002
• 13: Sylvia Ratnasamy , Paul Francis , Mark Handley , Richard Karp , Scott Schenker, A scalable content-addressable network, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.161-172, August 2001, San Diego, California, United States
• 14: P. Romine. LAN-Based web caching for accelerated web access. Mangosoft Technical White Paper, http://www.mangosoft.com/products/cachelink.
• 15: Antony I. T. Rowstron , Peter Druschel, Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems, Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg, p.329-350, November 12-16, 2001
• 16: Antony Rowstron , Peter Druschel, Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 17: Antony I. T. Rowstron , Anne-Marie Kermarrec , Miguel Castro , Peter Druschel, SCRIBE: The Design of a Large-Scale Event Notification Infrastructure, Proceedings of the Third International COST264 Workshop on Networked Group Communication, p.30-43, November 07-09, 2001
• 18: Tyron Stading , Petros Maniatis , Mary Baker, Peer-to-Peer Caching Schemes to Address Flash Crowds, Revised Papers from the First International Workshop on Peer-to-Peer Systems, p.203-213, March 07-08, 2002
• 19: Ion Stoica , Robert Morris , David Karger , M. Frans Kaashoek , Hari Balakrishnan, Chord: A scalable peer-to-peer lookup service for internet applications, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.149-160, August 2001, San Diego, California, United States
• 20: Renu Tewari , Michael Dahlin , Harrick Vin, Design Considerations for Distributed Caching on the Internet, University of Texas at Austin, Austin, TX, 1998
• 21: References for cacheability of web content. http://www.cs.rice.edu/~ssiyer/r/squirrel/links.html.
• 22: Jia Wang, A survey of web caching schemes for the Internet, ACM SIGCOMM Computer Communication Review, v.29 n.5, October 1999 [doi>10.1145/505696.505701]
• 23: D. Wessel. Squid internet object cache. http://squid.nlanr.net/.
• 24: Alec Wolman , M. Voelker , Nitin Sharma , Neal Cardwell , Anna Karlin , Henry M. Levy, On the scale and performance of cooperative Web proxy caching, Proceedings of the seventeenth ACM symposium on Operating systems principles, p.16-31, December 12-15, 1999, Charleston, South Carolina, United States
• 25: Ben Y. Zhao , John D. Kubiatowicz , Anthony D. Joseph, Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and, University of California at Berkeley, Berkeley, CA, 2001