Proxy-based acceleration of dynamically generated content on the world wide web: an approach and implementation

ABSTRACT

As Internet traffic continues to grow and web sites become increasingly complex, performance and scalability are major issues for web sites. Web sites are increasingly relying on dynamic content generation applications to provide web site visitors with dynamic, interactive, and personalized experiences. However, dynamic content generation comes at a cost --- each request requires computation as well as communication across multiple components.To address these issues, various dynamic content caching approaches have been proposed. Proxy-based caching approaches store content at various locations outside the site infrastructure and can improve Web site performance by reducing content generation delays, firewall processing delays, and bandwidth requirements. However, existing proxy-based caching approaches either (a) cache at the page level, which does not guarantee that correct pages are served and provides very limited reusability, or (b) cache at the fragment level, which requires the use of pre-defined page layouts. To address these issues, several back end caching approaches have been proposed, including query result caching and fragment level caching. While back end approaches guarantee the correctness of results and offer the advantages of fine-grained caching, they neither address firewall delays nor reduce bandwidth requirements.In this paper, we present an approach and an implementation of a dynamic proxy caching technique which combines the benefits of both proxy-based and back end caching approaches, yet does not suffer from their above-mentioned limitations. Our dynamic proxy caching technique allows granular, proxy-based caching where both the content and layout can be dynamic. Our analysis of the performance of our approach indicates that it is capable of providing significant reductions in bandwidth. We have also deployed our proposed dynamic proxy caching technique at a major financial institution. The results of this implementation indicate that our technique is capable of providing order-of-magnitude reductions in bandwidth and response times in real-world dynamic Web applications.

REFERENCES

• 1: Digital Island (a Cable & Wireless Company). Digital island 2 way web services. http://www.digitalisland.net.
• 2: Virgílio Almeida , Azer Bestavros , Mark Crovella , Adriana de Oliveira, Characterizing reference locality in the WWW, Proceedings of the fourth international conference on on Parallel and distributed information systems, p.92-107, December 18-20, 1996, Miami Beach, Florida, United States
• 3: Network Appliance. http://www.netapp.com.
• 4: CacheFlow. Accelerating e-commerce with cacheflow internet caching appliances (a cacheflow white paper, October 1999.
• 5: K. Selçuk Candan , Wen-Syan Li , Qiong Luo , Wang-Pin Hsiung , Divyakant Agrawal, Enabling dynamic content caching for database-driven web sites, Proceedings of the 2001 ACM SIGMOD international conference on Management of data, p.532-543, May 21-24, 2001, Santa Barbara, California, United States
• 6: J. Challenger, P. Dantzig, and A. Iyengar. A scalable system for consistently caching dynamic web data. In Proceedings of the 18th Annual Joint Conference of the IEEE Computer and Communications Societies, 1999.
• 7: ESI Consortium. Edge side includes. http://www.esi.org, 2001.
• 8: Inktomi Corp. Inktomi network products. http://www.inktomi.com/products/network/.
• 9: Oracle Corp. Oracle 9ias database cache. http://www.oracle.com/ip/deploy/ias/db_cache_fov.html.
• 10: Vignette Corp. Vignette content suite. http://www.vignette.com.
• 11: IBM. Corporation. Ibm websphere edge server version 2.0 (product documentation), 2001.
• 12: Carlos Cunha , Azer Bestavros , Mark Crovella, Characteristics of WWW Client-based Traces, Boston University, Boston, MA, 1995
• 13: Anindya Datta , Kaushik Dutta , Helen M. Thomas , Debra E. VanderMeer , Krithi Ramamritham , Dan Fishman, A Comparative Study of Alternative Middle Tier Caching Solutions to Support Dynamic Web Content Acceleration, Proceedings of the 27th International Conference on Very Large Data Bases, p.667-670, September 11-14, 2001
• 14: Anindya Datta , Kaushik Dutta , Krithi Ramamritham , Helen Thomas , Debra VanderMeer, Dynamic content acceleration: a caching solution to enable scalable dynamic Web page generation, Proceedings of the 2001 ACM SIGMOD international conference on Management of data, p.616, May 21-24, 2001, Santa Barbara, California, United States
• 15: S. Gadde , M. Rabinovich , J. Chase, Reduce, Reuse, Recycle: An Approach to Building Large Internet Caches, Proceedings of the 6th Workshop on Hot Topics in Operating Systems (HotOS-VI), p.93, May 05-06, 1997
• 16: Erich Gamma , Richard Helm , Ralph Johnson , John Vlissides, Design patterns: elements of reusable object-oriented software, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 17: IBM. Websphere application server. http://www.ibm.com.
• 18: D. Knuth, J. Morris, and V. Pratt. Fast pattern matching in strings. SIAM Journal of Computing, 6(2):323-350, June 1977.
• 19: Qiong Luo , Jeffrey F. Naughton, Form-Based Proxy Caching for Database-Backed Web Sites, Proceedings of the 27th International Conference on Very Large Data Bases, p.191-200, September 11-14, 2001
• 20: Qiong Luo , Jeffrey F. Naughton , Rajasekar Krishnamurthy , Pei Cao , Yunrui Li, Active Query Caching for Database Web Servers, Selected papers from the Third International Workshop WebDB 2000 on The World Wide Web and Databases, p.92-104, May 18-19, 2000
• 21: Microsoft. Asp, c#, vbscript, and asp+. http://www.microsoft.com.
• 22: Sun Microsystems. Java servlets and jsp. http://java.sun.com.
• 23: C. Mohan, Caching Technologies for Web Applications, Proceedings of the 27th International Conference on Very Large Data Bases, p.726, September 11-14, 2001
• 24: Perl. http://www.perl.org.
• 25: Michael Rabinovich , Amit Aggarwal, RaDaR: a scalable architecture for a global Web hosting service, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.31 n.11-16, p.1545-1561, May 17, 1999
• 26: Morgan Stanley Dean Witter Analyst Report. The Internet Evolution - Content Delivery Networks. Morgan Stanley Dean Witter, November 2000.
• 27: Microsoft ISA Server. http://www.microsoft.com/isaserver.
• 28: TimesTen Software. http://www.timesten.com.
• 29: SpiderCache. http://www.spidercache.com.
• 30: BEA Systems. Weblogic application server. http://www.bea.com/products/weblogic/index.html.
• 31: Akamai Technologies. http://www.akamai.com.
• 32: Chutney Technologies. http://www.chutneytech.com.
• 33: Sniffer Technologies. Sniffer basic. http://www.sniffer.com/products/sniffer-basic/.
• 34: Khaled Yagoub , Daniela Florescu , Valérie Issarny , Patrick Valduriez, Caching Strategies for Data-Intensive Web Sites, Proceedings of the 26th International Conference on Very Large Data Bases, p.188-199, September 10-14, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Distributed systems

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)
      H.3.5 On-line Information Services
          Subjects: Web-based services

General Terms:
Design, Performance

Keywords:
dynamic content, edge caching, proxy-based caching