Mining web logs for prediction models in WWW caching and prefetching

ABSTRACT

Web caching and prefetching are well known strategies for improving the performance of Internet systems. When combined with web log mining, these strategies can decide to cache and prefetch web documents with higher accuracy. In this paper, we present an application of web log mining to obtain web-document access patterns and use these patterns to extend the well-known GDSF caching policies and prefetching policies. Using real web logs, we show that this application of data mining can achieve dramatic improvement to web-access performance.

REFERENCES

• 1: M. Arlitt, R. Friedrich L. Cherkasova, J. DiUey, and T. Jin. Evaluating content management techniques for web proxy caches. In HP Technical report, Palo Alto, Apr. 1999.
• 2: Rakesh Agrawal , Ramakrishnan Srikant, Mining Sequential Patterns, Proceedings of the Eleventh International Conference on Data Engineering, p.3-14, March 06-10, 1995
• 3: Charu Aggarwal , Joel L. Wolf , Philip S. Yu, Caching on the World Wide Web, IEEE Transactions on Knowledge and Data Engineering, v.11 n.1, p.94-107, January 1999 [doi>10.1109/69.755618]
• 4: P. Cao and S. Irani. Cost-aware www proxy caching algorithms. In USENIX Symposium on Internet Technologies and Systems, Monterey, CA, Dec. 1997.
• 5: Pitknw J. and Pirolli P. Mining longest repeating subsequences to predict www surfing. In Proceedings of the 1999 USENIX Annual Technical Conference, 1999.
• 6: T.M. Kroeger and D. D. E. Long. Predicting future filesystem actions from prior events. In USENIX 96, San Diego, Calif., Jan. 1996.
• 7: K. Chinen and S. Yamaguchi. An Interactive Prefetching Proxy Server for Improvement of WWW Latency. In Proceedings of the Seventh Annual Conference of the Internet Society (INEt'97), Kuala Lumpur, June 1997.
• 8: Stuart Schechter , Murali Krishnan , Michael D. Smith, Using path profiles to predict HTTP requests, Proceedings of the seventh international conference on World Wide Web 7, p.457-467, April 1998, Brisbane, Australia
• 9: L. Cherkasova. Improving www proxies performance with greedy-dual-size-frequency caching policy. In HP Technical Report, Palo Alto, November 1998.
• 10: Pei Cao , Edward W. Felten , Anna R. Karlin , Kai Li, A study of integrated prefetching and caching strategies, Proceedings of the 1995 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, p.188-197, May 15-19, 1995, Ottawa, Ontario, Canada
• 11: K. Chinen and S. Yamaguchi. An interactive prefetching proxy server for improvement of www latency. In Proceedings of the Seventh Annual Conference of the Internet Society (INET '97), Kuala Lumpur, Malaysia, June 1997.
• 12: D. Duchamp. Prefetching hyperlinks. In Proceedings of the Second USENIX Symposium on Internet Technologies and Systems (USITS '99), Boulder, CO, October 1999.
• 13: Zhong Su , Qiang Yang , Ye Lu , Hongjiang Zhang, WhatNext: A Prediction System for Web Requests using N-gram Sequence Models, Proceedings of the First International Conference on Web Information Systems Engineering (WISE'00)-Volume 1, p.214, June 19-20, 2000
• 14: V. Padmanabhan and J. Mogul. Using predictive prefetching to improve world of the Seventeenth International Conference on very Large Database, pages 255-264, September 1991.
• 15: Edith Cohen , Balachander Krishnamurthy , Jennifer Rexford, Evaluating Server-Assisted Cache Replacement in the Web, Proceedings of the 6th Annual European Symposium on Algorithms, p.307-319, August 24-26, 1998
• 16: M. Arlitt, R. Friedrich, L. Cherkasova, J. Dilley, and T. Jin. Evaluating content management techniques for web proxy caches. In IIP Technical report, Palo Alto, Apr. 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software

          Nouns: World Wide Web (WWW)
      H.3.5 On-line Information Services
          Subjects: Web-based services

General Terms:
Algorithms, Design, Performance

Keywords:
Application to Caching and Prefetching on the WWW, Web Log Mining