Web mining for web personalization

ABSTRACT

Web personalization is the process of customizing a Web site to the needs of specific users, taking advantage of the knowledge acquired from the analysis of the user's navigational behavior (usage data) in correlation with other information collected in the Web context, namely, structure, content, and user profile data. Due to the explosive growth of the Web, the domain of Web personalization has gained great momentum both in the research and commercial areas. In this article we present a survey of the use of Web mining for Web personalization. More specifically, we introduce the modules that comprise a Web personalization system, emphasizing the Web usage mining module. A review of the most common methods that are used as well as technical issues that occur is given, along with a brief overview of the most popular tools and applications available from software vendors. Moreover, the most important research initiatives in the Web usage mining and personalization areas are presented.

REFERENCES

• 1: Berendt, B. 2000. Web usage mining, site semantics, and the support of navigation. In Proceedings of the Workshop WEBKDD'2000 Web Mining for E-Commerce---Challenges and Opportunities, Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Boston, August).
• 2: Berendt, B. 2001. Understanding Web usage at different levels of abstraction: Coarsening and visualizing sequences. In Proceedings of the Workshop WEBKDD 2001 Mining Log Data Across All Customer TouchPoints, Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, August).
• 3: José Borges , Mark Levene, Data Mining of User Navigation Patterns, Revised Papers from the International Workshop on Web Usage Analysis and User Profiling, p.92-111, August 15, 1999
• 4: Alex G. Büchner , Maurice D. Mulvenna, Discovering Internet marketing intelligence through online analytical web usage mining, ACM SIGMOD Record, v.27 n.4, p.54-61, Dec. 1998 [doi>10.1145/306101.306124]
• 5: Matthias Baumgarten , Alex G. Büchner , Sarabjot S. Anand , Maurice D. Mulvenna , John G. Hughes, User-Driven Navigation Pattern Discovery from Internet Data, Revised Papers from the International Workshop on Web Usage Analysis and User Profiling, p.74-91, August 15, 1999
• 6: Data mining for path traversal patterns in a web environment, Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96), p.385, May 27-30, 1996
• 7: Ibrahim Cingil , Asuman Dogac , Ayca Azgin, A broader approach to personalization, Communications of the ACM, v.43 n.8, p.136-141, Aug. 2000 [doi>10.1145/345124.345168]
• 8: Coenen, F., Swinnen, G., Vanhoof, K., and Wets, G. 2000. A framework for self adaptive websites: Tactical versus strategic changes. In proceedings of WEBKDD'2000 Web Mining for E-Commerce---Challenges and Opportunities, Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Boston, August).
• 9: Cooley, R., Mobasher, B., and Srivastava, J. 1999a. Data preparation for mining world wide web browsing patterns. Knowl. Inf. Syst., 1, 1 (Feb.).
• 10: Cooley, R., Tan, P.-N., and Srivastava, J. 1999b. WebSIFT: The web site information filter system. In Proceedings of the Web Usage Analysis and User Profiling Workshop (WEBKDD'99), Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Diego, August).
• 11: Dean, R. 1998. Personalizing your web site. Available at http://Webbuilder.netscape.com/Web-building/pages/Business/Personal/index.html.
• 12: Joshua Zhexue Huang , Michael K. Ng , Wai-Ki Ching , Joe Ng , David Wai-Lok Cheung, A Cube Model and Cluster Analysis for Web Access Sessions, Revised Papers from the Third International Workshop on Mining Web Log Data Across All Customers Touch Points, p.48-67, August 26, 2001
• 13: Joachims, T., Freitag, D., and Mitchell, T. 1997. WebWatcher: A tour guide for the world wide web. In Proceedings of IJCAI97 (August).
• 14: Joshi, A., Joshi, K., and Krishnapuram, R. 2000. On mining web access logs. In Proceedings of the 2000 ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, 63--69.
• 15: Krishnapuram, R., Joshi, A., Nasraoui, O., and Yi, L. 2001. Low-complexity fuzzy relational clustering algorithms for web mining, IEEE Trans. Fuzzy Syst. 9, 4, 596--607.
• 16: Lieberman, H. 1995. Letizia: An agent that assists web browsing. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (Montreal).
• 17: Florent Masseglia , Pascal Poncelet , Rosine Cicchetti, WebTool: An Integrated Framework for Data Mining, Proceedings of the 10th International Conference on Database and Expert Systems Applications, p.892-901, August 30-September 03, 1999
• 18: F. Masseglia , P. Poncelet , M. Teisseire, Using data mining techniques on Web access logs to dynamically improve hypertext structure, ACM SIGWEB Newsletter, v.8 n.3, p.13-19, October 1999 [doi>10.1145/951440.951443]
• 19: Florent Masseglia , Pascal Poncelet , Maguelonne Teisseire, Web Usage Mining: How to Efficiently Manage New Transactions and New Clients, Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery, p.530-535, September 13-16, 2000
• 20: Mladenic, D. 1999. Machine learning used by personal webwatcher. In Proceedings Of ACAI-99 Workshop on Machine Learning and Intelligent Agents (Chania, Greece, July).
• 21: Bamshad Mobasher , Robert Cooley , Jaideep Srivastava, Creating Adaptive Web Sites Through Usage-Based Clustering of URLs, Proceedings of the 1999 Workshop on Knowledge and Data Engineering Exchange, p.19, November 07-07, 1999
• 22: Bamshad Mobasher , Robert Cooley , Jaideep Srivastava, Automatic personalization based on Web usage mining, Communications of the ACM, v.43 n.8, p.142-151, Aug. 2000 [doi>10.1145/345124.345169]
• 23: Mobasher, B., Dai, H., Luo, T., Sung, Y., and Zhu, J. 2000b. Discovery of aggregate usage profiles for web personalization. In Proceedings of the Web Mining for E-Commerce Workshop (WEBKDD'2000), Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Boston, August).
• 24: Bamshad Mobasher , Honghua Dai , Tao Luo , Yuqing Sun , Jiang Zhu, Integrating Web Usage and Content Mining for More Effective Personalization, Proceedings of the First International Conference on Electronic Commerce and Web Technologies, p.165-176, September 04-06, 2000
• 25: Maurice D. Mulvenna , Sarabjot S. Anand , Alex G. Büchner, Personalization on the Net using Web mining: introduction, Communications of the ACM, v.43 n.8, p.122-125, Aug. 2000 [doi>10.1145/345124.345165]
• 26: Nasraoui, O., Frigui, H., Krishnapuram, R., and Joshi, A. 2000. Extracting web user profiles using relational competitive fuzzy clustering. Int. J. Arti. Intell. Tools 9, 4.
• 27: P3P. Platform for Privacy Preferences Project. Available at http://www.w3.org/P3P.
• 28: Perkowitz, M. and Etzioni, O. 1997. Adaptive web sites: An AI challenge. In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (Nagoya, Japan).
• 29: Mike Perkowitz , Oren Etzioni, Adaptive Web sites: automatically synthesizing Web pages, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.727-732, July 1998, Madison, Wisconsin, United States
• 30: Mike Perkowitz , Oren Etzioni, Adaptive Web Sites: Conceptual Cluster Mining, Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, p.264-269, July 31-August 06, 1999
• 31: Mike Perkowitz , Oren Etzioni, Towards adaptive Web sites: conceptual framework and case study, Artificial Intelligence, v.118 n.1-2, p.245-275, April 2000 [doi>10.1016/S0004-3702(99)00098-3]
• 32: Mike Perkowitz , Oren Etzioni, Adaptive Web sites, Communications of the ACM, v.43 n.8, p.152-158, Aug. 2000 [doi>10.1145/345124.345171]
• 33: RFC. Identification Protocol. Available at http://www.rfc-editor.org/rfc/rfc1413.txt.
• 34: C. Shahabi , A. M. Zarkesh , J. Adibi , V. Shah, Knowledge discovery from users Web-page navigation, Proceedings of the 7th International Workshop on Research Issues in Data Engineering (RIDE '97) High Performance Database Management for Large-Scale Applications, p.20, April 07-08, 1997
• 35: Myra Spiliopoulou, Web usage mining for Web site evaluation, Communications of the ACM, v.43 n.8, p.127-134, Aug. 2000 [doi>10.1145/345124.345167]
• 36: Spiliopoulou, M. and Faulstich, L. C. 1998. WUM: A web utilization miner. In Proceedings of the International Workshop on the Web and Databases (Valencia, March).
• 37: Spiliopoulou, M., Faulstich, L. C., and Wilkler, K. 1999. A data miner analyzing the navigational behavior of web users. In Proceedings of the Workshop on Machine Learning in User Modelling of the ACAI99 (Chania, Greece, July).
• 38: Jaideep Srivastava , Robert Cooley , Mukund Deshpande , Pang-Ning Tan, Web usage mining: discovery and applications of usage patterns from Web data, ACM SIGKDD Explorations Newsletter, v.1 n.2, January 2000 [doi>10.1145/846183.846188]
• 39: W3Clog. Extended log file format. Available at http://www.w3.org/TR/WD-logfile.html.
• 40: WCA. Web characterization terminology & definitions. Available at http://www.w3.org/ 1999/05/WCA-terms/.
• 41: K.-L. Wu , P. S. Yu , A. Ballman, SpeedTracer: a Web usage mining and analysis tool, IBM Systems Journal, v.37 n.1, p.89-105, 1997
• 42: Tak Woon Yan , Matthew Jacobsen , Hector Garcia-Molina , Umeshwar Dayal, From user access patterns to dynamic hypertext linking, Proceedings of the fifth international World Wide Web conference on Computer networks and ISDN systems, p.1007-1014, May 1996, Paris, France
• 43: Osmar R. Zaïane , Man Xin , Jiawei Han, Discovering Web Access Patterns and Trends by Applying OLAP and Data Mining Technology on Web Logs, Proceedings of the Advances in Digital Libraries Conference, p.19, April 22-24, 1998

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services

Additional Classification:
  A. General Literature
  A.1 INTRODUCTORY AND SURVEY

  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications

General Terms:
Algorithms, Design, Theory

Keywords:
WWW, Web personalization, Web usage mining, user profiling