Web usage mining based on probabilistic latent semantic analysis

ABSTRACT

The primary goal of Web usage mining is the discovery of patterns in the navigational behavior of Web users. Standard approaches, such as clustering of user sessions and discovering association rules or frequent navigational paths, do not generally provide the ability to automatically characterize or quantify the unobservable factors that lead to common navigational patterns. It is, therefore, necessary to develop techniques that can automatically discover hidden semantic relationships among users as well as between users and Web objects. Probabilistic Latent Semantic Analysis (PLSA) is particularly useful in this context, since it can uncover latent semantic associations among users and pages based on the co-occurrence patterns of these pages in user sessions. In this paper, we develop a unified framework for the discovery and analysis of Web navigational patterns based on PLSA. We show the flexibility of this framework in characterizing various relationships among users and Web objects. Since these relationships are measured in terms of probabilities, we are able to use probabilistic inference to perform a variety of analysis tasks such as user segmentation, page classification, as well as predictive tasks such as collaborative recommendations. We demonstrate the effectiveness of our approach through experiments performed on real-world data sets.

REFERENCES

• 1: Corin R. Anderson , Pedro Domingos , Daniel S. Weld, Relational Markov models and their application to adaptive web navigation, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775068]
• 2: Michael W. Berry , Susan T. Dumais , Gavin W. O'Brien, Using linear algebra for intelligent information retrieval, SIAM Review, v.37 n.4, p.573-595, Dec. 1995 [doi>10.1137/1037127]
• 3: Thorsten Brants , Francine Chen , Ioannis Tsochantaridis, Topic-based document segmentation with probabilistic latent semantic analysis, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA [doi>10.1145/584792.584829]
• 4: T. Brants and R. Stolle. Find similar documents in document collections. In Proceedings of the Third International Conference on Language Resources and Evaluation(LREC-2002), Las Palmas, Spain, June 2002.
• 5: David Cohn , Huan Chang, Learning to Probabilistically Identify Authoritative Documents, Proceedings of the Seventeenth International Conference on Machine Learning, p.167-174, June 29-July 02, 2000
• 6: D. Cohn and T. Hofmann. The missing link: A probabilistic model of document content and hypertext connectivity. In T. G. D. Todd K. Leen and V. Tresp, editors, Advances in Neural Information Processing Systems 13. MIT Press, 2001.
• 7: Web Mining: Information and Pattern Discovery on the World Wide Web, Proceedings of the 9th International Conference on Tools with Artificial Intelligence, p.558, November 03-08, 1997
• 8: R. Cooley, B. Mobasher, and J. Srivastava. Data preparation for mining world wide web browsing patterns. Journal of Knowledge and Information Systems, 1(1), 1999.
• 9: H. Dai and B. Mobasher. Using ontologies to discover domain-level web usage profiles. In Proceedings of the 2nd Semantic Web Mining Workshop at ECML/PKDD 2002, Helsinki, Finland, August 2002.
• 10: S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Hashman. Indexing by latent semantic indexing. Journal of the American Society for Information Science, 41(6), 1990.
• 11: A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of Royal Statistical Society, B(39):1--38, 1977.
• 12: Éric Gaussier , Cyril Goutte , Kris Popat , Francine Chen, A Hierarchical Model for Clustering and Categorising Documents, Proceedings of the 24th BCS-IRSG European Colloquium on IR Research: Advances in Information Retrieval, p.229-247, March 25-27, 2002
• 13: R. Ghani and A. Fano. Building recommender systems using a knowledge base of product semantics. In Proceedings of the Workshop on Recommendation and Personalization in E-Commerce, at the 2nd Int'l Conf. on Adaptive Hypermedia and Adaptive Web Based Systems, Malaga, Spain, May 2002.
• 14: T. Hofmann. Probabilistic latent semantic analysis. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, Stockholm, Sweden, July 1999.
• 15: Thomas Hofmann, Probabilistic latent semantic indexing, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.50-57, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312649]
• 16: Thomas Hofmann, Unsupervised Learning by Probabilistic Latent Semantic Analysis, Machine Learning, v.42 n.1-2, p.177-196, January-February 2001 [doi>10.1023/A:1007617005950]
• 17: T. Hofmann and J. Puzicha. Unsupervised learning from dyadic data. Technical report, UC, Berkeley, Berkeley, CA, 1998.
• 18: Y. Kim, J. Chang, and B. Zhang. a empirical study on dimensionality optimization in text mining for linguistic knowledge acquisition. In Proceedings of the Seventh Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD-03), Seol, Koera, April 2003.
• 19: Ron Kohavi , Llew Mason , Rajesh Parekh , Zijian Zheng, Lessons and Challenges from Mining Retail E-Commerce Data, Machine Learning, v.57 n.1-2, p.83-113, October-November 2004 [doi>10.1023/B:MACH.0000035473.11134.83]
• 20: Nicholas Kushmerick , James McKee , Fergus Toolan, Towards Zero-Input Personalization: Referrer-Based Page Prediction, Proceedings of the International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.133-143, August 28-30, 2000
• 21: Bamshad Mobasher , Robert Cooley , Jaideep Srivastava, Creating Adaptive Web Sites Through Usage-Based Clustering of URLs, Proceedings of the 1999 Workshop on Knowledge and Data Engineering Exchange, p.19, November 07-07, 1999
• 22: Bamshad Mobasher , Robert Cooley , Jaideep Srivastava, Automatic personalization based on Web usage mining, Communications of the ACM, v.43 n.8, p.142-151, Aug. 2000 [doi>10.1145/345124.345169]
• 23: Bamshad Mobasher , Honghua Dai , Tao Luo , Yuqing Sun , Jiang Zhu, Integrating Web Usage and Content Mining for More Effective Personalization, Proceedings of the First International Conference on Electronic Commerce and Web Technologies, p.165-176, September 04-06, 2000
• 24: Bamshad Mobasher , Honghua Dai , Tao Luo , Miki Nakagawa, Discovery and Evaluation of Aggregate Usage Profiles for Web Personalization, Data Mining and Knowledge Discovery, v.6 n.1, p.61-82, January 2002 [doi>10.1023/A:1013232803866]
• 25: O. Nasraoui, R. Krishnapuram, A. Joshi, and T. Kamdar. Automatic web user profiling and personalization using robust fuzzy relational clustering. In J. Segovia, P. Szczepaniak, and M. Niedzwiedzinski, editors, Studies in Fuzziness and Soft Computing. Springer-Verlag, 2002.
• 26: Mike Perkowitz , Oren Etzioni, Adaptive Web sites: automatically synthesizing Web pages, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.727-732, July 1998, Madison, Wisconsin, United States
• 27: Dimitrios Pierrakos , Georgios Paliouras , Christos Papatheodorou , Constantine D. Spyropoulos, Web Usage Mining as a Tool for Personalization: A Survey, User Modeling and User-Adapted Interaction, v.13 n.4, p.311-372, November 2003 [doi>10.1023/A:1026238916441]
• 28: J. Pitkow and P. Pirolli. Mining longest repeating subsequences to predict www surfing. In Proceedings of the 2nd USENIX Symposium on Internet Technologies and Systems, Boulder, Colorado, October 1999.
• 29: Ramesh R. Sarukkai, Link prediction and path analysis using Markov chains, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.377-386, June 2000, Amsterdam, The Netherlands
• 30: Stuart Schechter , Murali Krishnan , Michael D. Smith, Using path profiles to predict HTTP requests, Proceedings of the seventh international conference on World Wide Web 7, p.457-467, April 1998, Brisbane, Australia
• 31: Myra Spiliopoulou, Web usage mining for Web site evaluation, Communications of the ACM, v.43 n.8, p.127-134, Aug. 2000 [doi>10.1145/345124.345167]
• 32: Myra Spiliopoulou , Bamshad Mobasher , Bettina Berendt , Miki Nakagawa, A Framework for the Evaluation of Session Reconstruction Heuristics in Web-Usage Analysis, INFORMS Journal on Computing, v.15 n.2, p.171-190, April 2003 [doi>10.1287/ijoc.15.2.171.14445]
• 33: Ramakrishnan Srikant , Yinghui Yang, Mining web logs to improve website organization, Proceedings of the 10th international conference on World Wide Web, p.430-437, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372097]
• 34: Jaideep Srivastava , Robert Cooley , Mukund Deshpande , Pang-Ning Tan, Web usage mining: discovery and applications of usage patterns from Web data, ACM SIGKDD Explorations Newsletter, v.1 n.2, January 2000 [doi>10.1145/846183.846188]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning
  I.5 PATTERN RECOGNITION
      I.5.1 Models
          Subjects: Statistical

General Terms:
Algorithms

Keywords:
PLSA, Web usage mining, user profiling