Incorporating contextual information in recommender systems using a multidimensional approach

ABSTRACT

The article presents a multidimensional (MD) approach to recommender systems that can provide recommendations based on additional contextual information besides the typical information on users and items used in most of the current recommender systems. This approach supports multiple dimensions, profiling information, and hierarchical aggregation of recommendations. The article also presents a multidimensional rating estimation method capable of selecting two-dimensional segments of ratings pertinent to the recommendation context and applying standard collaborative filtering or other traditional two-dimensional rating estimation techniques to these segments. A comparison of the multidimensional and two-dimensional rating estimation approaches is made, and the tradeoffs between the two are studied. Moreover, the article introduces a combined rating estimation method, which identifies the situations where the MD approach outperforms the standard two-dimensional approach and uses the MD approach in those situations and the standard two-dimensional approach elsewhere. Finally, the article presents a pilot empirical study of the combined approach, using a multidimensional movie recommender system that was developed for implementing this approach and testing its performance.

REFERENCES

• 1: Gediminas Adomavicius , Alexander Tuzhilin, Multidimensional Recommender Systems: A Data Warehousing Approach, Proceedings of the Second International Workshop on Electronic Commerce, p.180-192, November 16-17, 2001
• 2: Gediminas Adomavicius , Alexander Tuzhilin, Expert-Driven Validation of Rule-Based User Models in Personalization Applications, Data Mining and Knowledge Discovery, v.5 n.1-2, p.33-58, January-April 2001 [doi>10.1023/A:1009839827683]
• 3: Charu C. Aggarwal , Joel L. Wolf , Kun-Lung Wu , Philip S. Yu, Horting hatches an egg: a new graph-theoretic approach to collaborative filtering, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.201-212, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312230]
• 4: Ansari, A., Essegaier, S., and Kohli, R. 2000. Internet recommendation systems. J. Market. Res. 37, 3, 363--375.
• 5: Christopher G. Atkeson , Andrew W. Moore , Stefan Schaal, Locally Weighted Learning, Artificial Intelligence Review, v.11 n.1-5, p.11-73, Feb. 1997 [doi>10.1023/A:1006559212014]
• 6: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 7: Marko Balabanović , Yoav Shoham, Fab: content-based, collaborative recommendation, Communications of the ACM, v.40 n.3, p.66-72, March 1997 [doi>10.1145/245108.245124]
• 8: Chumki Basu , Haym Hirsh , William Cohen, Recommendation as classification: using social and content-based information in recommendation, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.714-720, July 1998, Madison, Wisconsin, United States
• 9: Bettman, J. R., Johnson, E. J., and Payne, J. W. 1991. Consumer Decision Making. In Handbook of Consumer Behavior, T. Robertson and H. Kassarjian, Eds. Prentice Hall, 50--84.
• 10: Daniel Billsus , Michael J. Pazzani, Learning Collaborative Information Filters, Proceedings of the Fifteenth International Conference on Machine Learning, p.46-54, July 24-27, 1998
• 11: Daniel Billsus , Michael J. Pazzani, User Modeling for Adaptive News Access, User Modeling and User-Adapted Interaction, v.10 n.2-3, p.147-180, 2000 [doi>10.1023/A:1026501525781]
• 12: Breese, J. S., Heckerman, D., and Kadie, C. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, Madison, WI.
• 13: Caglayan, A., Snorrason, M., Jacoby, J., Mazzu, J., Jones, R., and Kumar, K. 1997. Learn Sesame---a learning agent engine. Appl. Artif. Intell. 11, 393--412.
• 14: Chatterjee, S., Hadi, A. S., and Price, B. 2000. Regression Analysis by Example. John Wiley and Sons, Inc.
• 15: Surajit Chaudhuri , Umeshwar Dayal, An overview of data warehousing and OLAP technology, ACM SIGMOD Record, v.26 n.1, p.65-74, March 1997 [doi>10.1145/248603.248616]
• 16: Chien, Y.-H. and George, E. I. 1999. A bayesian model for collaborative filtering. In Proceedings of the 7th International Workshop on Artificial Intelligence and Statistics.
• 17: Claypool, M., Gokhale, A., Miranda, T., Murnikov, P., Netes, D., and Sartin, M. 1999. Combining content-based and collaborative filters in an online newspaper. In ACM SIGIR'99. Workshop on Recommender Systems: Algorithms and Evaluation.
• 18: Condliff, M., Lewis, D., Madigan, D., and Posse, C. 1999. Bayesian mixed-effects models for recommender systems. In ACM SIGIR'99 Workshop on Recommender Systems: Algorithms and Evaluation.
• 19: Corinna Cortes , Kathleen Fisher , Daryl Pregibon , Anne Rogers, Hancock: a language for extracting signatures from data streams, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.9-17, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347094]
• 20: Delgado, J. and Ishii, N. 1999. Memory-based weighted-majority prediction for recommender systems. In ACM SIGIR'99 Workshop on Recommender Systems: Algorithms and Evaluation.
• 21: Thomas G. Dietterich, Ensemble Methods in Machine Learning, Proceedings of the First International Workshop on Multiple Classifier Systems, p.1-15, June 21-23, 2000
• 22: Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000
• 23: Fan, J. and Li, R. 2003. Local Modeling: Density Estimation and Nonparametric Regression. In Advanced Medical Statistics, J. Fang and Y. Lu, Eds. World Scientific, 885--930.
• 24: Getoor, L. and Sahami, M. 1999. Using probabilistic relational models for collaborative filtering. In Workshop on Web Usage Analysis and User Profiling (WEBKDD'99).
• 25: Ken Goldberg , Theresa Roeder , Dhruv Gupta , Chris Perkins, Eigentaste: A Constant Time Collaborative Filtering Algorithm, Information Retrieval, v.4 n.2, p.133-151, July 2001 [doi>10.1023/A:1011419012209]
• 26: Jiawei Han , Micheline Kamber, Data mining: concepts and techniques, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000
• 27: David J. Hand , Padhraic Smyth , Heikki Mannila, Principles of data mining, MIT Press, Cambridge, MA, 2001
• 28: Hastie, T., Tibshirani, R., and Friedman, J. 2001. The Elements of Statistical Learning. Springer.
• 29: Jonathan L. Herlocker , Joseph A. Konstan, Content-Independent Task-Focused Recommendation, IEEE Internet Computing, v.5 n.6, p.40-47, November 2001 [doi>10.1109/4236.968830]
• 30: Jonathan L. Herlocker , Joseph A. Konstan , Al Borchers , John Riedl, An algorithmic framework for performing collaborative filtering, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.230-237, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312682]
• 31: Will Hill , Larry Stead , Mark Rosenstein , George Furnas, Recommending and evaluating choices in a virtual community of use, Proceedings of the SIGCHI conference on Human factors in computing systems, p.194-201, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223929]
• 32: Zan Huang , Hsinchun Chen , Daniel Zeng, Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering, ACM Transactions on Information Systems (TOIS), v.22 n.1, p.116-142, January 2004 [doi>10.1145/963770.963775]
• 33: Im, I. and Hars, A. 2001. Finding information just for you: knowledge reuse using collaborative filtering systems. In Proceedings of the 22nd International Conference on Information Systems.
• 34: Kachigan, S. C. 1986. Statistical Analysis. Radius Press.
• 35: Diane Kelly , Jaime Teevan, Implicit feedback for inferring user preference: a bibliography, ACM SIGIR Forum, v.37 n.2, p.18-28, Fall 2003 [doi>10.1145/959258.959260]
• 36: Kimball, R. 1996. The Data Warehouse Toolkit. John Wiley & Sons, Inc.
• 37: Klein, N. M. and Yadav, M. 1989. Context effects on effort and accuracy in choice: An inquiry into adaptive decision making. J. Consum. Res. 16, 410--420.
• 38: Koller, D. and Sahami, M. 1996. Toward optimal feature selection. In Proceedings of the 13th International Conference on Machine Learning, Morgan Kaufmann.
• 39: Joseph A. Konstan , Bradley N. Miller , David Maltz , Jonathan L. Herlocker , Lee R. Gordon , John Riedl, GroupLens: applying collaborative filtering to Usenet news, Communications of the ACM, v.40 n.3, p.77-87, March 1997 [doi>10.1145/245108.245126]
• 40: Kotler, P. 2003. Marketing Management. 11th ed. Prentice Hall.
• 41: Ravi Kumar , Prabhakar Raghavan , Sridhar Rajagopalan , Andrew Tomkins, Recommendation systems: a probabilistic analysis, Journal of Computer and System Sciences, v.63 n.1, p.42-61, August 2001 [doi>10.1006/jcss.2001.1757]
• 42: Lang, K. 1995. Newsweeder: Learning to filter netnews. In Proceedings of the 12th International Conference on Machine Learning.
• 43: Lee, W. S. 2001. Collaborative learning for recommender systems. In Proccedings of the International Conference on Machine Learning.
• 44: Lilien, G. L., Kotler, P., and Moorthy, S. K. 1992. Marketing Models. Prentice Hall, 22--23.
• 45: Huan Liu , Hiroshi Motoda, Feature Selection for Knowledge Discovery and Data Mining, Kluwer Academic Publishers, Norwell, MA, 1998
• 46: Lussier, D. A. and Olshavsky, R. W. 1979. Task complexity and contingent processing in brand choice. J. Consum. Res. 6, 154--165.
• 47: Thomas M. Mitchell, Machine Learning, McGraw-Hill Higher Education, 1997
• 48: Bamshad Mobasher , Honghua Dai , Tao Luo , Miki Nakagawa, Using Sequential and Non-Sequential Patterns in Predictive Web Usage Mining Tasks, Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM'02), p.669, December 09-12, 2002
• 49: Mood, A. M., Graybill, F. A., and Boes, D. C. 1974. Introduction to the Theory of Statistics, 3rd ed., McGraw-Hill.
• 50: Mooney, R. J., Bennett, P. N., and Roy, L. 1998. Book recommending using text categorization with extracted information. In Recommender Systems. Papers from 1998 Workshop. Tech. Rep. WS-98-08. AAAI Press.
• 51: Mooney, R. J. and Roy, L. 1999. Content-based book recommending using learning for text categorization. In ACM SIGIR'99. Workshop on Recommender Systems: Algorithms and Evaluation.
• 52: Atsuyoshi Nakamura , Naoki Abe, Collaborative Filtering Using Weighted Majority Prediction Algorithms, Proceedings of the Fifteenth International Conference on Machine Learning, p.395-403, July 24-27, 1998
• 53: Oard, D. W. and Kim, J. 2001. Modeling information content using observable behavior. In Proceedings of the American Society for Information Science and Technology Conference, Washington, DC.
• 54: Michael J. Pazzani, A Framework for Collaborative, Content-Based and Demographic Filtering, Artificial Intelligence Review, v.13 n.5-6, p.393-408, Dec. 1999 [doi>10.1023/A:1006544522159]
• 55: Michael Pazzani , Daniel Billsus, Learning and Revising User Profiles: The Identification ofInteresting Web Sites, Machine Learning, v.27 n.3, p.313-331, June 1997 [doi>10.1023/A:1007369909943]
• 56: Pennock, D. M. and Horvitz, E. 1999. Collaborative filtering by personality diagnosis: A hybrid memory- and model-based approach. In IJCAI'99 Workshop: Machine Learning for Information Filtering.
• 57: Raghu Ramakrishnan , Johannes Gehrke, Database Management Systems, McGraw-Hill Higher Education, 2000
• 58: Paul Resnick , Neophytos Iacovou , Mitesh Suchak , Peter Bergstrom , John Riedl, GroupLens: an open architecture for collaborative filtering of netnews, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.175-186, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.192905]
• 59: Gerald Salton, Automatic text processing, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1988
• 60: Sarwar B., Karypis, G., Konstan, J., and Riedl, J. 2000. Application of dimensionality reduction in recommender systems---a case study. In Proceedings of the ACM WebKDD Workshop.
• 61: Badrul Sarwar , George Karypis , Joseph Konstan , John Reidl, Item-based collaborative filtering recommendation algorithms, Proceedings of the 10th international conference on World Wide Web, p.285-295, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372071]
• 62: Upendra Shardanand , Pattie Maes, Social information filtering: algorithms for automating “word of mouth”, Proceedings of the SIGCHI conference on Human factors in computing systems, p.210-217, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223931]
• 63: Soboroff, I. and Nicholas, C. 1999. Combining content and collaboration in text filtering. In IJCAI'99 Workshop: Machine Learning for Information Filtering.
• 64: Sparck Jones, K. 1974. Automatic Indexing. Journal of Documentation, 30,393--432.
• 65: Myra Spiliopoulou , Bamshad Mobasher , Bettina Berendt , Miki Nakagawa, A Framework for the Evaluation of Session Reconstruction Heuristics in Web-Usage Analysis, INFORMS Journal on Computing, v.15 n.2, p.171-190, April 2003 [doi>10.1287/ijoc.15.2.171.14445]
• 66: Loren Terveen , Will Hill , Brian Amento , David McDonald , Josh Creter, PHOAKS: a system for sharing recommendations, Communications of the ACM, v.40 n.3, p.59-62, March 1997 [doi>10.1145/245108.245122]
• 67: Tran, T. and Cohen, R. 2000. Hybrid Recommender Systems for Electronic Commerce. In Knowledge-Based Electronic Markets, Papers from the AAAI Workshop, Tech. Rep. WS-00-04, AAAI Press.
• 68: Ungar, L. H. and Foster, D. P. 1998. Clustering methods for collaborative filtering. In Recommender Systems. Papers from 1998 Workshop. Tech. Rep. WS-98-08. AAAI Press.
• 69: Wade, W. 2003. A grocery cart that holds bread, butter and preferences. New York Times, Jan. 16.
• 70: Patrick Henry Winston, Artificial intelligence (3rd ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Selection process; Information filtering

General Terms:
Algorithms, Design, Experimentation, Performance

Keywords:
Recommender systems, collaborative filtering, context-aware recommender systems, multidimensional data models, multidimensional recommender systems, personalization, rating estimation