Personalized recommendation on dynamic content using predictive bilinear models

ABSTRACT

In Web-based services of dynamic content (such as news articles), recommender systems face the difficulty of timely identifying new items of high-quality and providing recommendations for new users. We propose a feature-based machine learning approach to personalized recommendation that is capable of handling the cold-start issue effectively. We maintain profiles of content of interest, in which temporal characteristics of the content, e.g. popularity and freshness, are updated in real-time manner. We also maintain profiles of users including demographic information and a summary of user activities within Yahoo! properties. Based on all features in user and content profiles, we develop predictive bilinear regression models to provide accurate personalized recommendations of new items for both existing and new users. This approach results in an offline model with light computational overhead compared with other recommender systems that require online re-training. The proposed framework is general and flexible for other personalized tasks. The superior performance of our approach is verified on a large-scale data set collected from the Today-Module on Yahoo! Front Page, with comparison against six competitive approaches.

REFERENCES

• 1: D. Agarwal, B. Chen, P. Elango, N. Motgi, S. Park,R. Ramakrishnan, S. Roy, and J. Zachariah. Online models for content optimization. In Advances in Neural Information Processing Systems 21, 2009.
• 2: Jae-wook Ahn , Peter Brusilovsky , Jonathan Grady , Daqing He , Sue Yeon Syn, Open user profiles for adaptive news systems: help or harm?, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242575]
• 3: Marko Balabanović , Yoav Shoham, Fab: content-based, collaborative recommendation, Communications of the ACM, v.40 n.3, p.66-72, March 1997 [doi>10.1145/245108.245124]
• 4: Justin Basilico , Thomas Hofmann, A joint framework for collaborative and content filtering, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009115]
• 5: Chumki Basu , Haym Hirsh , William Cohen, Recommendation as classification: using social and content-based information in recommendation, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.714-720, July 1998, Madison, Wisconsin, United States
• 6: D. Billsus and M. Pazzani. Adaptive news access. In P. Brusilovsky, A. Kobsa, and W. Nejdl, editors, The Adaptive Web -- Methods and Strategies of Web Personalization, volume 4321 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2007.
• 7: J. S. Breese, D. Heckerman, and C. Kadie. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 43--52, 1998.
• 8: P. Brusilovsky, A. Kobsa, and W. Nejdl, editors. The Adaptive Web -- Methods and Strategies of Web Personalization, volume 4321 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2007.
• 9: A. G. Büchner, J. G. Hughes, and D. A. Bell. Contextual data and domain knowledge for incorporation in knowledge discovery systems. In J. Wang, editor, Modeling and Using Context, volume 1688, pages 831--832, 1999.
• 10: R. Burke. Hybrid systems for personalized recommendations. In B. Mobasher and S. S. Anand, editors, Intelligent Techniques for Web Personalization. Springer-Verlag, 2005.
• 11: W. Chu and Z. Ghahramani. Probabilistic models for incomplete multi-dimensional arrays. In Proceedings of the 12th International Conference on Artificial Intelligence and Statistics, 2009.
• 12: M. Claypool, A. Gokhale, T. Miranda, P. Murnikov, D. Netes, andM. Sartin. Combining content-based and collaborative filters in an online newspaper. In ACM SIGIR Workshop on Recommender Systems, 1999.
• 13: Mark Claypool , Phong Le , Makoto Wased , David Brown, Implicit interest indicators, Proceedings of the 6th international conference on Intelligent user interfaces, p.33-40, January 14-17, 2001, Santa Fe, New Mexico, United States [doi>10.1145/359784.359836]
• 14: R. Coppi , S. Bolasco, Multiway data analysis, North-Holland Publishing Co., Amsterdam, The Netherlands, 1989
• 15: Abhinandan S. Das , Mayur Datar , Ashutosh Garg , Shyam Rajaram, Google news personalization: scalable online collaborative filtering, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242610]
• 16: Mukund Deshpande , George Karypis, Item-based top-N recommendation algorithms, ACM Transactions on Information Systems (TOIS), v.22 n.1, p.143-177, January 2004 [doi>10.1145/963770.963776]
• 17: B. J. Frey, R. Patrascu, T. Jaakkola, and J. Moran. Sequentially fitting inclusive trees for inference in noisy-or networks. In Advances in Neural Information Processing Systems 13. MIT Press, 2000.
• 18: Evgeniy Gabrilovich , Susan Dumais , Eric Horvitz, Newsjunkie: providing personalized newsfeeds via analysis of information novelty, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988738]
• 19: S. Gauch, M. Speratta, A. Chandranouli, and A. Micarelli. User profiles for personalized information access. In P. Brusilovsky, A. Kobsa, and W. Nejdl, editors, The Adaptive Web -- Methods and Strategies of Web Personalization. Springer Berlin / Heidelberg, 2007.
• 20: Nathaniel Good , J. Ben Schafer , Joseph A. Konstan , Al Borchers , Badrul Sarwar , Jon Herlocker , John Riedl, Combining collaborative filtering with personal agents for better recommendations, Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence, p.439-446, July 18-22, 1999, Orlando, Florida, United States
• 21: Robert H. Guttman , Alexandros G. Moukas , Pattie Maes, Agent-mediated electronic commerce: a survey, The Knowledge Engineering Review, v.13 n.2, p.147-159, July 1998 [doi>10.1017/S0269888998002082]
• 22: Tianyi Jiang , Alexander Tuzhilin, Segmenting Customers from Population to Individuals: Does 1-to-1 Keep Your Customers Forever?, IEEE Transactions on Knowledge and Data Engineering, v.18 n.10, p.1297-1311, October 2006 [doi>10.1109/TKDE.2006.164]
• 23: B. Krulwich. Lifestyle finder: Intelligent user profiling using large-scale demographic data. Artificial Intelligence Magazine, 18(2):37--45, 1997.
• 24: N. Lawrence, M. Seeger, and R. Herbrich. The informative vector machine. In Advances in Neural Information Processing Systems 15. MIT Press, 2003.
• 25: P. J. Lenk, W. S. DeSardo, P. E. Green, and M. R. Young. Hierarchical Bayes conjoint analysis: Recovery of partworth heterogeneity from reduced experimental designs. Marketing Science, 15(2):173--191, 1996.
• 26: David J. C. MacKay, The evidence framework applied to classification networks, Neural Computation, v.4 n.5, p.720-736, September 1992 [doi>10.1162/neco.1992.4.5.720]
• 27: Prem Melville , Raymod J. Mooney , Ramadass Nagarajan, Content-boosted collaborative filtering for improved recommendations, Eighteenth national conference on Artificial intelligence, p.187-192, July 28-August 01, 2002, Edmonton, Alberta, Canada
• 28: A. Micarelli, F. Gasparetti, F. Sciarrone, and S. Gauch. Personalized search on the World Wide Web. In P. Brusilovsky, A. Kobsa, and W. Nejdl, editors, The Adaptive Web -- Methods and Strategies of Web Personalization, volume 4321 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2007.
• 29: Thomas P. Minka , Rosalind Picard, A family of algorithms for approximate bayesian inference, Massachusetts Institute of Technology, 2001
• 30: Dunja Mladenic, Text-Learning and Related Intelligent Agents: A Survey, IEEE Intelligent Systems, v.14 n.4, p.44-54, July 1999 [doi>10.1109/5254.784084]
• 31: Bamshad Mobasher , Sarabjot Singh Anand, Intelligent Techniques for Web Personalization: IJCAI 2003 Workshop, ITWP 2003, Acapulco, Mexico, August 11, 2003, Revised Selected Papers (Lecture Notes ... / Lecture Notes in Artificial Intelligence), Springer-Verlag New York, Inc., Secaucus, NJ, 2005
• 32: O. Nasraoui. World Wide Web personalization. In J. Wang, editor, Encyclopedia of Data Warehousing and Mining, pages 1235--1241. Idea Group, 2005.
• 33: Seung-Taek Park , David Pennock , Omid Madani , Nathan Good , Dennis DeCoste, Naïve filterbots for robust cold-start recommendations, Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, August 20-23, 2006, Philadelphia, PA, USA [doi>10.1145/1150402.1150490]
• 34: Michael J. Pazzani, A Framework for Collaborative, Content-Based and Demographic Filtering, Artificial Intelligence Review, v.13 n.5-6, p.393-408, Dec. 1999 [doi>10.1023/A:1006544522159]
• 35: Alexandrin Popescul , Lyle H. Ungar , David M. Pennock , Steve Lawrence, Probabilistic Models for Unified Collaborative and Content-Based Recommendation in Sparse-Data Environments, Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence, p.437-444, August 02-05, 2001
• 36: J. Salojarvi, K. Puolamaki, and S. Kaski. Implicit relevance feedback from eye movements. In Proceedings of the 15th International Conference on Artificial Neural Networks, pages 513--518, 2005.
• 37: J. Ben Schafer , Joseph Konstan , John Riedi, Recommender systems in e-commerce, Proceedings of the 1st ACM conference on Electronic commerce, p.158-166, November 03-05, 1999, Denver, Colorado, United States [doi>10.1145/336992.337035]
• 38: Micro Speretta , Susan Gauch, Personalized Search Based on User Search Histories, Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence, p.622-628, September 19-22, 2005 [doi>10.1109/WI.2005.114]
• 39: Joshua B. Tenenbaum , William T. Freeman, Separating Style and Content with Bilinear Models, Neural Computation, v.12 n.6, p.1247-1283, June 2000 [doi>10.1162/089976600300015349]
• 40: Y. Wind. Issue and advances in segmentation research. Journal of Marketing Research, 15:317--337, 1978.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.0 General

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

General Terms:
Algorithms, Design, Experimentation, Performance

Keywords:
bilinear models, dynamic features, personalization, ranking, recommender systems, regression, user and content profile