Collaborative filtering with temporal dynamics

ABSTRACT

Customer preferences for products are drifting over time. Product perception and popularity are constantly changing as new selection emerges. Similarly, customer inclinations are evolving, leading them to ever redefine their taste. Thus, modeling temporal dynamics should be a key when designing recommender systems or general customer preference models. However, this raises unique challenges. Within the eco-system intersecting multiple products and customers, many different characteristics are shifting simultaneously, while many of them influence each other and often those shifts are delicate and associated with a few data instances. This distinguishes the problem from concept drift explorations, where mostly a single concept is tracked. Classical time-window or instance-decay approaches cannot work, as they lose too much signal when discarding data instances. A more sensitive approach is required, which can make better distinctions between transient effects and long term patterns. The paradigm we offer is creating a model tracking the time changing behavior throughout the life span of the data. This allows us to exploit the relevant components of all data instances, while discarding only what is modeled as being irrelevant. Accordingly, we revamp two leading collaborative filtering recommendation approaches. Evaluation is made on a large movie rating dataset by Netflix. Results are encouraging and better than those previously reported on this dataset.

REFERENCES

• 1: Robert M. Bell , Yehuda Koren, Scalable Collaborative Filtering with Jointly Derived Neighborhood Interpolation Weights, Proceedings of the 2007 Seventh IEEE International Conference on Data Mining, p.43-52, October 28-31, 2007 [doi>10.1109/ICDM.2007.90]
• 2: Robert Bell , Yehuda Koren , Chris Volinsky, Modeling relationships at multiple scales to improve accuracy of large recommender systems, Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, August 12-15, 2007, San Jose, California, USA [doi>10.1145/1281192.1281206]
• 3: J. Bennett, C. Elkan, B. Liu, P. Smyth and D. Tikk (eds.). KDD Cup and Workshop in conjunction with KDD'07, 2007.
• 4: J. Bennet and S. Lanning. The Netflix Prize. KDD Cup and Workshop, 2007. www.netflixprize.com
• 5: John Canny, Collaborative filtering with privacy via factor analysis, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564419]
• 6: Yi Ding , Xue Li, Time weight collaborative filtering, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099689]
• 7: Jeremy Z. Kolter , Marcus A. Maloof, Dynamic Weighted Majority: A New Ensemble Method for Tracking Concept Drift, Proceedings of the Third IEEE International Conference on Data Mining, p.123, November 19-22, 2003
• 8: Yehuda Koren, Factorization meets the neighborhood: a multifaceted collaborative filtering model, Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2008, Las Vegas, Nevada, USA [doi>10.1145/1401890.1401944]
• 9: Greg Linden , Brent Smith , Jeremy York, Amazon.com Recommendations: Item-to-Item Collaborative Filtering, IEEE Internet Computing, v.7 n.1, p.76-80, January 2003 [doi>10.1109/MIC.2003.1167344]
• 10: A. Paterek. Improving regularized singular value decomposition for collaborative filtering. Proc. KDD Cup and Workshop, 2007.
• 11: G. Potter. Putting the collaborator back into collaborative filtering. KDD'08 Workshop on Large Scale Recommenders Systems and the Netflix Prize, 2008.
• 12: P. Pu, D. G. Bridge, B. Mobasher and F. Ricci (eds.). Proc. 2008 ACM Conference on Recommender Systems, 2008.
• 13: Ruslan Salakhutdinov , Andriy Mnih , Geoffrey Hinton, Restricted Boltzmann machines for collaborative filtering, Proceedings of the 24th international conference on Machine learning, p.791-798, June 20-24, 2007, Corvalis, Oregon [doi>10.1145/1273496.1273596]
• 14: Badrul Sarwar , George Karypis , Joseph Konstan , John Reidl, Item-based collaborative filtering recommendation algorithms, Proceedings of the 10th international conference on World Wide Web, p.285-295, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372071]
• 15: J. Schlimmer and R. Granger. Beyond incremental processing: Tracking concept drift. Proc. 5th National Conference on Artificial Intelligence, pp. 502--507, 1986.
• 16: W. Nick Street , YongSeog Kim, A streaming ensemble algorithm (SEA) for large-scale classification, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.377-382, August 26-29, 2001, San Francisco, California [doi>10.1145/502512.502568]
• 17: Kazunari Sugiyama , Kenji Hatano , Masatoshi Yoshikawa, Adaptive web search based on user profile constructed without any effort from users, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988764]
• 18: Gábor Takács , István Pilászy , Bottyán Németh , Domonkos Tikk, Major components of the gravity recommendation system, ACM SIGKDD Explorations Newsletter, v.9 n.2, December 2007 [doi>10.1145/1345448.1345466]
• 19: Gábor Takács , István Pilászy , Bottyán Németh , Domonkos Tikk, Matrix factorization and neighbor based algorithms for the netflix prize problem, Proceedings of the 2008 ACM conference on Recommender systems, October 23-25, 2008, Lausanne, Switzerland [doi>10.1145/1454008.1454049]
• 20: C. Thompson. If you liked this, you're sure to love that. The New York Times, Nov 21, 2008.
• 21: A. Toscher, M. Jahrer and R. Legenstein. Improved neighborhood-based algorithms for large-scale recommender systems. KDD'08 Workshop on Large Scale Recommenders Systems and the Netflix Prize, 2008.
• 22: A. Tsymbal. The problem of concept drift: Definitions and related work. Technical Report TCD-CS-2004-15, Trinity College Dublin, 2004.
• 23: A. Tuzhilin, Y. Koren, J. Bennett, C. Elkan and D. Lemire (eds.). Workshop on large scale recommender systems and the Netflix Prize in conjunction with KDD'08, 2008.
• 24: Haixun Wang , Wei Fan , Philip S. Yu , Jiawei Han, Mining concept-drifting data streams using ensemble classifiers, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C. [doi>10.1145/956750.956778]
• 25: Gerhard Widmer , Miroslav Kubat, Learning in the presence of concept drift and hidden contexts, Machine Learning, v.23 n.1, p.69-101, April 1996 [doi>10.1023/A:1018046501280]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

General Terms:
Algorithms

Keywords:
collaborative filtering, concept drift, recommender systems