Toward trustworthy recommender systems: An analysis of attack models and algorithm robustness

ABSTRACT

Publicly accessible adaptive systems such as collaborative recommender systems present a security problem. Attackers, who cannot be readily distinguished from ordinary users, may inject biased profiles in an attempt to force a system to “adapt” in a manner advantageous to them. Such attacks may lead to a degradation of user trust in the objectivity and accuracy of the system. Recent research has begun to examine the vulnerabilities and robustness of different collaborative recommendation techniques in the face of “profile injection” attacks. In this article, we outline some of the major issues in building secure recommender systems, concentrating in particular on the modeling of attacks and their impact on various recommendation algorithms. We introduce several new attack models and perform extensive simulation-based evaluations to show which attacks are most successful and practical against common recommendation techniques. Our study shows that both user-based and item-based algorithms are highly vulnerable to specific attack models, but that hybrid algorithms may provide a higher degree of robustness. Using our formal characterization of attack models, we also introduce a novel classification-based approach for detecting attack profiles and evaluate its effectiveness in neutralizing attacks.

REFERENCES

• 1: Albert, M. and Aha, D. 1991. Analyses of instance-based learning algorithms. In Proceedings of the 9th National Conference on Artificial Intelligence. Morgan Kaufmann, San Francisco, CA.
• 2: Michael W. Berry , Susan T. Dumais , Gavin W. O'Brien, Using linear algebra for intelligent information retrieval, SIAM Review, v.37 n.4, p.573-595, Dec. 1995 [doi>10.1137/1037127]
• 3: Daniel Billsus , Michael J. Pazzani, User Modeling for Adaptive News Access, User Modeling and User-Adapted Interaction, v.10 n.2-3, p.147-180, 2000 [doi>10.1023/A:1026501525781]
• 4: Breese, J., Heckerman, D., and Kadie, C. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Uncertainty in Artificial Intelligence. Proceedings of the Fourteenth Conference. Morgan Kaufman, San Francisco, CA, 43--53.
• 5: Burke, R. 2000. Knowledge-based recommender systems. In Encyclopedia of Library and Information Systems, A. Kent, Ed. Vol. 69. Marcel Dekker, New York, NY.
• 6: Robin Burke, Hybrid Recommender Systems: Survey and Experiments, User Modeling and User-Adapted Interaction, v.12 n.4, p.331-370, November 2002 [doi>10.1023/A:1021240730564]
• 7: Burke, R., Mobasher, B., and Bhaumik, R. 2005a. Limited knowledge shilling attacks in collaborative filtering systems. In Proceedings of the 3rd IJCAI Workshop in Intelligent Techniques for Personalization (Edinburgh, Scotland).
• 8: Robin Burke , Bamshad Mobasher , Chad Williams , Runa Bhaumik, Classification features for attack detection in collaborative recommender systems, Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, August 20-23, 2006, Philadelphia, PA, USA [doi>10.1145/1150402.1150465]
• 9: Robin Burke , Bamshad Mobasher , Chad Williams , Runa Bhaumik, Detecting Profile Injection Attacks in Collaborative Recommender Systems, Proceedings of the The 8th IEEE International Conference on E-Commerce Technology and The 3rd IEEE International Conference on Enterprise Computing, E-Commerce, and E-Services, p.23, June 26-29, 2006 [doi>10.1109/CEC-EEE.2006.34]
• 10: Burke, R., Mobasher, B., Zabicki, R., and Bhaumik, R. 2005b. Identifying attack models for secure recommendation. In Beyond Personalization: A Workshop on the Next Generation of Recommender Systems (San Diego, CA).
• 11: Paul-Alexandru Chirita , Wolfgang Nejdl , Cristian Zamfir, Preventing shilling attacks in online recommender systems, Proceedings of the 7th annual ACM international workshop on Web information and data management, November 04-04, 2005, Bremen, Germany [doi>10.1145/1097047.1097061]
• 12: Haussler, D. 1990. Probably approximately correct learning. In Proceedings of the 8th National Conference on Artificial Intelligence. Morgan Kaufmann, San Francisco, CA, 1101--1108.
• 13: Jonathan L. Herlocker , Joseph A. Konstan , Al Borchers , John Riedl, An algorithmic framework for performing collaborative filtering, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.230-237, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312682]
• 14: Herlocker, J. L., Frankowski, D., Schafer, J. B., and Sen, S. 2006. Collaborative filtering. In The Adaptive Web: Methods and Strategies of Web Personalization, P. Brusilovsky, A. Kobsa, and W. Nejdl, Eds. Springer Verlag, Berlin, Germany.
• 15: Jonathan L. Herlocker , Joseph A. Konstan , Loren G. Terveen , John T. Riedl, Evaluating collaborative filtering recommender systems, ACM Transactions on Information Systems (TOIS), v.22 n.1, p.5-53, January 2004 [doi>10.1145/963770.963772]
• 16: Jin, X. and Mobasher, B. 2003. Using semantic similarity to enhance item-based collaborative filtering. In Proceedings of the 2nd IASTED International Conference on Information and Knowledge Sharing (Scottsdale, AZ).
• 17: Shyong K. Lam , John Riedl, Shilling recommender systems for fun and profit, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988726]
• 18: Lang, K. 1995. Newsweeder: Learning to filter news. In Proceedings of the 12th International Conference on Machine Learning. 331--339.
• 19: Massa, P. and Avesani, P. 2006. Trust-aware collaborative filtering for recommender systems. In Proceedings of the 11th International Conference on Intelligent User Interfaces (Agia Napa, Cyprus).
• 20: Mobasher, B. 2007. Data mining for Web personalization. In The Adaptive Web: Methods and Strategies of Web Personalization, P. Brusilovsky, A. Kobsa, and W. Nejdl, Eds. Lecture Notes in Computer Science, vol. 4321. Springer-Verlag, Berlin Heidelberg, Germany (New York, NY).
• 21: Mobasher, B., Burke, R., Bhaumik, R., and Williams, C. 2005. Effective attack models for shilling item-based collaborative filtering systems. In Proceedings of the 2005 WebKDD Workshop, held in conjuction with ACM SIGKDD'2005, Chicago, IL).
• 22: Mobasher, B., Burke, R., and Sandvig, J. 2006a. Model-based collaborative filtering as a defense against profile injection attacks. In Proceedings of the 21st National Conference on Artificial Intelligence.
• 23: Mobasher, B., Burke, R., Williams, C., and Bhaumik, R. 2006b. Analysis and detection of segment-focused attacks against collaborative recommendation. In Proceedings of the 2005 WebKDD Workshop. Lecture Notes in Computer Science. Springer, Berlin, Germany.
• 24: Bamshad Mobasher , Honghua Dai , Tao Luo , Miki Nakagawa, Effective personalization based on association rule discovery from web usage data, Proceedings of the 3rd international workshop on Web information and data management, November 09-01, 2001, Atlanta, Georgia, USA [doi>10.1145/502932.502935]
• 25: Mobasher, B., Jin, X., and Zhou, Y. 2004. Semantically enhanced collaborative filtering on the web. In Web Mining: From Web to Semantic Web, Lecture Notes in Artificial Intelligence, volume 3209. Springer, Berlin, Germany.
• 26: Mooney, R. J. and Roy, L. 1999. Content-based book recommending using learning for text categorization. In Proceedings of the SIGIR '99 Workshop on Recommender Systems: Algorithms and Evaluation. (Berkeley, CA).
• 27: John O'Donovan , Barry Smyth, Is trust robust?: an analysis of trust-based recommendation, Proceedings of the 11th international conference on Intelligent user interfaces, January 29-February 01, 2006, Sydney, Australia [doi>10.1145/1111449.1111476]
• 28: Michael O'Mahony , Neil Hurley , Nicholas Kushmerick , Guénolé Silvestre, Collaborative recommendation: A robustness analysis, ACM Transactions on Internet Technology (TOIT), v.4 n.4, p.344-377, November 2004 [doi>10.1145/1031114.1031116]
• 29: Paul Resnick , Neophytos Iacovou , Mitesh Suchak , Peter Bergstrom , John Riedl, GroupLens: an open architecture for collaborative filtering of netnews, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.175-186, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.192905]
• 30: Badrul Sarwar , George Karypis , Joseph Konstan , John Reidl, Item-based collaborative filtering recommendation algorithms, Proceedings of the 10th international conference on World Wide Web, p.285-295, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372071]
• 31: Xue-Feng Su , Hua-Jun Zeng , Zheng Chen, Finding group shilling in recommendation system, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062818]
• 32: Ian H. Witten , Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

General Terms:
Algorithms, Security

Keywords:
Profile injection attacks, attack detection, collaborative filtering, recommender systems, shilling