Attack resistant collaborative filtering

ABSTRACT

The widespread deployment of recommender systems has lead to user feedback of varying quality. While some users faithfully express their true opinion, many provide noisy ratings which can be detrimental to the quality of the generated recommendations. The presence of noise can violate modeling assumptions and may thus lead to instabilities in estimation and prediction. Even worse, malicious users can deliberately insert attack profiles in an attempt to bias the recommender system to their benefit.

While previous research has attempted to study the robustness of various existing Collaborative Filtering (CF) approaches, this remains an unsolved problem. Approaches such as Neighbor Selection algorithms, Association Rules and Robust Matrix Factorization have produced unsatisfactory results. This work describes a new collaborative algorithm based on SVD which is accurate as well as highly stable to shilling. This algorithm exploits previously established SVD based shilling detection algorithms, and combines it with SVD based-CF. Experimental results show a much diminished effect of all kinds of shilling attacks. This work also offers significant improvement over previous Robust Collaborative Filtering frameworks.

REFERENCES

• 1: N. M. Al-Kandari and I. T. Jolliffe. Variable selection and interpretation in correlation principal components. Environmetrics, 16(6):659--672, 2005.
• 2: Robin Burke , Bamshad Mobasher , Chad Williams , Runa Bhaumik, Classification features for attack detection in collaborative recommender systems, Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, August 20-23, 2006, Philadelphia, PA, USA [doi>10.1145/1150402.1150465]
• 3: Paul-Alexandru Chirita , Wolfgang Nejdl , Cristian Zamfir, Preventing shilling attacks in online recommender systems, Proceedings of the 7th annual ACM international workshop on Web information and data management, November 04-04, 2005, Bremen, Germany [doi>10.1145/1097047.1097061]
• 4: S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391--407, 1990.
• 5: A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society, 39(1):1--38, 1977.
• 6: G. Gorrell. Generalized hebbian algorithm for incremental singular value decomposition in natural language processing. In EACL, 2006.
• 7: H. Hotelling. Analysis of a Complex of Statistical Variables Into Principal Components. 1933.
• 8: Joseph A. Konstan , Bradley N. Miller , David Maltz , Jonathan L. Herlocker , Lee R. Gordon , John Riedl, GroupLens: applying collaborative filtering to Usenet news, Communications of the ACM, v.40 n.3, p.77-87, March 1997 [doi>10.1145/245108.245126]
• 9: Shyong K. Lam , John Riedl, Shilling recommender systems for fun and profit, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988726]
• 10: B. Mehta. Unsupervised shilling detection for collaborative filtering. In AAAI, pages 1402--1407, 2007.
• 11: Bhaskar Mehta , Thomas Hofmann , Peter Fankhauser, Lies and propaganda: detecting spam users in collaborative filtering, Proceedings of the 12th international conference on Intelligent user interfaces, January 28-31, 2007, Honolulu, Hawaii, USA [doi>10.1145/1216295.1216307]
• 12: Bhaskar Mehta , Thomas Hofmann , Wolfgang Nejdl, Robust collaborative filtering, Proceedings of the 2007 ACM conference on Recommender systems, October 19-20, 2007, Minneapolis, MN, USA [doi>10.1145/1297231.1297240]
• 13: Michael O'Mahony , Neil Hurley , Nicholas Kushmerick , Guénolé Silvestre, Collaborative recommendation: A robustness analysis, ACM Transactions on Internet Technology (TOIT), v.4 n.4, p.344-377, November 2004 [doi>10.1145/1031114.1031116]
• 14: Michael P. O'Mahony , Neil J. Hurley , Guénolé C.M. Silvestre, Detecting noise in recommender system databases, Proceedings of the 11th international conference on Intelligent user interfaces, January 29-February 01, 2006, Sydney, Australia [doi>10.1145/1111449.1111477]
• 15: M. P. O'Mahony, N. J. Hurley, and G. C. M. Silvestre. Efficient and secure collaborative filtering through intelligent neighbour selection. In Proceedings of the 16th European Conference on Artificial Intelligence, 22nd-27th, pages 383--387, Valencia, Spain, Aug 2004. IOS Press.
• 16: J. J. Sandvig , Bamshad Mobasher , Robin Burke, Robustness of collaborative recommendation based on association rule mining, Proceedings of the 2007 ACM conference on Recommender systems, October 19-20, 2007, Minneapolis, MN, USA [doi>10.1145/1297231.1297249]
• 17: T. D. Sanger. Optimal unsupervised learning in a single-layer linear feedforward neural network. Neural Networks, 2(6):459--473, 1989.
• 18: B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Application of dimensionality reduction in recommender systems-a case study, 2000.
• 19: B. Webb. Netflix update: Try this at home. http://sifter.org/ simon/journal/20061211.html, 2006.
• 20: C. Williams, B. Mobasher, R. Burke, J. Sandvig, and R. Bhaumik. Detection of Obfuscated Attacks in Collaborative Recommender Systems. In Workshop on Recommender Systems, ECAI, 2006.
• 21: Sheng Zhang , Yi Ouyang , James Ford , Fillia Makedon, Analysis of a low-dimensional linear model under recommendation attacks, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148259]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

Additional Classification:
  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.4 Electronic Commerce
          Subjects: Security

General Terms:
Algorithms, Security

Keywords:
SVD, collaborative filtering, recommendation algorithm, shilling