Defending online reputation systems against collaborative unfair raters through signal modeling and trust

ABSTRACT

Online feedback-based rating systems are gaining popularity. Dealing with collaborative unfair ratings in such systems has been recognized as an important but difficult problem. This problem is challenging especially when the number of honest ratings is relatively small and unfair ratings can contribute to a significant portion of the overall ratings. In addition, the lack of unfair rating data from real human users is another obstacle toward realistic evaluation of defense mechanisms. In this paper, we propose a set of methods that jointly detect smart and collaborative unfair ratings based on signal modeling. Based on the detection, a framework of trust-assisted rating aggregation system is developed. Furthermore, we design and launch a Rating Challenge to collect unfair rating data from real human users. The proposed system is evaluated through simulations as well as experiments using real attack data. Compared with existing schemes, the proposed system can significantly reduce the impact from collaborative unfair ratings.

REFERENCES

• 1: Chrysanthos Dellarocas, The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms, Management Science, v.49 n.10, p.1407-1424, October 2003 [doi>10.1287/mnsc.49.10.1407.17308]
• 2: Audun Jøsang , Roslan Ismail , Colin Boyd, A survey of trust and reputation systems for online service provision, Decision Support Systems, v.43 n.2, p.618-644, March, 2007 [doi>10.1016/j.dss.2005.05.019]
• 3: J. Livingston, "How valuable is a good reputation? a sample selection model of internet auctions," The Review of Electronics and Statistics, vol. 87, no. 3, pp. 453--465, August 2005.
• 4: P. Resnick, R. Zeckhauser, J. Swanson, and K. Lockwood, "The value of reputation on ebay: A controlled experiment," Experimental Economics, vol. 9, no. 2, pp. 79--101, June 2006.
• 5: comScore.com, "Press release: Online consumer-generated reviews have significant impact on offline purchase behavior," http://www.comscore.com/press/release.asp?press=1928, November 2007.
• 6: J. Meattle, "Digg overtakes facebook; both cross 20 million u.s. unique visitors," compete.com, 2007.
• 7: Chrysanthos Dellarocas, Strategic Manipulation of Internet Opinion Forums: Implications for Consumers and Firms, Management Science, v.52 n.10, p.1577-1593, October 2006 [doi>10.1287/mnsc.1060.0567]
• 8: A. Harmon, "Amazon glitch unmasks war of reviewers," The New York Times, February 14 2004.
• 9: M. Hines, "Scammers gaming youtube ratings for profit," InfoWorld, http://www.infoworld.com/article/07/05/16/cybercrooks_gaming google_1.html, May 2007.
• 10: J. Brown and J. Morgan, "Reputation in online auctions: The market for trust," California Management Review, vol. 49, no. 1, pp. 61--81, 2006.
• 11: University of Rhode Island, "Etan rating challenge," www.etanlab.com/rating.
• 12: Chrysanthos Dellarocas, Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior, Proceedings of the 2nd ACM conference on Electronic commerce, p.150-157, October 17-20, 2000, Minneapolis, Minnesota, United States [doi>10.1145/352871.352889]
• 13: Mao Chen , Jaswinder Pal Singh, Computing and using reputations for internet ratings, Proceedings of the 3rd ACM conference on Electronic Commerce, p.154-162, October 14-17, 2001, Tampa, Florida, USA [doi>10.1145/501158.501175]
• 14: A. Whitby, A. Jøang, and J. Indulska, "Filtering out unfair ratings in Bayesian reputation systems," in Proc. 7th Int. Workshop on Trust in Agent Societies, 2004.
• 15: Jianshu Weng , Chunyan Miao , Angela Goh, An Entropy-Based Approach to Protecting Rating Systems from Unfair Testimonies, IEICE - Transactions on Information and Systems, v.E89-D n.9, p.2502-2511, September 2006 [doi>10.1093/ietisy/e89-d.9.2502]
• 16: Audun Jøsang , Roslan Ismail , Colin Boyd, A survey of trust and reputation systems for online service provision, Decision Support Systems, v.43 n.2, p.618-644, March, 2007 [doi>10.1016/j.dss.2005.05.019]
• 17: Runfang Zhou , Kai Hwang, PowerTrust: A Robust and Scalable Reputation System for Trusted Peer-to-Peer Computing, IEEE Transactions on Parallel and Distributed Systems, v.18 n.4, p.460-473, April 2007 [doi>10.1109/TPDS.2007.1021]
• 18: Saurabh Ganeriwal , Mani B. Srivastava, Reputation-based framework for high integrity sensor networks, Proceedings of the 2nd ACM workshop on Security of ad hoc and sensor networks, October 25-25, 2004, Washington DC, USA [doi>10.1145/1029102.1029115]
• 19: PeerTrust: Supporting Reputation-Based Trust for Peer-to-Peer Electronic Communities, IEEE Transactions on Knowledge and Data Engineering, v.16 n.7, p.843-857, July 2004 [doi>10.1109/TKDE.2004.1318566]
• 20: Ko Fujimura , Takuo Nishihara, Reputation rating system based on past behavior of evaluators, Proceedings of the 4th ACM conference on Electronic commerce, June 09-12, 2003, San Diego, CA, USA [doi>10.1145/779928.779981]
• 21: A. Jsang and R. Ismail, "The beta reputation system," in Proceedings of the 15th Bled Electronic Commerce Conference, June 2002.
• 22: Y. Sun, Z. Han, W. Yu, and K. J. Ray Liu, "A trust evaluation framework in distributed networks: Vulnerability analysis and defense against attacks," in Proceeding of the 27th Conference on Computer Communications (INFOCOM'06), Barcelona, Spain, April 2006.
• 23: S. Buchegger and J-Y Le Boudec, "The effect of rumor spreading in reputation systems in mobile ad-hoc networks," in Proceedings of Wiopt'03, 2003.
• 24: Steven M. Kay, Fundamentals of statistical signal processing: estimation theory, Prentice-Hall, Inc., Upper Saddle River, NJ, 1993
• 25: Monson H. Hayes, Statistical Digital Signal Processing and Modeling, John Wiley & Sons, Inc., New York, NY, 1996
• 26: Yafei Yang , Yan Lindsay Sun , Jin Ren , Qing Yang, Building Trust in Online Rating Systems Through Signal Modeling, Proceedings of the 27th International Conference on Distributed Computing Systems Workshops, p.23, June 22-29, 2007 [doi>10.1109/ICDCSW.2007.27]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.0 General

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services

Keywords:
detection, rating, reputation systems, trust