Telling experts from spammers: expertise ranking in folksonomies

ABSTRACT

With a suitable algorithm for ranking the expertise of a user in a collaborative tagging system, we will be able to identify experts and discover useful and relevant resources through them. We propose that the level of expertise of a user with respect to a particular topic is mainly determined by two factors. Firstly, an expert should possess a high quality collection of resources, while the quality of a Web resource depends on the expertise of the users who have assigned tags to it. Secondly, an expert should be one who tends to identify interesting or useful resources before other users do. We propose a graph-based algorithm, SPEAR (SPamming-resistant Expertise Analysis and Ranking), which implements these ideas for ranking users in a folksonomy. We evaluate our method with experiments on data sets collected from Delicious.com comprising over 71,000 Web documents, 0.5 million users and 2 million shared bookmarks. We also show that the algorithm is more resistant to spammers than other methods such as the original HITS algorithm and simple statistical measures.

REFERENCES

• 1: M.T.H. Chi. Two approaches to the study of experts' characteristics. In The Cambridge Handbook of Expertise and Expert Performance, pages 21--30. Cambridge University Press, USA, 2006.
• 2: Byron Dom , Iris Eiron , Alex Cozzi , Yi Zhang, Graph-based ranking algorithms for e-mail expertise analysis, Proceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery, June 13-13, 2003, San Diego, California [doi>10.1145/882082.882093]
• 3: P.J. Feltovich, M.J. Prietula, and K.A. Ericsson. Studies of expertise from psychological perspectives. In The Cambridge Handbook of Expertise and Expert Performance, pages 41--68. Cambridge University Press, USA, 2006.
• 4: T. Hammond, T. Hannay, B. Lund, and J. Scott. Social bookmarking tools (i): A general review. D-Lib Magazine, 11(4), April 2005.
• 5: Paul Heymann , Georgia Koutrika , Hector Garcia-Molina, Fighting Spam on Social Web Sites: A Survey of Approaches and Future Challenges, IEEE Internet Computing, v.11 n.6, p.36-45, November 2007 [doi>10.1109/MIC.2007.125]
• 6: Paul Heymann , Georgia Koutrika , Hector Garcia-Molina, Can social bookmarking improve web search?, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA [doi>10.1145/1341531.1341558]
• 7: A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Information retrieval in folksonomies: Search and ranking. In Proc. of 3rd European Semantic Web Conference, pages 411--426. Montenegro, 2006.
• 8: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM (JACM), v.46 n.5, p.604-632, Sept. 1999 [doi>10.1145/324133.324140]
• 9: Georgia Koutrika , Frans Adjie Effendi , Zoltán Gyöngyi , Paul Heymann , Hector Garcia-Molina, Combating spam in tagging systems, Proceedings of the 3rd international workshop on Adversarial information retrieval on the web, May 08-08, 2007, Banff, Alberta, Canada [doi>10.1145/1244408.1244420]
• 10: R. Krestel and L. Chen. Using co-occurence of tags and resources to identify spammers. In Proc. of ECML PKDD Discovery Challenge Workshop, col located with ECML/PKDD 2008, 2008.
• 11: C. Macdonald, D. Hannah, and I. Ounis. High quality expertise evidence for expert search. In Proc. of 30th European Conference on IR Research, UK, 2008., pages 283--295. Springer, 2008.
• 12: A. Madkour, T. Hefni, A. Hefny, and K.S. Refaat. Using semantic features to detect spamming in social bookmarking systems. In Proc. of ECML PKDD Discovery Challenge Workshop, Belgium, 2008.
• 13: Peter Mika, Ontologies are us: A unified model of social networks and semantics, Web Semantics: Science, Services and Agents on the World Wide Web, v.5 n.1, p.5-15, March, 2007 [doi>10.1016/j.websem.2006.11.002]
• 14: Michael G. Noll , Christoph Meinel, Authors vs. readers: a comparative study of document metadata and content in the www, Proceedings of the 2007 ACM symposium on Document engineering, August 28-31, 2007, Winnipeg, Manitoba, Canada [doi>10.1145/1284420.1284465]
• 15: Michael G. Noll , Christoph Meinel, Exploring social annotations for web document classification, Proceedings of the 2008 ACM symposium on Applied computing, March 16-20, 2008, Fortaleza, Ceara, Brazil [doi>10.1145/1363686.1364235]
• 16: Jidong Wang , Zheng Chen , Li Tao , Wei-Ying Ma , Liu Wenyin, Ranking user's relevance to a topic through link analysis on web logs, Proceedings of the 4th international workshop on Web information and data management, November 08-08, 2002, McLean, Virginia, USA [doi>10.1145/584931.584942]
• 17: R. Wetzker, C. Zimmermann, and C. Bauckhage. Analyzing social bookmarking systems: A del.icio.us cookbook. In Proc. of Mining Social Data Workshop, collocated with ECAI 2008, pages 26--30, 2008.
• 18: Haifeng Yu , Michael Kaminsky , Phillip B. Gibbons , Abraham Flaxman, SybilGuard: defending against sybil attacks via social networks, ACM SIGCOMM Computer Communication Review, v.36 n.4, October 2006
• 19: Jun Zhang , Mark S. Ackerman , Lada Adamic, Expertise networks in online communities: structure and algorithms, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242603]
• 20: Ding Zhou , Sergey A. Orshanskiy , Hongyuan Zha , C. Lee Giles, Co-ranking Authors and Documents in a Heterogeneous Network, Proceedings of the 2007 Seventh IEEE International Conference on Data Mining, p.739-744, October 28-31, 2007 [doi>10.1109/ICDM.2007.57]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software

General Terms:
Algorithms, Experimentation, Human Factors

Keywords:
collaborative tagging, expertise, folksonomy, ranking, spam