A reference collection for web spam

ABSTRACT

We describe the WEBSPAM-UK2006 collection, a large set of Web pages that have been manually annotated with labels indicating if the hosts are include Web spam aspects or not. This is the first publicly available Web spam collection that includes page contents and links, and that has been labelled by a large and diverse set of judges.

REFERENCES

• 1: {Becchetti et al., 2006} Becchetti, L., Castillo, C., Donato, D., Leonardi, S., and Baeza-Yates, R. (2006). Using rank propagation and probabilistic counting for link-based spam detection. In Proceedings of the Workshop on Web Mining and Web Usage Analysis (WebKDD), Pennsylvania, USA. ACM Press.
• 2: András A. Benczúr , István Bíró , Károly Csalogány , Máté Uher, Detecting nepotistic links by language model disagreement, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135954]
• 3: {Benczúr et al., 2006b} Benczúr, A. A., Csalogány, K., and Sarlós, T. (2006b). Link-based similarity search to fight web spam. In Adversarial Information Retrieval on the Web (AIRWEB), Seattle, Washington, USA.
• 4: {Benczúr et al., 2005} Benczúr, A. A., Csalogány, K., Sarlós, T., and Uher, M. (2005). Spamrank: fully automatic link spam detection. In Proceedings of the First International Workshop on Adversarial Information Retrieval on the Web, Chiba, Japan.
• 5: Paolo Boldi , Bruno Codenotti , Massimo Santini , Sebastiano Vigna, UbiCrawler: a scalable fully distributed web crawler, Software—Practice & Experience, v.34 n.8, p.711-726, 10 July 2004 [doi>10.1002/spe.587]
• 6: P. Boldi , S. Vigna, The webgraph framework I: compression techniques, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988752]
• 7: {Cohen, 1960} Cohen, J. (1960). A coefficient of agreement for nominal scales. Psychological Bulletin, 20:37--46.
• 8: {Davison, 2000} Davison, B. D. (2000). Recognizing nepotistic links on the web. In Aaai-2000 Workshop On Artificial Intelligence For Web Search, pages 23--28, Austin, Texas. Aaai Press.
• 9: Nadav Eiron , Kevin S. McCurley , John A. Tomlin, Ranking the web frontier, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988714]
• 10: {Fleiss, 1971} Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5):378--382.
• 11: Marco Gori , Ian Witten, The bubble of web visibility, Communications of the ACM, v.48 n.3, March 2005 [doi>10.1145/1047671.1047715]
• 12: {Green, 1997} Green, A. M. (1997). Kappa statistics for multiple raters using categorical classifications. In Proceedings of the Twenty-Second Annual Conference of SAS Users Group, San Diego, USA.
• 13: {Gyöngyi and Garcia-Molina, 2005} Gyöngyi, Z. and Garcia-Molina, H. (2005). Web spam taxonomy. In First International Workshop on Adversarial Information Retrieval on the Web.
• 14: {Gyöngyi et al., 2004} Gyöngyi, Z., Molina, H. G., and Pedersen, J. (2004). Combating web spam with trustrank. In Proceedings of the Thirtieth International Conference on Very Large Data Bases (VLDB), pages 576--587, Toronto, Canada. Morgan Kaufmann.
• 15: Alexandros Ntoulas , Marc Najork , Mark Manasse , Dennis Fetterly, Detecting spam web pages through content analysis, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135794]
• 16: {Page et al., 1998} Page, L., Brin, S., Motwani, R., and Winograd, T. (1998). The PageRank citation ranking: bringing order to the Web. Technical report, Stanford Digital Library Technologies Project.
• 17: {Perkins, 2001} Perkins, A. (2001). The classification of search engine spam. Available online at http://www.silverdisc.co.uk/articles/spam-classification/.