Web spam challenge proposal for filtering in archives

ABSTRACT

In this paper we propose new tasks for a possible future Web Spam Challenge motivated by the needs of the archival community. The Web archival community consists of several relatively small institutions that operate independently and possibly over different top level domains (TLDs). Each of them may have a large set of historic crawls. Efficient filtering would hence require (1) enhanced use of the time series of domain snapshots and (2) collaboration by transferring models across different TLDs. Corresponding Challenge tasks could hence include the distribution of crawl snapshot data for feature generation as well as classification of unlabeled new crawls of the same or even different TLDs.

REFERENCES

• 1: J. Abernethy, O. Chapelle, and C. Castillo. WITCH: A New Approach to Web Spam Detection. In Proc. 4th Int. Workshop on Adversarial Information Retrieval on the Web (AIRWeb), 2008.
• 2: István Bíró , Dávid Siklósi , Jácint Szabó , András A. Benczúr, Linked latent Dirichlet allocation in web spam filtering, Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web, April 21-21, 2009, Madrid, Spain [doi>10.1145/1531914.1531922]
• 3: Paolo Boldi , Bruno Codenotti , Massimo Santini , Sebastiano Vigna, UbiCrawler: a scalable fully distributed web crawler, Software—Practice & Experience, v.34 n.8, p.711-726, 10 July 2004 [doi>10.1002/spe.587]
• 4: Paolo Boldi , Massimo Santini , Sebastiano Vigna, A large time-aware web graph, ACM SIGIR Forum, v.42 n.2, December 2008 [doi>10.1145/1480506.1480511]
• 5: Carlos Castillo , Debora Donato , Luca Becchetti , Paolo Boldi , Stefano Leonardi , Massimo Santini , Sebastiano Vigna, A reference collection for web spam, ACM SIGIR Forum, v.40 n.2, p.11-24, December 2006 [doi>10.1145/1189702.1189703]
• 6: G. Cormack. Content-based Web Spam Detection. In Proc. 3rd Int. Workshop on Adversarial Information Retrieval on the Web (AIRWeb), 2007.
• 7: Na Dai , Brian D. Davison , Xiaoguang Qi, Looking into the past to better classify web spam, Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web, April 21-21, 2009, Madrid, Spain [doi>10.1145/1531914.1531916]
• 8: Miklós Erdélyi , András A. Benczúr , Julien Masanés , Dávid Siklósi, Web spam filtering in internet archives, Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web, April 21-21, 2009, Madrid, Spain [doi>10.1145/1531914.1531918]
• 9: G. Geng, X. Jin, and C. Wang. CASIA at WSC2008. In Proc. 4th Int. Workshop on Adversarial Information Retrieval on the Web (AIRWeb), 2008.
• 10: Y. joo Chung, M. Toyoda, and M. Kitsuregawa. A study of web spam evolution using a time series of web snapshots. In AIRWeb '09: Proc. 5th int. workshop on Adversarial information retrieval on the web, 2009.
• 11: Alexandros Ntoulas , Marc Najork , Mark Manasse , Dennis Fetterly, Detecting spam web pages through content analysis, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135794]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Document analysis

Keywords:
challenge, document classification, evaluation, information retrieval, web archival, web spam