The SPIRIT collection: an overview of a large web collection

ABSTRACT

A large scale collection of web pages has been essential for research in information retrieval and related areas. This paper provides an overview of a large web collection used in the SPIRIT project for the design and testing of spatially-aware retrieval systems. Several statistics are derived and presented to show the characteristics of the collection.

REFERENCES

• 1: Cacheda, F., Plachouras, V. & Ounis:, I. (2004). "Performance Analysis of Distributed Architectures to Index One Terabyte of Text". In: McDonald, S. & Tait, J. (eds.), Advances in Information Retrieval, Proceedings of the 26th European Conference on IR Research, Lecture Notes in Computer Science, Vol. 2997, Sunderland, UK. pp. 394--408. Springer.
• 2: C. L. A. Clarke , G. V. Cormack , M. Laszlo , T. R. Lynam , E. L. Terra, The impact of corpus size on question answering performance, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564448]
• 3: Craswell, N., Hawking, D., Wilkinson, R. & Wu, M. (2003). "Overview of the TREC 2003 Web Track". In: Voorheer, E. (ed.), NIST Special Publication 500--255:The Twelfth Text REtrieval Conference (TREC 2003), Gaithersburg, MD. pp. 78--92. NIST.
• 4: Cathal Gurrin , Alan F. Smeaton, Replicating Web Structure in Small-Scale Test Collections, Information Retrieval, v.7 n.3-4, p.239-263, September-December 2004 [doi>10.1023/B:INRT.0000011206.23588.ab]
• 5: Christopher B. Jones , R. Purves , A. Ruas , M. Sanderson , M. Sester , M. van Kreveld , R. Weibel, Spatial information retrieval and geographical ontologies an overview of the SPIRIT project, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564457]