Mapping geographic coverage of the web

ABSTRACT

In this paper, we describe a methodology to estimate the geographic coverage of the web without the need for secondary knowledge or complex geo-tagging. This is achieved by randomly selecting toponyms from the Ordnance Survey 50K gazetteer to create search queries and thus gather document counts from various web sources for Great Britain. The same gazetteer is then used to geo-code the results and enable mapping. To validate our approach, and demonstrate the effects of geo/non-geo and geo/geo ambiguity, we mapped the selected toponyms to Geograph, a community project that contains user generated geo-tagged photographs of the UK. Although success varies with resolution, the proposed approach is likely sufficient to be reliably used by applications exploring the geographic coverage of the web for cases where references to settlements are likely to be common. In our case, we applied the method to produce maps of web coverage for a range of sources at a resolution of 30km.

REFERENCES

• 1: Einat Amitay , Nadav Har'El , Ron Sivan , Aya Soffer, Web-a-where: geotagging web content, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009040]
• 2: Lars Backstrom , Jon Kleinberg , Ravi Kumar , Jasmine Novak, Spatial variation in search engine queries, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China [doi>10.1145/1367497.1367546]
• 3: Brunner, T. (2008), 'Geographic Information Retrieval: Identifikation der geographischen Lage von Zeitungsartikeln', Master's thesis, Geographisches Institut.
• 4: Census, General Register Office for Scotland, Census: Standard Area Statistics (Scotland) {Computer File}. 2001, ESRC/JISC Census Programme, Census Dissemination Unit, MIMAS (University of Manchester).
• 5: Census, Office for National Statistics, Census: Standard Area Statistics (England and Wales) {Computer File}. 2001, ESRC/JISC Census Programme, Census Dissemination Unit, MIMAS (University of Manchester).
• 6: Chakrabrati, S., Mining the Web: Analysis of Hypertext and Semi Structured Data. 2002: Morgan Kaufmann.
• 7: Philipp Cimiano , Steffen Staab, Learning by googling, ACM SIGKDD Explorations Newsletter, v.6 n.2, p.24-33, December 2004 [doi>10.1145/1046456.1046460]
• 8: Martin Dodge , Rob Kitchin, Mapping Cyberspace, Routledge, New York, NY, 2000
• 9: Max J. Egenhofer, Toward the semantic geospatial web, Proceedings of the 10th ACM international symposium on Advances in geographic information systems, p.1-4, November 08-09, 2002, McLean, Virginia, USA [doi>10.1145/585147.585148]
• 10: Goodchild, M. F., Citizens as Sensors: The World of Volunteered Geography. GeoJournal, 2007. 69(4): p. 211--221.
• 11: A. Gulli , A. Signorini, The indexable web is more than 11.5 billion pages, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062789]
• 12: Linda L. Hill, Core Elements of Digital Gazetteers: Placenames, Categories, and Footprints, Proceedings of the 4th European Conference on Research and Advanced Technology for Digital Libraries, p.280-290, September 18-20, 2000
• 13: Marty Himmelstein, Local Search: The Internet Is the Yellow Pages, Computer, v.38 n.2, p.26-34, February 2005 [doi>10.1109/MC.2005.65]
• 14: Christopher B. Jones , Harith Alani , Douglas Tudhope, Geographical Information Retrieval with Ontologies of Place, Proceedings of the International Conference on Spatial Information Theory: Foundations of Geographic Information Science, p.322-335, September 19-23, 2001
• 15: C. B. Jones , R. S. Purves , P. D. Clough , H. Joho, Modelling vague places with knowledge from the Web, International Journal of Geographical Information Science, v.22 n.10, p.1045-1065, January 2008 [doi>10.1080/13658810701850547]
• 16: Frank Keller , Mirella Lapata, Using the web to obtain frequencies for unseen bigrams, Computational Linguistics, v.29 n.3, p.459-484, September 2003 [doi>10.1162/089120103322711604]
• 17: Adam Kilgarriff , Gregory Grefenstette, Introduction to the special issue on the web as corpus, Computational Linguistics, v.29 n.3, p.333-347, September 2003 [doi>10.1162/089120103322711569]
• 18: Larson, R. Geographic Information Retrieval and Spatial Browsing. in Geographic Information Systems and Libraries: Patrons, Maps, and Spatial Information. 1996: Urbana-Champaign: Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign.
• 19: Huifeng Li , Rohini K. Srihari , Cheng Niu , Wei Li, InfoXtract location normalization: a hybrid approach to geographic references in information extraction, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.39-44, May 31, 2003 [doi>10.3115/1119394.1119400]
• 20: Lin, J. and A. Halavais, Geographical Distribution of Blogs in the United States. Webeology, 2006. 3(4).
• 21: Markowetz, A., T. Brinkhoff, and B. Seeger. Geographic Information Retrieval. in 3rd International Workshop on Web Dynamics {online: http://dbs.mathematik.uni-marburg.de/publications/myPapers/2004/WebDyn2004.pdf}. 2004.
• 22: Kevin S. McCurley, Geospatial mapping and navigation of the web, Proceedings of the 10th international conference on World Wide Web, p.221-229, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372056]
• 23: Andrei Mikheev , Marc Moens , Claire Grover, Named Entity recognition without gazetteers, Proceedings of the ninth conference on European chapter of the Association for Computational Linguistics, June 08-12, 1999, Bergen, Norway [doi>10.3115/977035.977037]
• 24: G. Monroe , J. French , A. Powell, Obtaining Language Models of Web Collections Using Query-Based Sampling Techniques, Proceedings of the 35th Annual Hawaii International Conference on System Sciences (HICSS'02)-Volume 3, p.67.2, January 07-10, 2002
• 25: Purves, R., P. Clough, and H. Joho. Identifying Imprecise Regions for Geographic Information Retrieval Using the Web. in GISRUK 2005 - 13th Annual Conference on GIS Research UK. 2005.
• 26: Erik Rauch , Michael Bukatin , Kenneth Baker, A confidence-based framework for disambiguating geographic terms, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.50-54, May 31, 2003 [doi>10.3115/1119394.1119402]
• 27: Philip Resnik , Noah A. Smith, The Web as a parallel corpus, Computational Linguistics, v.29 n.3, p.349-380, September 2003 [doi>10.1162/089120103322711578]
• 28: Sanderson, M. and J. Kohler. Analyzing Geographic Queries. in SIGIR 2004 - Workshop on Geographic Information Retrieval. 2004.
• 29: Steven Schockaert , Martine De Cock, Neighborhood restrictions in geographic IR, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277772]
• 30: David A. Smith , Gideon S. Mann, Bootstrapping toponym classifiers, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.45-49, May 31, 2003 [doi>10.3115/1119394.1119401]
• 31: Jaideep Srivastava , Robert Cooley, Web Business Intelligence: Mining the Web for Actionable Knowledge, INFORMS Journal on Computing, v.15 n.2, p.191-207, April 2003 [doi>10.1287/ijoc.15.2.191.14447]
• 32: Tezuka, T. and K. Tanaka. Landmark Extraction: A Web Mining Approach. in COSIT 2005 - Conference on Spatial Information Theory. 2005.
• 33: Tobler, W. R. (1979), 'Smooth Pycnophylactic Interpolation for Geographical Regions', Journal of the American Statistical Association 74(367), 519--530.
• 34: Zook, M., The Geographies of the Internet, in Annual Review of Information Science and Technology, B. Cronin, Editor. 2005. p. 53--78.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering; Retrieval models

General Terms:
Experimentation, Human Factors

Keywords:
gazetteers, geographic information retrieval, geographic references, web coverage