NewsStand: a new view on news

ABSTRACT

News articles contain a wealth of implicit geographic content that if exposed to readers improves understanding of today's news. However, most articles are not explicitly geotagged with their geographic content, and few news aggregation systems expose this content to users. A new system named NewsStand is presented that collects, analyzes, and displays news stories in a map interface, thus leveraging on their implicit geographic content. NewsStand monitors RSS feeds from thousands of online news sources and retrieves articles within minutes of publication. It then extracts geographic content from articles using a custom-built geotagger, and groups articles into story clusters using a fast online clustering algorithm. By panning and zooming in NewsStand's map interface, users can retrieve stories based on both topical significance and geographic region, and see substantially different stories depending on position and zoom level.

REFERENCES

• 1: Einat Amitay , Nadav Har'El , Ron Sivan , Aya Soffer, Web-a-where: geotagging web content, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009040]
• 2: B. Baldwin and B. Carpenter. Lingpipe {online, cited 24 Jun 2008}. Available from World Wide Web: http://alias-i.com/lingpipe/.
• 3: Roberto J. Bayardo , Yiming Ma , Ramakrishnan Srikant, Scaling up all pairs similarity search, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242591]
• 4: Ken Been , Eli Daiches , Chee Yap, Dynamic Map Labeling, IEEE Transactions on Visualization and Computer Graphics, v.12 n.5, p.773-780, September 2006 [doi>10.1109/TVCG.2006.136]
• 5: Ken Been , Martin Nöllenburg , Sheung-Hung Poon , Alexander Wolff, Optimizing active ranges for consistent dynamic map labeling, Proceedings of the twenty-fourth annual symposium on Computational geometry, June 09-11, 2008, College Park, MD, USA [doi>10.1145/1377676.1377681]
• 6: John D. Burger , John C. Henderson , William T. Morgan, Statistical named entity recognizer adaptation, proceedings of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118856]
• 7: O. Buyukkokten, J. Cho, H. Garcia-Molina, L. Gravano, and N. Shivakumar. Exploiting geographical location information of web pages. In Proceedings of the Workshop on Web Databases, pages 91--96, Philadelphia, PA, June 1999.
• 8: Yen-Yu Chen , Torsten Suel , Alexander Markowetz, Efficient query processing in geographic web search engines, Proceedings of the 2006 ACM SIGMOD international conference on Management of data, June 27-29, 2006, Chicago, IL, USA [doi>10.1145/1142473.1142505]
• 9: Jon Christensen , Joe Marks , Stuart Shieber, An empirical study of algorithms for point-feature label placement, ACM Transactions on Graphics (TOG), v.14 n.3, p.203-232, July 1995 [doi>10.1145/212332.212334]
• 10: Silviu Cucerzan , David Yarowsky, Language independent NER using a unified model of internal and contextual evidence, proceedings of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118860]
• 11: Junyan Ding , Luis Gravano , Narayanan Shivakumar, Computing Geographical Scopes of Web Resources, Proceedings of the 26th International Conference on Very Large Data Bases, p.545-556, September 10-14, 2000
• 12: Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000
• 13: W. N. Francis. A standard corpus of edited present-day american english. College English, 26(4):267--273, 1965.
• 14: Aristides Gionis , Piotr Indyk , Rajeev Motwani, Similarity Search in High Dimensions via Hashing, Proceedings of the 25th International Conference on Very Large Data Bases, p.518-529, September 07-10, 1999
• 15: J. L. Leidner. Toponym Resolution in Text: Annotation, Evaluation and Applications of Spatial Grounding of Place Names. PhD thesis, University of Edinburgh, Edinburgh, Scotland, UK, Oct. 2006.
• 16: Huifeng Li , Rohini K. Srihari , Cheng Niu , Wei Li, InfoXtract location normalization: a hybrid approach to geographic references in information extraction, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.39-44, May 31, 2003 [doi>10.3115/1119394.1119400]
• 17: Michael D. Lieberman , Hanan Samet , Jagan Sankaranarayanan , Jon Sperling, STEWARD: architecture of a spatio-textual search engine, Proceedings of the 15th annual ACM international symposium on Advances in geographic information systems, November 07-09, 2007, Seattle, Washington [doi>10.1145/1341012.1341045]
• 18: J. Makkonen, H. Ahonen-Myka, and M. Salmenkivi. Topic detection and tracking with spatio-temporal evidence. In Proceedings of 25th European Conference on Information Retrieval Research, pages 251--265, Pisa, Italy, Apr. 2003.
• 19: Robert Malouf, Markov models for language-independent named entity recognition, proceedings of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118872]
• 20: A. Markowetz, T. Brinkhoff, and B. Seeger. Exploiting the internet as a geospatial database. In Proceedings on the Workshop on Next Generation Geospatial Information, Cambridge, MA, Oct. 2003. Online Proceedings.
• 21: Kevin S. McCurley, Geospatial mapping and navigation of the web, Proceedings of the 10th international conference on World Wide Web, p.221-229, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372056]
• 22: Paul McNamee , James Mayfield, Entity extraction without language-specific resources, proceedings of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118873]
• 23: Andrew Mehler , Yunfan Bao , Xin Li , Yue Wang , Steven Skiena, Spatial Analysis of News Sources, IEEE Transactions on Visualization and Computer Graphics, v.12 n.5, p.765-772, September 2006 [doi>10.1109/TVCG.2006.179]
• 24: K. D. Mote. Fast point-feature label placement for dynamic visualizations. Master's thesis, Washington State University, Pullman, WA, Dec. 2007.
• 25: Jon Patrick , Casey Whitelaw , Robert Munro, SLINERC: the Sydney Language-Independent Named Entity Recogniser and Classifier, proceedings of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118875]
• 26: I. Petzold, G. Gröger, and L. Plümer. Fast screen map labeling --- data structures and algorithms. In Proceedings of the 21st International Cartographic Conference, pages 288--298, Durban, South Africa, Aug. 2003.
• 27: I. Petzold, L. Plümer, and M. Heber. Label placement for dynamically generated screen maps. In Proceedings of the 19th International Cartographic Conference, pages 893--903, Ottawa, Canada, Aug. 1999.
• 28: S.-H. Poon and C.-S. Shin. Adaptive zooming in point set labeling. Lecture Notes in Computer Science, 3623:233--244, Sept. 2005.
• 29: M. F. Porter. An algorithm for suffix stripping. Program, 14(3):130--137, 1980.
• 30: Ross S. Purves , Paul Clough , Christopher B. Jones , Avi Arampatzis , Benedicte Bucher , David Finch , Gaihua Fu , Hideo Joho , Awase Khirni Syed , Subodh Vaid , Bisheng Yang, The design and implementation of SPIRIT: a spatially aware search engine for information retrieval on the Internet, International Journal of Geographical Information Science, v.21 n.7, p.717-745, January 2007 [doi>10.1080/13658810601169840]
• 31: Erik Rauch , Michael Bukatin , Kenneth Baker, A confidence-based framework for disambiguating geographic terms, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.50-54, May 31, 2003 [doi>10.3115/1119394.1119402]
• 32: Y. Ravin and N. Wacholder. Extracting names from natural-language text. Technical Report RC 2033, IBM Research Report, Yorktown Heights, NY" 1997.
• 33: Gerard Salton , Christopher Buckley, Term-weighting approaches in automatic text retrieval, Information Processing and Management: an International Journal, v.24 n.5, p.513-523, 1988 [doi>10.1016/0306-4573(88)90021-0]
• 34: G. Salton , A. Wong , C. S. Yang, A vector space model for automatic indexing, Communications of the ACM, v.18 n.11, p.613-620, Nov. 1975 [doi>10.1145/361219.361220]
• 35: David A. Smith , Gideon S. Mann, Bootstrapping toponym classifiers, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.45-49, May 31, 2003 [doi>10.3115/1119394.1119401]
• 36: David A. Smith , Gregory Crane, Disambiguating Geographic Names in a Historical Digital Library, Proceedings of the 5th European Conference on Research and Advanced Technology for Digital Libraries, p.127-136, September 04-09, 2001
• 37: M. Steinbach, G. Karypis, and V. Kumar. A comparison of document clustering techniques. In KDD Workshop on Text Mining, pages 1--20, Boston, MA, Aug. 2000.
• 38: The Associated Press. Mobile news network {online, cited 24 Jun 2008}. Available from World Wide Web: http://apnews.com/.
• 39: Thomson Reuters. Reuters news maps {online, cited 24 Jun 2008}. Available from World Wide Web: http://labs.reuters.com/newsmaps/.
• 40: Chuang Wang , Xing Xie , Lee Wang , Yansheng Lu , Wei-Ying Ma, Web resource geographic location classification and detection, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062907]
• 41: M. Wick and B. Vatant. The geonames geographical database {online, cited 24 Jun 2008}. Available from World Wide Web: http://geonames.org/.
• 42: Dekai Wu , Grace Ngai , Marine Carpuat , Jeppe Larsen , Yongsheng Yang, Boosting for named entity recognition, proceedings of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118888]
• 43: M. Yamamoto, G. Câmara, and L. Lorena. Fast point-feature label placement algorithm for real time screen maps. In Proceedings of the 7th Brazilian Symposium on GeoInformatics, pages 1--13, Campos do Jordão, Brazil, Nov. 2005.
• 44: GuoDong Zhou , Jian Su, Named entity recognition using an HMM-based chunk tagger, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073163]
• 45: Yinghua Zhou , Xing Xie , Chuang Wang , Yuchang Gong , Wei-Ying Ma, Hybrid index structures for location-based web search, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099584]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Algorithms, Design, Performance

Keywords:
clustering, geotagging, knowledge discovery, text mining