Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

We have studied the problem of linking event information across different languages without the use of translation systems or dictionaries. The linking is based on interlingua information obtained through probabilistic topic models trained on comparable corpora written in two languages (in our case English and Dutch). The achieve this, we expand the Latent Dirichlet Allocation model to process documents in two languages. We demonstrate the validity of the learned interlingual topics in a document clustering task, where the evaluation is performed on Google News.

REFERENCES

• 1: James Allan , Victor Lavrenko , Russell Swan, Explorations within topic tracking and detection, Topic detection and tracking: event-based information organization, Kluwer Academic Publishers, Norwell, MA, 2002
• 2: James Allan , Courtney Wade , Alvaro Bolivar, Retrieval and novelty detection at the sentence level, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860493]
• 3: A. Bagga and B. Baldwin. Algorithms for scoring coreference chains. In In The First International Conference on Language Resources and Evaluation Workshop on Linguistics Coreference, pages 563--566, 1998.
• 4: Michael W. Berry , Susan T. Dumais , Gavin W. O'Brien, Using linear algebra for intelligent information retrieval, SIAM Review, v.37 n.4, p.573-595, Dec. 1995 [doi>10.1137/1037127]
• 5: David M. Blei , Andrew Y. Ng , Michael I. Jordan, Latent dirichlet allocation, The Journal of Machine Learning Research, 3, p.993-1022, 3/1/2003 [doi>10.1162/jmlr.2003.3.4-5.993]
• 6: J. G. Carbonell, J. G. Yang, R. E. Frederking, R. D. Brown, Y. Geng, D. Lee, Y. Frederking, R. E, R. D. Geng, and Y. Yang. Translingual information retrieval: A comparative evaluation. In In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, pages 708--714, 1997.
• 7: Peter A. Chew , Brett W. Bader , Tamara G. Kolda , Ahmed Abdelali, Cross-language information retrieval using PARAFAC2, Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, August 12-15, 2007, San Jose, California, USA [doi>10.1145/1281192.1281211]
• 8: Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
• 9: S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41:391--407, 1990.
• 10: T. Hofmann. Probabilistic latent semantic analysis. In Proceedings of Uncertainty in Artificial Intelligence, UAI, Stockholm, 1999.
• 11: Michael I. Jordan , Zoubin Ghahramani , Tommi S. Jaakkola , Lawrence K. Saul, An Introduction to Variational Methods for Graphical Models, Machine Learning, v.37 n.2, p.183-233, Nov.1.1999 [doi>10.1023/A:1007665907178]
• 12: Giridhar Kumaran , James Allan, Text classification and named entities for new event detection, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009044]
• 13: Leah S. Larkey , Fangfang Feng , Margaret Connell , Victor Lavrenko, Language-specific models in multilingual topic tracking, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009061]
• 14: Zhiwei Li , Bin Wang , Mingjing Li , Wei-Ying Ma, A probabilistic model for retrospective news event detection, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076055]
• 15: M. Littman, S. T. Dumais, and T. K. Landauer. Automatic cross-language information retrieval using latent semantic indexing. In Cross-Language Information Retrieval, chapter 5, pages 51--62. Kluwer Academic Publishers, 1998.
• 16: U. Makkonen, H. Ahonen-Myka, and Marko. Applying semantic classes in event detection and tracking. In Proc. International Conference on Natural Language Processing (ICON'02), pages 175--183, 2002.
• 17: B. Mathieu, R. Besançon, and C. Fluhr. Multilingual document clusters discovery. In RIAO, pages 116--125, 2004.
• 18: T. Muramatsu and T. Mori. Integration of plsa into probabilistic clir model. In Proceedings of NTCIR-04, 2004.
• 19: Xiaochuan Ni , Jian-Tao Sun , Jian Hu , Zheng Chen, Mining multilingual topics from wikipedia, Proceedings of the 18th international conference on World wide web, April 20-24, 2009, Madrid, Spain [doi>10.1145/1526709.1526904]
• 20: Bruno Pouliquen , Ralf Steinberger , Camelia Ignat , Tom De Groeve, Geographical information recognition and visualization in texts written in various languages, Proceedings of the 2004 ACM symposium on Applied computing, March 14-17, 2004, Nicosia, Cyprus [doi>10.1145/967900.968115]
• 21: W. D. Smet and M.-F. Moens. An aspect based document representation for event clustering. In Proceedings of CLIN 19.
• 22: Ellen M. Voorhees, Implementing Agglomerative Hierarchic Clustering Algorithms for Use in Document Retrieval, Cornell University, Ithaca, NY, 1986
• 23: Yejun Wu , Douglas W. Oard, Bilingual topic aspect classification with a few training examples, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390371]
• 24: Yiming Yang , Jaime G. Carbonell , Ralf D. Brown , Thomas Pierce , Brian T. Archibald , Xin Liu, Learning Approaches for Detecting and Tracking News Events, IEEE Intelligent Systems, v.14 n.4, p.32-43, July 1999 [doi>10.1109/5254.784083]
• 25: Kuo Zhang , Juan Zi , Li Gang Wu, New event detection based on indexing-tree and named entity, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277780]
• 26: Bing Zhao , Eric P. Xing, BiTAM: bilingual topic AdMixture models for word alignment, Proceedings of the COLING/ACL on Main conference poster sessions, p.969-976, July 17-18, 2006, Sydney, Australia

INDEX TERMS

Primary Classification:
  G. Mathematics of Computing
  G.3 PROBABILITY AND STATISTICS
      Subjects: Stochastic processes

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Machine translation

General Terms:
Algorithms, Measurement

Keywords:
event detection, latent dirichlet allocation