Addressing the lack of direct translation resources for cross-language retrieval

ABSTRACT

Most cross language information retrieval research concentrates on language pairs for which direct, rich, and often multiple translation resources already exist. However, for most language pairs, translation via an intermediate language is necessary. Two distinct methods for dealing with the additional ambiguity introduced by the extra translation step have been proposed and individually, shown to improve retrieval effectiveness. Two previous works indicated that in combination, the methods were ineffective. This paper provides strong empirical evidence that the methods can be combined to produce consistent and often significant improvements in retrieval effectiveness. The improvement is shown across a number of different intermediate languages and test collections.

REFERENCES

• 1: Ballesteros, L. Cross-Language Retrieval via Transitive Translation. Advances in Information Retrieval: Recent Research from the CIIR, pp. 203-234. W. Bruce Croft, Ed. Kluwer Academic Publishers, 2000.
• 2: Lisa Ballesteros , W. Bruce Croft, Resolving ambiguity for cross-language retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.64-71, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290958]
• 3: Lisa Ballesteros , W. Bruce Croft, Phrasal translation and query expansion techniques for cross-language information retrieval, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, p.84-91, July 27-31, 1997, Philadelphia, Pennsylvania, United States
• 4: Broglio, J., Callan, J., and Croft, W. B. Inquery system overview. In Proceedings of the TIPSTER Text Program (Phase I), pp 47--67, 1994.
• 5: Tim Gollins , Mark Sanderson, Improving cross language retrieval with triangulated translation, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.90-95, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383965]
• 6: Gollins, T., Dictionary Based Transitive Cross-Language Information Retrieval Using Lexical Triangulation. MSc Dissertation, University of Sheffield. 2000.
• 7: Lehtokangas, R. and Airio, E., Translation via a Pivot Language Challenges Direct Translation in CLIR. Working Notes of the SIGIR 2002 Workshop on Cross-language Information Retrieval, pp 19--24.
• 8: Lehtokangas, R. and Airio, E., and Jarvelin, K. Transitive dictionary translation challenges direct dictionary translation in CLIR. University of Tampere Technical Report, 2003. http://www.info.uta.fi/tutkimus/fire/archive/RL_200503.pdf.
• 9: Revised Papers from the Workshop of Cross-Language Evaluation Forum on Cross-Language Information Retrieval and Evaluation, September 2000
• 10: Piepenbrock, R. CELEX, The Dutch Center for Lexical Information, CELEX, 2000. http://www.kun.nl/celex/.
• 11: Ari Pirkola , Turid Hedlund , Heikki Keskustalo , Kalervo Järvelin, Dictionary-Based Cross-Language Information Retrieval: Problems, Methods, and Research Findings, Information Retrieval, v.4 n.3-4, p.209-230, September-December 2001 [doi>10.1023/A:1011994105352]
• 12: Ari Pirkola, The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.55-63, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290957]
• 13: Voorhees, E. M., and Harman, D. K., NIST Special Publication 500-246: The Eighth Text REtrieval Conference (TREC-8), 1999. Editors: E. M. Voorhees and D. K. Harman
• 14: Ruth Sperer , Douglas W. Oard, Structured translation for cross-language information retrieval, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.120-127, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345562]
• 15: University of Neuchatel multilingual retrieval page. http://www.unine.ch/info/clef/
• 16: Kielikone multilingual dictionaries. www.kielikone.fi.
• 17: Kareem Darwish , Douglas W. Oard, Probabilistic structured query methods, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860497]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Algorithms, Experimentation, Measurement, Performance

Keywords:
cross-language information retrieval, cross-lingual, pivot language, structured queries, transitive translation