Structured translation for cross-language information retrieval

ABSTRACT

The paper introduces a query translation model that reflects the structure of the cross-language information retrieval task. The model is based on a structured bilingual dictionary in which the translations of each term are clustered into groups with distinct meanings. Query translation is modeled as a two-stage process, with the system first determining the intended meaning of a query term and then selecting translations appropriate to that meaning that might appear in the document collection. An implementation of structured translation based on automatic dictionary clustering is described and evaluated by using Chinese queries to retrieve English documents. Structured translation achieved an average precision that was statistically indistinguishable from Pirkola's technique for very short queries, but Pirkola's technique outperformed structured translation on long queries. The paper concludes with some observations on future work to improve retrieval effectiveness and on other potential uses of structured translation in interactive cross-language retrieval applications.

REFERENCES

• 1: M. J. Bates. Subject access in online catalogs: A design model. Journal of the American Society for Information Sczence, 37(6):357-376, 1986.
• 2: Hsin-Hsi Chen , Guo-Wei Bian , Wen-Cheng Lin, Resolving translation ambiguity and target polysemy in cross-language information retrieval, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.215-222, June 20-26, 1999, College Park, Maryland [doi>10.3115/1034678.1034717]
• 3: C. Fellbaum, editor. WordNet: An Eleetronze Lexical Database. MIT Press, 1998.
• 4: Nancy Ide , Jean Véronis, Introduction to the special issue on word sense disambiguation: the state of the art, Computational Linguistics, v.24 n.1, March 1998
• 5: Jaana Kekäläinen , Kalervo Järvelin, The impact of query structure and query expansion on retrieval performance, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.130-137, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290978]
• 6: Dekang Lin, PRINCIPAR: an efficient, broad-coverage, principle-based parser, Proceedings of the 15th conference on Computational linguistics, August 05-09, 1994, Kyoto, Japan [doi>10.3115/991886.991970]
• 7: Dekang Lin, An Information-Theoretic Definition of Similarity, Proceedings of the Fifteenth International Conference on Machine Learning, p.296-304, July 24-27, 1998
• 8: R. Mandala, T. Takenobu, and T. Hozumi. The use of Word.Net in information retrieval. In COLING/ACL Workshop on Usage of WordNet in Natural Language Processing Systert, 1998.
• 9: J. Scott McCarley, Should we translate the documents or the queries in cross-language information retrieval?, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.208-214, June 20-26, 1999, College Park, Maryland [doi>10.3115/1034678.1034716]
• 10: Susan W. McRoy, Using multiple knowledge sources for word sense discrimination, Computational Linguistics, v.18 n.1, p.1-30, March 1992
• 11: D. W. Oard and A. R. Diekema. Cross-language information retrieval. In Annual Review of Information Science and Technology, volume 33. ASIS, 1998.
• 12: Douglas W. Oard , Philip Resnik, Support for interactive document selection in cross-language information retrieval, Information Processing and Management: an International Journal, v.35 n.3, p.363-379, May 1999 [doi>10.1016/S0306-4573(98)00066-1]
• 13: W. Ogden et al. Getting information from documents you cannot read: An interactive cross-language text retrieval and summarization system. In SIGIR/DL Workshop on Mulhlingual Information Discovery and Access, Aug. 1999.
• 14: Ari Pirkola, The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.55-63, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290957]
• 15: Páraic Sheridan , Jean Paul Ballerini, Experiments in multilingual information retrieval using the SPIDER system, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.58-65, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243213]
• 16: R. Sperer. Translation ambiguity reduction in translingual information filtering using Word.Net. Master's thesis, University of Maryland, College Park, 1999.
• 17: B. M. Wildemuth, K. Cogdill, and C. P. Friedman. The transition from formalized to compromised need in the context of clinical problem solving. In Second International Conference on Research zn Information Needs, Seeking and Use in Different Contests, pages 290-303, Aug. 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Machine translation

General Terms:
Algorithms, Design, Experimentation, Performance