Translation enhancement: a new relevance feedback method for cross-language information retrieval

ABSTRACT

As an effective technique for improving retrieval effectiveness, relevance feedback (RF) has been widely studied in both monolingual and cross-language information retrieval (CLIR) settings. The studies of RF in CLIR have been focused on query expansion (QE), in which queries are reformulated before and/or after they are translated. However, RF in CLIR actually not only can help select better query terms, but also can enhance query translation by adjusting translation probabilities and even resolve some out-of-vocabulary terms. In this paper, we propose a novel RF method called translation enhancement (TE), which uses the extracted translation relationships from relevant documents to revise the translation probabilities of query terms and to identify extra translation alternatives if available so that the translated queries are more tuned to the current search. We studied TE using pseudo relevance feedback (PRF) and interactive relevance feedback (IRF). Our results show that TE can significantly improve CLIR with both types of RF methods, and that the improvement is comparable to that of QE. More importantly, the effects of TE and QE are complementary. Their integration can produce further improvement, and makes CLIR more robust for a variety of queries.

REFERENCES

• 1: Allan, J. HARD Track Overview in TREC 2003 High Accuracy Retrieval from Documents. In 12th Text Retrieval Conference. pages 24--37. 2003.
• 2: James Allan, Introduction to topic detection and tracking, Topic detection and tracking: event-based information organization, Kluwer Academic Publishers, Norwell, MA, 2002
• 3: Lisa Ballesteros , W. Bruce Croft, Phrasal translation and query expansion techniques for cross-language information retrieval, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, p.84-91, July 27-31, 1997, Philadelphia, Pennsylvania, United States
• 4: Buckley, C., Salton, G., Allan, J. and Singhal, A. Automatic Query Expansion Using SMART: TREC 3. In The Third Text REtrieval Conference (TREC-3). 1994.
• 5: Kareem Darwish , Douglas W. Oard, Probabilistic structured query methods, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860497]
• 6: Dina Demner-Fushman , Douglas W. Oard, The Effect of Bilingual Term List Size on Dictionary-Based Cross-Language Information Retrieval, Proceedings of the 36th Annual Hawaii International Conference on System Sciences (HICSS'03) - Track 4, p.108.2, January 06-09, 2003
• 7: Gey, F. C. and Chen, A. TREC-9 Cross-Language Information Retrieval (English - Chinese) Overview. In TREC 2001. pages 1--10. 2001.
• 8: Donna Harman, Relevance feedback revisited, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.1-10, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133167]
• 9: Harper, D. J. Relevance Feedback in document retrieval systems: an evaluation of probabilistic strategies. Jesus College, Cambridge University, 1980.
• 10: Daqing He , Douglas W. Oard , Jianqiang Wang , Jun Luo , Dina Demner-Fushman , Kareem Darwish , Philip Resnik , Sanjeev Khudanpur , Michael Nossal , Michael Subotin , Anton Leuski, Making MIRACLEs: Interactive translingual search for Cebuano and Hindi, ACM Transactions on Asian Language Information Processing (TALIP), v.2 n.3, p.219-244, September 2003 [doi>10.1145/979872.979876]
• 11: He, D., Wang, J., Oard, D. W. and Nossal, M. Comparing user-assisted and Automatic Query Translation. In Proceedings of CLEF'02. pages 400--415. 2002.
• 12: Djoerd Hiemstra , Wessel Kraaij , Renée Pohlmann , Thijs Westerveld, Translation Resources, Merging Strategies, and Relevance Feedback for Cross-Language Information Retrieval, Revised Papers from the Workshop of Cross-Language Evaluation Forum on Cross-Language Information Retrieval and Evaluation, p.102-115, September 21-22, 2000
• 13: Ide, E. New experiments in relevance feedback. The SMART retrieval system, Experiments in automatic document processing. G. Salton (Eds). Prentice-Hall. pp:337--354. 1971.
• 14: Victor Lavrenko , Martin Choquette , W. Bruce Croft, Cross-lingual relevance models, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564408]
• 15: Victor Lavrenko , W. Bruce Croft, Relevance based language models, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.120-127, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383972]
• 16: Fernando López-Ostenero , Julio Gonzalo , Anselmo Peñas , Felisa Verdejo, Noun Phrase Translations for Cross-Language Document Selection, Revised Papers from the Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language Information Retrieval Systems, p.320-331, September 03-04, 2001
• 17: Paul McNamee , James Mayfield, Comparing cross-language query expansion techniques by degrading translation resources, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564406]
• 18: Anne Diekema , Wen-Yuan Hsiao, Cross-Language Information Retrieval Using Dutch Query Translation, Revised Papers from the Workshop of Cross-Language Evaluation Forum on Cross-Language Information Retrieval and Evaluation, p.230-236, September 21-22, 2000
• 19: Douglas W. Oard , Julio Gonzalo, The CLEF 2001 Interactive Track, Revised Papers from the Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language Information Retrieval Systems, p.308-319, September 03-04, 2001
• 20: Viviane Moreira Orengo , Christian Huyck, Relevance feedback and cross-language information retrieval, Information Processing and Management: an International Journal, v.42 n.5, p.1203-1217, September 2006 [doi>10.1016/j.ipm.2005.12.003]
• 21: Ari Pirkola, The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.55-63, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290957]
• 22: Ponte, J. M. Language models for relevance feedback. Advances in Information retrieval: Recent Research from the Center for Intelligent Information Retrieval. W. B. Croft (Eds). Kluwer Academic Publishers. pp:73--95. 2000.
• 23: Philip Resnik , Douglas Oard , Gina Levow, Improved cross-language retrieval using backoff translation, Proceedings of the first international conference on Human language technology research, p.1-3, March 18-21, 2001, San Diego [doi>10.3115/1072133.1072185]
• 24: Rocchio, J. J. Relevance Feedback in Information Retrieval. the SMART Retrieval System. G. Salton (Eds). Prentice Hall, Inc. pp:313--323. 1971.
• 25: Salton, G. and Buckley, C. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41(4): 288--297.1990
• 26: Ellen M. Voorhees, Query expansion using lexical-semantic relations, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.61-69, July 03-06, 1994, Dublin, Ireland
• 27: Jianqiang Wang , Douglas W. Oard, iCLEF 2001 at Maryland: Comparing Term-for-Term Gloss and MT, Revised Papers from the Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language Information Retrieval Systems, p.336-354, September 03-04, 2001
• 28: Jianqiang Wang , Douglas W. Oard, Combining bidirectional translation and synonymy for cross-language information retrieval, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148208]
• 29: Jinxi Xu , W. Bruce Croft, Improving the effectiveness of information retrieval with local context analysis, ACM Transactions on Information Systems (TOIS), v.18 n.1, p.79-112, Jan. 2000 [doi>10.1145/333135.333138]
• 30: Xu, J., Fraser, A. and Weischedel, R. TREC 2001 Cross-lingual Retrieval at BBN. In Proceeding of TREC01. 2001.
• 31: David Yarowsky, Unsupervised word sense disambiguation rivaling supervised methods, Proceedings of the 33rd annual meeting on Association for Computational Linguistics, p.189-196, June 26-30, 1995, Cambridge, Massachusetts [doi>10.3115/981658.981684]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

General Terms:
Algorithms, Experimentation, Languages, Performance

Keywords:
cross-language information retrieval, query expansion, relevance feedback, translation enhancement