Making MIRACLEs: Interactive translingual search for Cebuano and Hindi

ABSTRACT

Searching is inherently a user-centered process; people pose the questions for which machines seek answers, and ultimately people judge the degree to which retrieved documents meet their needs. Rapid development of interactive systems that use queries expressed in one language to search documents written in another poses five key challenges: (1) interaction design, (2) query formulation, (3) cross-language search, (4) construction of translated summaries, and (5) machine translation. This article describes the design of MIRACLE, an easily extensible system based on English queries that has previously been used to search French, German, and Spanish documents, and explains how the capabilities of MIRACLE were rapidly extended to accommodate Cebuano and Hindi. Evaluation results for the cross-language search component are presented for both languages, along with results from a brief full-system interactive experiment with Hindi. The article concludes with some observations on directions for further research on interactive cross-language information retrieval.

REFERENCES

• 1: Kevin Knight , Jonathan Graehl, Machine transliteration, Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, p.128-135, July 07-12, 1997, Madrid, Spain
• 2: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 3: Lisa Ballesteros , W. Bruce Croft, Resolving ambiguity for cross-language retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.64-71, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290958]
• 4: Belkin, N. 1980. Anomalous states of knowledge as a basis for information retrieval. Canadian Journal of Information Science 5, 133--143.
• 5: Kareem Darwish , Douglas W. Oard, Probabilistic structured query methods, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860497]
• 6: Dina Demner-Fushman , Douglas W. Oard, The Effect of Bilingual Term List Size on Dictionary-Based Cross-Language Information Retrieval, Proceedings of the 36th Annual Hawaii International Conference on System Sciences (HICSS'03) - Track 4, p.108.2, January 06-09, 2003
• 7: Dorr, B., Zajic, D., and Schwartz, R. 2003. Cross language headline generation for Hindi. This volume.
• 8: Dorr, B. J., He, D., Luo, J., Oard, D. W., Schwartz, R., Wang, J., and Zajic, D. 2003. iCLEF 2003 at Maryland: Translation selection and document selection. In Proceedings of CLEF'03.
• 9: Garofolo, J. S., Voorhees, E. M., Stanford, V. M., and Sparck Jones, K. 1997. TREC-6 1997 spoken document retrieval track overview and results. In Proceedings of TREC 97. 83--91.
• 10: Paul G. Hackett , Douglas W. Oard, Comparison of word-based and syllable-based retrieval for Tibetan (poster session), Proceedings of the fifth international workshop on on Information retrieval with Asian languages, p.197-198, September 30-October 01, 2000, Hong Kong, China [doi>10.1145/355214.355242]
• 11: He, D., Wang, J., Oard, D. W., and Nossal, M. 2002. Comparing user-assisted and automatic query translation. In Proceedings of CLEF'02.
• 12: K. L. Kwok, A new method of weighting query terms for ad-hoc retrieval, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.187-195, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243266]
• 13: Gary Marchionini, Information seeking in electronic environments, Cambridge University Press, New York, NY, 1995
• 14: Meng, H., Chen, B., Grams, E., Khudanpur, S., Lo, W.-K., Levow, G. A., Oard, D. W., Schone, P., Tang, K., Wang, H.-M., and Wang, J. 2000. Mandarin-English Information (MEI): Investigating translingual speech retrieval. Technical Report, Summer 2000 Workshop, Center for Language and Speech Processing, John's Hopkins University. http://www.clsp.jhu.edu/ws2000/final_reports/mei/ws00mei.pdf.
• 15: Anand Natrajan , Allison L. Powell , James C. French, Using N-grams to Process Hindi Queries with Transliteration Variations, University of Virginia, Charlottesville, VA, 1997
• 16: Oard, D. W. and Diekema, A. 1998. Cross-language information retrieval. Annual Review of Information Science and Technology 33, 223--256.
• 17: Douglas W. Oard , Philip Resnik, Support for interactive document selection in cross-language information retrieval, Information Processing and Management: an International Journal, v.35 n.3, p.363-379, May 1999 [doi>10.1016/S0306-4573(98)00066-1]
• 18: Ogden, W., Cowie, J., Davis, M., Ludovik, Y., Nirenburg, S., Molina-Salgado, H., and N., S. 1999. Keizai: An interactive cross-language text retrieval system. In Machine Translation Summit VII, Workshop on Machine Translation for Cross Language Information Retrieval.
• 19: Ari Pirkola, The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.55-63, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290957]
• 20: Pirkola, A., Leppnen, E., and Jrvelin, K. 2002. The RATF formula (Kwok's formula): exploiting average term frequency in cross-language retrieval. Information Research 7, 2.
• 21: Philip Resnik , Douglas Oard , Gina Levow, Improved cross-language retrieval using backoff translation, Proceedings of the first international conference on Human language technology research, p.1-3, March 18-21, 2001, San Diego [doi>10.3115/1072133.1072185]
• 22: Resnik, P., Olsen, M. B., and Diab, M. 1999. The Bible as a Parallel Corpus: Annotating the 'Book of 2000 Tongues'. Computers and the Humanities 33, 1-2, 129--153.
• 23: Karen Sparck Jones , Julia R. Galliers , J. R. Galliers, Evaluating Natural Language Processing Systems: An Analysis and Review, Springer-Verlag New York, Inc., Secaucus, NJ, 1996
• 24: Jianqiang Wang , Douglas W. Oard, iCLEF 2001 at Maryland: Comparing Term-for-Term Gloss and MT, Revised Papers from the Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language Information Retrieval Systems, p.336-354, September 03-04, 2001
• 25: Xu, J., Fraser, A., and Weischedel, R. 2001. TREC 2001 cross-lingual retrieval at BBN. In Proceeding of TREC01.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Keywords:
Cross-language information retrieval, Interactive information retrieval, Machine translation