Translation of web queries using anchor text mining

ABSTRACT

This article presents an approach to automatically extracting translations of Web query terms through mining of Web anchor texts and link structures. One of the existing difficulties in cross-language information retrieval (CLIR) and Web search is the lack of appropriate translations of new terminology and proper names. The proposed approach successfully exploits the anchor-text resources and reduces the existing difficulties of query term translation. Many query terms that cannot be obtained in general-purpose translation dictionaries are, therefore, extracted.

REFERENCES

• 1: Peter F. Brown , John Cocke , Stephen A. Della Pietra , Vincent J. Della Pietra , Fredrick Jelinek , John D. Lafferty , Robert L. Mercer , Paul S. Roossin, A statistical approach to machine translation, Computational Linguistics, v.16 n.2, p.79-85, June 1990
• 2: Eric Brill, Some advances in transformation-based part of speech tagging, Proceedings of the twelfth national conference on Artificial intelligence (vol. 1), p.722-727, October 1994, Seattle, Washington, United States
• 3: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 4: Soumen Chakrabarti , Byron Dom , Prabhakar Raghavan , Sridhar Rajagopalan , David Gibson , Jon Kleinberg, Automatic resource compilation by analyzing hyperlink structure and associated text, Proceedings of the seventh international conference on World Wide Web 7, p.65-74, April 1998, Brisbane, Australia
• 5: Lee-Feng Chien, PAT-tree-based keyword extraction for Chinese information retrieval, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, p.50-58, July 27-31, 1997, Philadelphia, Pennsylvania, United States
• 6: DAGAN, I., CHURCH, K. W., AND GALE, W. A 1993. Robust bilingual word alignment for machine aided translation. In Proceedings of the Workshop on Very Large Corpora, 1-8.
• 7: DUMAIS, S. T., LANDAUER, T. K., AND LITTMAN, M. L. 1996. Automatic cross-linguistic information retrieval using latent semantic indexing. In Proceedings of SIGIR'96 Workshop on Cross-Linguistic Information Retrieval, 16-24.
• 8: FUNG, P., AND MCKEOWN, K. 1997. Finding terminology translation from non-parallel corpora. In Proceedings of the 5th Annual Workshop on Very Large Corpora. 192-202.
• 9: Pascale Fung , Lo Yuen Yee, An IR approach for translating new words from nonparallel, comparable texts, Proceedings of the 17th international conference on Computational linguistics, August 10-14, 1998, Montreal, Quebec, Canada
• 10: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, p.668-677, January 25-27, 1998, San Francisco, California, United States
• 11: KWOK, K. L. 2001. NTCIR-2 Chinese, cross language retrieval experiments using PIRCS. In Proceedings of NTCIR Workshop Meeting, 668-677.
• 12: LIU, S. H., CHEN, K. J., CHANG, L. P., AND CHIN, Y. H. 1995. Automatic part-of-speech tagging for Chinese corpora. Comput. Process. Chinese/Oriental Lang. 9, 1, 31-47.
• 13: Wen-Hsiang Lu , Lee-Feng Chien , Hsi-Jian Lee, Anchor Text Mining for Translation of Web Queries, Proceedings of the 2001 IEEE International Conference on Data Mining, p.401-408, November 29-December 02, 2001
• 14: Jian-Yun Nie , Michel Simard , Pierre Isabelle , Richard Durand, Cross-language information retrieval based on parallel texts and automatic mining of parallel texts from the Web, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.74-81, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312656]
• 15: Hsiao-Tieh Pu , Shui-Lung Chuang , Chyan Yang, Subject categorization of query terms for exploring Web users' search interests, Journal of the American Society for Information Science and Technology, v.53 n.8, p.617-630, August 2002 [doi>10.1002/asi.10071]
• 16: Reinhard Rapp, Identifying word translations in non-parallel texts, Proceedings of the 33rd annual meeting on Association for Computational Linguistics, June 26-30, 1995, Cambridge, Massachusetts [doi>10.3115/981658.981709]
• 17: Reinhard Rapp, Automatic identification of word translations from unrelated English and German corpora, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.519-526, June 20-26, 1999, College Park, Maryland [doi>10.3115/1034678.1034756]
• 18: Frank Smadja , Kathleen R. McKeown , Vasileios Hatzivassiloglou, Translating collocations for bilingual lexicons: a statistical approach, Computational Linguistics, v.22 n.1, p.1-38, March 1996
• 19: S. K. M. Wong , Y. Y. Yao, On modeling information retrieval with probabilistic inference, ACM Transactions on Information Systems (TOIS), v.13 n.1, p.38-68, Jan. 1995 [doi>10.1145/195705.195713]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Textual databases
      H.2.8 Database applications
          Subjects: Data mining
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Algorithms, Experimentation, Performance

Keywords:
anchor text mining, comparable corpora, cross-language information retrieval, machine translation, parallel corpora, web mining