Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

This paper proposes a query structuring method by analyzing Japanese natural language sentences that users input. We use linguistic structure information obtained by morphological analysis and dependency parsing on the natural language inputs. Our proposed method converts a sentence into a structured query on the basis of linguistic structures such as phrases and modification relations. Such structured queries enable effective retrieval with reasonable efficiency. To evaluate our proposed method, we compare it with the method using no structures at all, using a 100-gibabyte web collection mostly written in Japanese. We demonstrate through the experiments that mean average precision was improved about 8.6% using our query structuring method alone, and about 22.5% by combining our query structuring method with pseudo-relevance feedback.

REFERENCES

• 1: Fernando Diaz , Donald Metzler, Improving the estimation of relevance models using large external corpora, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148200]
• 2: K. Eguchi and W. B. Croft. Query structuring with two-stage term dependence in the Japanese language. In Information Retrieval Technology: Third Asia Information Retrieval Symposium, volume 4182 of Lecture Notes in Computer Science, pages 522--529. Springer, 2006.
• 3: K. Eguchi, K. Oyama, E. Ishida, N. Kando, and K. Kuriyama. Overview of the Web Retrieval Task at the Third NTCIR Workshop. In Proceedings of the 3rd NTCIR Workshop on Research in Information Retrieval, Automatic Text Summarization and Question Answering, Tokyo, Japan, 2003.
• 4: Djoerd Hiemstra, A Linguistically Motivated Probabilistic Model of Information Retrieval, Proceedings of the Second European Conference on Research and Advanced Technology for Digital Libraries, p.569-584, September 21-23, 1998
• 5: Taku Kudo , Yuji Matsumoto, Japanese dependency analysis using cascaded chunking, proceedings of the 6th conference on Natural language learning, p.1-7, August 31, 2002 [doi>10.3115/1118853.1118869]
• 6: Victor Lavrenko , W. Bruce Croft, Relevance based language models, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.120-127, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383972]
• 7: Christopher D. Manning , Prabhakar Raghavan , Hinrich Schtze, Introduction to Information Retrieval, Cambridge University Press, New York, NY, 2008
• 8: Donald Metzler , W. Bruce Croft, Combining the language model and inference network approaches to retrieval, Information Processing and Management: an International Journal, v.40 n.5, p.735-750, September 2004 [doi>10.1016/j.ipm.2004.05.001]
• 9: Donald Metzler , W. Bruce Croft, A Markov random field model for term dependencies, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076115]
• 10: Donald Metzler , W. Bruce Croft, Latent concept expansion using markov random fields, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277796]
• 11: D. Metzler, T. Strohman, H. Turtle, and W. B. Croft. Indri at TREC 2004: Terabyte Track. In Proceedings of the 13th Text Retrieval Conference (TREC 2004). NIST Special Publication 500-261, 2004.
• 12: Jay M. Ponte , W. Bruce Croft, A language modeling approach to information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.275-281, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291008]
• 13: Fei Song , W. Bruce Croft, A general language model for information retrieval, Proceedings of the eighth international conference on Information and knowledge management, p.316-321, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319950.320022]
• 14: Chengxiang Zhai , John Lafferty, Model-based feedback in the language modeling approach to information retrieval, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502654]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

General Terms:
Experimentation

Keywords:
Japanese information retrieval, structured quries, term dependence, web retrieval