Experiments on incorporating syntactic processing of user queries into a document retrieval strategy

ABSTRACT

Traditional information has relied on the extensive use of statistical parameters in the implementation of retrieval strategies. This paper sets out to investigate whether linguistic processes can be used as part of a document retrieval strategy. This is done by predefining a level of syntactic analysis of user queries only, to be used as part of the retrieval process. A large series of experiments on an experimental test collection are reported which use a parser for noun phrases as part of the retrieval strategy. The results obtained from the experiments do yield improvements in the level of retrieval effectiveness and given the crude linguistic process used and the way it was used on queries and not on document texts, suggests that the approach of using linguistic processing in retrieval, is valid.

REFERENCES

• Cat86: Cater, A.W.S., "Preference-directed Use of ATNs" in'ProceedinKs o_#f the 7th European Conference o__nn Artificial Intel!iKen__ce_, Brighton, Volume II, pp23-38, July 1986.
• Cho57: Chomsky, N. , "Syntactic Structures", Mouton, The Hague, 1957.
• DeF85: B. Defude, Different levels of expertise for an expert system in information retrieval, Proceedings of the 8th annual international ACM SIGIR conference on Research and development in information retrieval, p.147-153, June 05-07, 1985, Montreal, Quebec, Canada [doi>10.1145/253495.253520]
• DG83: Dillon, M. and Gray, A.S., "FASIT" a Fully Automatic Syntactically-Based Indexing System", Journal of the ASIS, 34(2), pp99-108, 1983
• DG85: Dillon, M. and Gray, A.S., "Improved Results Using FASIT for Associative Retrieval" Private Communication, January 1985 P
• DG86: Dario De Jaco , Gianluca Garbolino, An information retrieval system based on artificial intelligence techniques, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.214-220, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253215]
• DM83: Dillon, M. and McDonald, L.K., *'Fully Automatic Book Indexing", Journal o_#f Documentation, 39(3), pp135-154, 1983.
• Dos85: Tamas Doszkocs, Natural language processing in intelligent information retrieval, Proceedings of the 1985 ACM annual conference on The range of computing : mid-80's perspective: mid-80's perspective, p.356-359, October 1985, Denver, Colorado, United States [doi>10.1145/320435.320541]
• Fag87: Joel L Fagan, Experiments in Automatic Phrase Indexing For Document Retrieval: A Comparison of Syntactic and Non-Syntactic Methods, Cornell University, Ithaca, NY, 1987
• Fag88: Joel L. Fagan, The effectiveness of a nonsyntatic approach to automatic phrase indexing for document retrieval, Journal of the American Society for Information Science, v.40 n.2, p.115-132, March 1989 [doi>10.1002/(SICI)1097-4571(198903)40:2<115::AID-ASI6>3.0.CO;2-B]
• Fox83: Fox, E.A., "Characterisation of Two New Experimental C}ollections in Computer and Information Science Containing Textual and Bibliographic Concepts", p_#qpartment of Computer _S_qien__/c_ee. Cornell University, TR 83-561, September 1983.
• Gri84: Crishman, R. , "Natural Language Processing", Journal of the ASIS, 35, pp291-296, 198&.
• Har80: HarDer. D.J.. "Relevance Feedback in Document Retrieval Svstems" An Evaluation of Probabilistic Strategies", FhD Thesis, Jesus Colleg# Cambridge University, 1980.
• HC83: Hayes, P.J. and Carbonell, J.G., "A Tutorial on Techniques and Applications for Natural Language Processing"# Technical :Report, CMU-CS-83-158 Garne#e-Mellon University, 19 3.
• Hei82: Heidorn, G. , "The EPISTLE Text Critiquing System", IBM Systems Journal, 21(3), pp305-327, 1982.
• Jen86: Jensen, K., "Parsing Strategies in a Broad-Coverage Grammar of English", Technical Report RG12147, IBM Research Report, 1986.
• Les86: Lesk, M.E., "Information in Data" Using the Oxford E.ngli:sh Dictionary on a Computer", appearing in IRLIST, an Electronic News Digest, I(28) , 1986.
• Mar86: Claudia Marcus, Prolog programming: applications for database systems, expert systems, and natural language systems, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1986
• McC82: McGord, M., "Slots and Modifiers in Logic Grammars for Natural Language", Artificial Intelligence, 18(3), 327-367, 1982.
• MF85: Elaine Marsh , Carol Friedman, Transporting the linguistic string project system from a medical to a Navy domain, ACM Transactions on Information Systems (TOIS), v.3 n.2, p.121-140, April 1985 [doi>10.1145/3914.3984]
• PB85: Palmer, P. and Berrut, C., "Definition for a Surface Syntactical Parser for Natural Language", in Proceedings of ACSI, Montreal, 1985.
• Pet82: J. L. Peterson, Webster''s Seventh New Collegiate Dictionary: a Computer-readable File Format, University of Texas at Austin, Austin, TX, 1982
• PW80: Pereir#, F.G.N and Warren, D.H.D., "Definite Clause Grammars for Language Analysis-A Survey of the Formalism and a Comparison with Augmented Transition Networks", Artificial Intelli#ence, 13, pp231-278, 1980.
• Sag81: Naomi Sager, Natural Language Information Processing: A Computer Grammmar of English and Its Applications, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1981
• Sal85: Salton, G., "A Note on Information Retrieval Models and Theories" in RIAO 85L Acres of the Conference" Recherche d'Information Assistee par Ordinateur, Grenoble, ppl-27, IMAG, 1985.
• Sal86: Gerard Salton, Recent trends in automatic information retrieval, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.1-10, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253171]
• SD80: Silva, G. and Dwiggens, D. , "Towards a PROLOG Text Grammar", ACM SIGART Newsletter, 73, pp20-25, 1980.
• Sme86: Alan F. Smeaton, Incorporating syntactic information into a document retrieval strategy: an investigation, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.103-113, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253193]
• Sme88: Smeaton, A.F., "Using Parsing of Natural Language as Part of Document Retrieval", Department of Computing Science, Glasgow University, Technical Report, (in press), 1988.
• Thu86: G. Thurmair, A common architecture for different text processing techniques in an information retrieval environment, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.138-143, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253198]
• WA80: Wilensky, R. and Arens, Y., "PHRAN" A Knowledge-Based Approach to Natural Language Analysis", Technical Report Memo UCB/ERL/MSO/34, University o_#f California, 1980.
• Wal84: Mark Wallace, Communicating with databases in natural language, John Wiley & Sons, Inc., New York, NY, 1984
• Win83: Terry Winograd, Language As a Cognitive Process: Syntax, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1982
• WP82: David H. D. Warren , Fernando C. N. Pereira, An efficient easily adaptable system for interpreting natural language queries, Computational Linguistics, v.8 n.3-4, p.110-122, July-December 1982

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Design, Experimentation, Languages