Automatic phrase indexing for document retrieval

ABSTRACT

An automatic phrase indexing method based on the term discrimination model is described, and the results of retrieval experiments on five document collections are presented. Problems related to this non-syntactic phrase construction method are discussed, and some possible solutions are proposed that make use of information about the syntactic structure of document and query texts.

REFERENCES

• 1: Olorunfemi Stephen Aladesulu, Improvement of automatic indexing through recognition of semantically equivalent syntactically different phrases, 1985
• 2: Baxendale, P. B. 1958. Machine-Made Index for Technical Literature - An Experiment. IBM Journal of Research and Development 2:354-361.
• 3: Baxendale, P. B. 1961. An Empirical Model for Machine Indexing. In: Machine Indezing; Pro#ress and Probleme. Third Institute for Information Storage and Retrieval, February 13-17, 1961. Center for Technology and Administration, School of Government and Public Administration, The American University, Washington, D.C.: 207-218.
• 4: Chris Buckley, Implementation of the SMART Information Retrieval System, Cornell University, Ithaca, NY, 1985
• 5: Croft, B. W. 1986. Boolean Queries and Term Dependencies in Probabilistic Retrieval Models. Journal of the American Society for Information Science 37(2):71-77.
• 6: Dillon, M. and A. S. Gray. 1983. FASIT: A Fully Automatic Syntactically Baaed Indexing System. Journal of the American Societp for Information Science 34(2):99-108.
• 7: Lauren B. Doyle, Semantic Road Maps for Literature Searchers, Journal of the ACM (JACM), v.8 n.4, p.553-578, Oct. 1961 [doi>10.1145/321088.321095]
• 8: Doyle, L. 13. 1962. Indexing and Abstracting by Association. American Documentation 13(4):378-390.
• 9: Earl, L.L. 1970. Experiments in Automatic Indexing and Extracting. Information Storage and Retrieval 6:313-334.
• 10: Earl, L. L. 1972. The Resolution of Syntactic Ambiguity in Automatic Language Processing. Information Storage and Retrieval 8(6):277-308.
• 11: Fagan, J.L. 1985. Using PLNLP for Content Analysis in Information Retrieval. Paper presented at the Symposium on PLNLP: The Programming Language for Natural Language Processing at the Annual Meeting of the Linguistic Society of America, Seattle, Washington, December 27-30, 1985.
• 12: Joel L. Fagan, The effectiveness of a nonsyntatic approach to automatic phrase indexing for document retrieval, Journal of the American Society for Information Science, v.40 n.2, p.115-132, March 1989 [doi>10.1002/(SICI)1097-4571(198903)40:2<115::AID-ASI6>3.0.CO;2-B]
• 13: Fox, E. A. 1983a. Characterization of Two New Experimental Collections in Computer and information Science Containing Textual and Bibliographic Concepts. Technical Report TR83-561, Department of Computer Science, Cornell University, Ithaca, New York.
• 14: Edward Alan Fox, Extending the boolean and vector space models of information retrieval with p-norm queries and multiple concept types, 1983
• 15: Giuliano, V. E. and P. E. Jones. 1963. Linear Associative Information Retrieval. In: Paul W. Howerton and David C. Weeks, Vistae in Information Handling, Volume 1: The Augmentation of Man's Intellect by Machine. Spartan Books, Washington, D.C.: 30-54.
• 16: Harper, D. J. and C. J. van Rijsbergen. 1978. An Evaluation of Feedback in Document Retrieval Using Cooecurrence Data. Journal of Documentation 34(3):189-208.
• 17: Heidorn, G. E. 1972. Natural Language Inputs to a Simulation Programming System. Technical Report NPS-55HD72101A, Naval Postgraduate School, Monterey, California.
• 18: George E. Heidorn, Augmented phrase structure grammars, Proceedings of the 1975 workshop on Theoretical issues in natural language processing, June 10-13, 1975, Cambridge, Massachusetts [doi>10.3115/980190.980197]
• 19: Hillman, D. J. 1973. Customized User Services via Interactions with LEADERMART. Information Storage and Retrieval 9:587-596.
• 20: Hillman, D. J. and A. J. Kasarda. 1969. The LEADER Retrieval System. AFIPSProceedings 34:447-455.
• 21: Jensen, K. 1986. PEG 1986: A Broad-Coverage Computational Syntax of English. Research Report, IBM Thomas J. Watson Research Center, Yorktown Heights, New York.
• 22: Klingbiel, P. H. 1973a. Machine-Aided Indexing of Technical Literature. Information Storage and Retrieval 9(2):79-84.
• 23: Klingbiel, P. H. 1973b. A Technique for Machine-Aided Indexing. Information Storage and Retrieval 9(9):477-494.
• 24: Lesk, M.E. 1969. Word-Word Associations in Document Retrieval Systems. American Documentation 20(1):27-38.
• 25: D. P. Metzler , T. Noreault , L. Richey , B. Heidorn, Dependency parsing for information retrieval, Proc. of the third joint BCS and ACM symposium on Research and development in information retrieval, p.313-324, November 1984, King's College, Cambridge
• 26: Salton, G. 1966. Automatic Phrase Matching. in: D. G. Hays, Readings in Automatic Language Processing. American Elsevier Publishing Co., Inc., New York: 169-188.
• 27: Gerard. Salton, Automatic Information Organization and Retrieval., McGraw Hill Text, 1968
• 28: Gerard Salton, Another look at automatic text-retrieval systems, Communications of the ACM, v.29 n.7, p.648-656, July 1986 [doi>10.1145/6138.6149]
• 29: G. Salton , C. Buckley , C. T. Yu, An evaluation of term dependence models in information retrieval, Proceedings of the 5th annual ACM conference on Research and development in information retrieval, p.151-173, May 18-20, 1982, West Berlin, Germany
• 30: Salton, G. and M. E. Lesk. 1971. Computer Evaluation of Indexing and Text Processing. In: Gerard Salton, The SMART Retrieval System -- Experiments in Automatic Document Processing. Prentice-Hall, Inc., Englewood Cliffs, New Jersey: 143- 180.
• 31: Salton, G. and C. S. Yang. 1973. On the Specification of Term Values in Automatic Indexing. Journal of Documentation 29(4):351-372.
• 32: Salton, G., C. S. Yang, and C. T. Yu. 1975. A Theory of Term Importance in Automatic Text Analysis. Journal of the American Society for Information Science 26(1):33-44.
• 33: Alan F. Smeaton, Incorporating syntactic information into a document retrieval strategy: an investigation, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.103-113, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253193]
• 34: Sparck Jones, K. 1972. A Statistical Interpretation of Term Specificity and Its Application to Retrieval. Journal of Documentation 28:11-20.
• 35: Sparck Jones, K. 1974. Automatic Indexing. Journal of Documentation 30(4):393-432.
• 36: H. Edmund Stiles, The Association Factor in Information Retrieval, Journal of the ACM (JACM), v.8 n.2, p.271-279, April 1961 [doi>10.1145/321062.321074]
• 37: van Rijsbergen, C. J. 1977. A Theoretical Basis for the Use of Cooecurrence Data in Retrieval. Journal of Documentation 33:106-119.
• 38: C. T. Yu , Chris Buckley , K. Lam , Gerard Salton, A Generalized Term Dependence Model in Information Retrieval, Cornell University, Ithaca, NY, 1983

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Documentation, Performance