Generalized vector spaces model in information retrieval

ABSTRACT

In information retrieval, it is common to model index terms and documents as vectors in a suitably defined vector space. The main difficulty with this approach is that the explicit representation of term vectors is not known a priori. For this reason, the vector space model adopted by Salton for the SMART system treats the terms as a set of orthogonal vectors. In such a model it is often necessary to adopt a separate, corrective procedure to take into account the correlations between terms. In this paper, we propose a systematic method (the generalized vector space model) to compute term correlations directly from automatic indexing scheme. We also demonstrate how such correlations can be included with minimal modification in the existing vector based information retrieval systems. The preliminary experimental results obtained from the new model are very encouraging.

REFERENCES

• 1: G. Salton, The SMART Retrieval System—Experiments in Automatic Document Processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1971
• 2: Gerard Salton, Dynamic information and library processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1975
• 3: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 4: Vijay V. Raghavan , C. T. Yu, Experiments on the determination of the relationships between terms, ACM Transactions on Database Systems (TODS), v.4 n.2, p.240-260, June 1979 [doi>10.1145/320071.320081]
• 5: Van Rijsbergen, C.j., A Theoretical Basis for the Use of Co-occurrence Data in Information Retrieval Journal of Documentation. vol 33, (1977). pp. 106- 119.
• 6: Harper, D.J. and Van Rijsbergen, C.J., An Evaluation of Feedback in Document Retrieval using Co-occurrence Data. Journal of Documentation. vol 34, (1978). pp. 189 - 216.
• 7: G. Salton , C. Buckley , C. T. Yu, An evaluation of term dependence models in information retrieval, Proceedings of the 5th annual ACM conference on Research and development in information retrieval, p.151-173, May 18-20, 1982, West Berlin, Germany
• 8: Katter, R.V. A study of Document Representations: Multidimension Scaling of Index Terms. SDC - Final Report, (1967).
• 9: Switzer, P., Vector Images in Information Retrieval Proceedings of the Symposium on Statistical Association Methods for Mechanical Documentation, Wash. D.C., 1964. (NBS Misa PubL 269, 1965) Stevens, MS..., Heilprin, L, Guiliano, V.E. (eds.). pp. 163 - 171.
• 10: Matthew B. Koll, WEIRD: an approach to concept-based information retrieval, ACM SIGIR Forum, v.13 n.4, Spring 1979 [doi>10.1145/1095366.1095368]
• 11: S. K. M. Wong , Vijay V. Raghavan, Vector space model of information retrieval: a reevaluation, Proceedings of the 7th annual international ACM SIGIR conference on Research and development in information retrieval, p.167-185, July 02-06, 1984, Cambridge, England