Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Latent Semantic Indexing (LSI) is a technique for representing documents, queries, and terms as vectors in a multidimensional real-valued space. The representtions are approximations to the original term space encoding, and are found using the matrix technique of Singular Value Decomposition. In comparison Multidimensional Scaling (MDS) is a class of data analysis techniques for representing data points as points in a multidimensional real-valued space. The objects are represented so that inter-point similarities in the space match inter-object similarity information provided by the researcher. We illustrate how the document representations given by LSI are equivalent to the optimal representations found when solving a particular MDS problem in which the given inter-object similarity information is provided by the inner product similarities between the documents themselves. We further analyze a more general MDS problem in which the interdocument similarity information, although still in inner product form is arbitrary with respect to the vector space encoding of the documents.

REFERENCES

• 1: I. Borg, Multidimensional similarity structure analysis, Springer-Verlag New York, Inc., New York, NY, 1987
• 2: Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, and Richard Harshman. Indexing by latent semantic analysis. Journal of the A merzcau Society for inform alion Sczence, 41(6):391-407, 1990.
• 3: Susan T. Dumais. Enhancing performance in latent semantic indexing (LSI) retrieval. Technical Report Technical Memorandum, Bellcore, September 1990.
• 4: james E. Everett and Antony Pecotich. A combined loglinear/MDS model for mapping journals by citation analysis. Journal of the American Soczely for Information Sczence, 42(6):405-413, 1991.
• 5: G. W. Furnas , T. K. Landauer , L. M. Gomez , S. T. Dumais, The vocabulary problem in human-system communication, Communications of the ACM, v.30 n.11, p.964-971, Nov. 1987 [doi>10.1145/32206.32212]
• 6: Michael J. Greenacre and Leslie G. Underhill. Scaling a data matrix in a low-dimensional euclidean space. In Douglas M. Hawkins, editor, Top~cs zn Apphed Mullzvarzate Analyszs, pages 183-268. Cambridge University Press, 1982.
• 7: J. B. Kruskal. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrtka, 29(1):i-27, March 1964.
• 8: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 9: Gilbert W. Stewart. Introduction to Matrix Computations. Academic Press, 1973.
• 10: W. S. Torgerson. Theory and Methods of Scahng. New York: John Wiley, 1958.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Languages