Geometric and quantum methods for information retrieval

ABSTRACT

This paper reviews the recent developments in applying geometric and quantum mechanics methods for information retrieval and natural language processing. It discusses the interesting analogies between components of information retrieval and quantum mechanics. It then describes some quantum mechanics phenomena found in the conventional data analysis and in the psychological experiments for word association. It also presents the applications of the concepts and methods in quantum mechanics such as quantum logic and tensor product to document retrieval and meaning of composite words, respectively. The purpose of the paper is to give the state of the art on and to draw attention of the IR community to the geometric and quantum methods and their potential applications in IR and NLP.

REFERENCES

• 1: Soumen Chakrabarti, Mining the Web: Discovering Knowledge from HyperText Data, Science & Technology Books, 2002
• 2: S. Clark, B. Coecke, and M. Sadrzadeh. A compositional distributional model of meaning. In Proceedings of the Second Quantum Interaction Symposium (QI-2008). College Publications, 2008.
• 3: S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41:391--407, 1990.
• 4: Dieter Fensel , Frank van Harmelen , Bo Andersson , Paul Brennan , Hamish Cunningham , Emanuele Della Valle , Florian Fischer , Zhisheng Huang , Atanas Kiryakov , Tony Kyung-il Lee , Lael Schooler , Volker Tresp , Stefan Wesner , Michael Witbrock , Ning Zhong, Towards LarKC: A Platform for Web-Scale Reasoning, Proceedings of the 2008 IEEE International Conference on Semantic Computing, p.524-529, August 04-07, 2008 [doi>10.1109/ICSC.2008.41]
• 5: A. F. Huertas-Rosero, L. A. Azzopardi, and K. van Rijsbergen. Characterising through erasing. In Proceedings of the Second Quantum Interaction Symposium (QI-2008). College Publications, 2008.
• 6: J. Karlgren and M. Sahlgren. From words to understanding. In Y. Uesaka, P. Kanerva, and H. Asoh, editors, Foundations of Real-World Intelligence, pages 294--308. Stanford: CSLI Publications, 2001.
• 7: M. Melucci. Towards modeling implicit feedback with quantum entanglement. In Proceedings of the Second Quantum Interaction Symposium (QI-2008). College Publications, 2008.
• 8: D. Nelson and C. McEvoy. Entangled Associative Structures and Context. In Proceedings of the AAAI Spring Symposium on Quantum Interaction. AAAI Press, 2007.
• 9: D. Pavlovic. On quantum statistics in data analysis. In Proceedings of the Second Quantum Interaction Symposium (QI-2008). College Publications, 2008.
• 10: C. J. van Rijsbergen, The Geometry of Information Retrieval, Cambridge University Press, New York, NY, 2004
• 11: Dominic Widdows, Orthogonal negation in vector spaces for modelling word-meanings and document retrieval, Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, p.136-143, July 07-12, 2003, Sapporo, Japan [doi>10.3115/1075096.1075114]
• 12: Dominic Widdows, Geometry and Meaning, Center for the Study of Language and Information/SRI, 2004
• 13: D. Widdows. Semantic vector products: Some initial investigations. In Proceedings of the Second Quantum Interaction Symposium (QI-2008). College Publications, 2008.
• 14: D. Widdows and P. Bruza. Quantum information dynamics and open world science. In Proceedings of the First Quantum Interaction Symposium (QI-2007). AAAI Press, 2007.
• 15: D. Widdows and S. Peters. Word vectors and quantum logic: Experiments with negation and disjunction. In Eighth Mathematics of Language Conference, pages 141--154, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  F. Theory of Computation
  F.1 COMPUTATION BY ABSTRACT DEVICES
      F.1.2 Modes of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems
          Subjects: Geometrical problems and computations

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing

General Terms:
Algorithms, Design, Theory