Retrieval activities in a database consisting of heterogeneous collections of structured text

ABSTRACT

The first part of this paper briefly describes a mathematical framework (called the containment model) that provides the operations and data structures for a text dominated database with a hierarchical structure. The database is considered to be a hierarchical collection of continuous extents each extent being a word, word phrase, text element or non-text element. The filter operations making up a search command are expressed in terms of containment criteria that specify whether a contiguous extent will be selected or rejected during a search. This formalism, comprised of the mathematical framework and its associated language, defines a conceptual layer upon which we can construct a well-defined higher level layer, specifically the user interface that serves to provide a level of functionality that is closer to the needs of the user and the application domain. With the conceptual layer established, we go on to describe the design and implementation of a versatile interface which handles queries that search and navigate a heterogeneous collection of structured documents. Interface functionality is provided by a set of “worker” modules supported by an “environment” that is the same for all interfaces. The interface environment allows a worker to communicate with the underlying text retrieval engine using a well-defined command protocol that is based on a small set of filter operators. The overall design emphasizes: a) interface flexibility for a variety of search and browsing capabilities, b) the modular independence of the interface with respect to its underlying retrieval engine, and c) the advantages to be accrued by defining retrieval commands using operators that are part of a text algebra that provides a sound theoretical foundation for the database.

REFERENCES

• 1: Peter G. Anick , Rex A. Flynn , David R. Hanssen, Addressing the requirements of a dynamic corporate textual information base, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.163-172, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122876]
• 2: ATA/AIA Subcommittee 89-9C (1990, June). CD-ROM lnterchangeability Standard - SFQL: Structured Full-Text Query Language, ATA Draft Standard 89-9C.SFQL2-R1-1990, version 2.0.
• 3: Forbes J. Burkowski, An algebra for hierarchically organized text-dominated databases, Information Processing and Management: an International Journal, v.28 n.3, p.333-348, 1992 [doi>10.1016/0306-4573(92)90079-F]
• 4: Cooper, W. S. (1983). Exploiting the maximum entropy principle to increase retrieval effectiveness. Journal of the American Society for Information Science, 34(1), 31-39.
• 5: W. B. Croft , R. Das, Experiments with query acquisition and use in document retrieval systems, Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval, p.349-368, September 05-07, 1990, Brussels, Belgium [doi>10.1145/96749.98240]
• 6: C. J. Date , Andrew Warden, Relational database writings (1985–1989), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• 7: Joel L Fagan, Experiments in Automatic Phrase Indexing For Document Retrieval: A Comparison of Syntactic and Non-Syntactic Methods, Cornell University, Ithaca, NY, 1987
• 8: Gaston H. Gonnet , Frank Wm. Tompa, Mind Your Grammar: a New Approach to Modelling Text, Proceedings of the 13th International Conference on Very Large Data Bases, p.339-346, September 01-04, 1987
• 9: Gonnet, G. H. (1987). Examples of PAT applied to the Oxford English Dictionary. Centre for the New Oxford English Dictionary, Univ. of Waterloo.
• 10: M. Gyssens , J. Paredaens , D. van Gucht, A grammar-based approach towards unifying hierarchical data models, Proceedings of the 1989 ACM SIGMOD international conference on Management of data, p.263-272, June 1989, Portland, Oregon, United States
• 11: Harman, D. & Candela, G. (1990). Retrieving records from a gigabyte of text on a minicomputer using statistical ranking. Journal of the American Society for Information Science, 41(8), 581-589.
• 12: G. Zinßmeister, EXPRESS: an experimental interface for factual information retrieval, Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval, p.63-81, September 05-07, 1990, Brussels, Belgium [doi>10.1145/96749.98009]
• 13: International Standards Organization (1986, October). Information Processing - Text and office systems - Standard Generalized Markup Language (SGML), (ISO 8879), Geneva: ISO.
• 14: International Standards Organization (1988, March). Information Processing - Text and office systems - Office Document Architecture (ODA) and Interchange Format, Part 1: introduction and general principles, (ISO 8613-1), Geneva: ISO.
• 15: G. McAlpine , P. Ingwersen, Integrated information retrieval in a knowledge worker support system, Proceedings of the 12th annual international ACM SIGIR conference on Research and development in information retrieval, p.48-57, June 25-28, 1989, Cambridge, Massachusetts, United States
• 16: Carlo Meghini , Fausto Rabitti , Costantino Thanos, Conceptual Modeling of Multimedia Documents, Computer, v.24 n.10, p.23-30, October 1991 [doi>10.1109/2.97248]
• 17: National Information Standards Organizat, Information Retrieval Service: Information Retrieval Service Definition and Protocol Specification for Library Applications, Transaction Publishers, 1989
• 18: Lisa F. Rau , Paul S. Jacobs, Creating segmented databases from free text for text retrieval, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.337-346, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122894]
• 19: Raymond, D. R. (1991). Reading source code. Technical Report TR 74.070, Centre for Advanced Studies, IBM Canada Ltd., Dept. 81/894, 895 Don Mills Road, North York, Ontario, M3C 1W3, Canada.
• 20: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 21: R. Sacks-Davis , P. Wallis , R. Wilkinson, Using syntactic analysis in a document retrieval system that uses signature files, Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval, p.179-192, September 05-07, 1990, Brussels, Belgium [doi>10.1145/96749.98219]
• 22: Gerard Salton , Chris Buckley, An Evaluation of Text Matching Systems for Text Excerpts of Varying Scope, Cornell University, Ithaca, NY, 1990
• 23: Gerard Salton , Chris Buckley, Automatic text structuring and retrieval-experiments in automatic encyclopedia searching, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.21-30, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122863]
• 24: Jean Tague , Airi Salminen , Charles McClellan, Complete formal model for information retrieval systems, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.14-20, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122862]
• 25: R. H. Thompson , W. B. Croft, Support for browsing in an intelligent text retrieval system, International Journal of Man-Machine Studies, v.30 n.6, p.639-668, June 1989
• 26: Edgar B. Wendlandt , James R. Driscoll, Incorporating a semantic analysis into a document retrieval strategy, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.270-279, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122888]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Algorithms, Design, Languages