A specialized computer architecture for text retrieval

ABSTRACT

This paper describes a specialized computer architecture for text retrieval that provides a wide range of query capabilities, without the use of indexes of the material retrieved. A distributed approach is employed, with direct search processors. Each search processor is closely associated with one or more disk drives that store the data to be searched and each consists of a comparator for matching query terms, logic elements to combine query terms, a disk controller and a control minicomputer. The key element of the architecture is the comparator, which can store over 64.000 characters of query terms and compare all of these terms simultaneously with data arriving from a disk continuously at more than one million bytes per second. Exact match, partical match, numeric comparison and context limitation are among the capabilities provided. The comparator is implemented as three similar universal finite-state automata, with special features to facilitate text retrieval and reduce hardware costs. A breadboard version of the system with one searcher is operational and has undergone detailed evaluation. A prototype system with two searchers is being implemented and will be placed into regularly scheduled use.

REFERENCES

• 1: COLTS II: CRW On-Line Text Search User's Manual. Chase, Rosen and Wallace, Inc., Alexandria, Va., 1976.
• 2: Operator's Manual for GESCAN. General Electric Company, Apollo Systems, Space Division, Daytona Beach, Florida, 1970.
• 3: Bullen, R. H., Jr. and Millen, J. K. Microtext - The Design of a Micro programmed Finite State Search Machine for Full-Text Retrieval. AFIPS Conference Proceedings, Fall Joint Computer Conference, 1972, pp. 479-488.
• 4: Kadonaga, R. S., Associative File Processor Systems and Programmer's Manual. Operating Systems, Inc., Woodland Hills, Calif., 1978.
• 5: David Gries, Compiler Construction for Digital Computers, John Wiley & Sons, Inc., New York, NY, 1971
• 6: Roberts, D.C. (ed.) A Computer System for Text Retrieval: Design Concept Development. Central Intelligence Agency, Washington, D.C., 1977, Report No. RD-77-10011.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.0 GENERAL
      Subjects: System architectures

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process; Query formulation

General Terms:
Design, Languages, Management