A common architecture for different text processing techniques in an information retrieval environment

ABSTRACT

The following paper gives an overview on a text processing software called REALIST (Retrieval Aids by Linguistics and Statistics) which integrates different text processing techniques into a common surface. It supports the user by offering the environment of a given term, using morphological, syntactic and statistic means. The user can call up the processing results, use it for indexing, classification or retrieval purposes and combine them as he wishes e.g. to set up a search logic. The text processing is done on a main frame computer, the results are transferred to a minicomputer where the evaluation is performed. REALIST is a stand alone package, fitting any existing search systems. In the retrieval context, this technique reduces connecting time and improves the search results. REALIST is able to run on English and German texts. Each REALIST component has been separately tested with good success. An integrated version is currently under test at the US Patent ad Trademark Office using 150000 English patent abstracts, and a German version is being tested with 12000 legal texts of the European Community.

REFERENCES

• 1: MEY83 M.Meya: Treatment of Suffixes in Automatic Morphological Analysis. In: Linguistlea Ccmputazionale IIl, 1983, Supplement: L.Cignonl, C. Peters, Hsg. : Computers in Literary and Linguistic Research. (Proc. VII ALLC Symposlon, Pisa), S. 199-206
• 2: MEY83 M.Meya: Anallsis morfologico automatico del espagnol. ' in: Procesamlento del Lenguaje, Boletin 1 # 1983, San Sebastian Fac. Infor#matica, 18-23
• 3: G. Th. Niedermair , G. Thurmair , I. Büttel, MARS: a retrieval tool on the basis of morphological analysis, Proceedings of the 7th annual international ACM SIGIR conference on Research and development in information retrieval, p.369-381, July 02-06, 1984, Cambridge, England
• 4: SWAB4 Ch.Sehwarz: Linguistisohe Hilfsmlttel beim Information Retrieval. in: Nachriehten for Dokumentatlon 35, 1984, S.179-182
• 5: Christoph Schwarz, Textrecherche mit Mehrwortbegriffen, Sprachverarbeitung in Information und Dokumentation, Jahrestagung der Gesellschaft für Linguistische Datenverarbeitung (GLDV) in Kooperation mit der Fachgruppe 3 "Natürlichsprachliche Systeme" im FA 1.2 der Gesellschaft für Informatik (GI), p.216-225, March 05-07, 1985
• 6: SWA86, THU86 Ch.Schwarz, G.Thurmair,eds. : infor# mationslingulstlsche Texterschlle#mg. to appear Hildesheim 1986
• 7: THUS3 G.Thurmalr: An Integrated Algorithm for morphological Decomposltion. In: Linguistica Computazionale III, 1983, Supplement: L. Cignonl, C. Peters, Hsg. = Computers in Literary and Linguistic Research. (Proe. VII A# Symposion, Pisa), S. 269-277
• 8: THU84 G. Thurmalr: Linguistic Problems in multilingual morphological decomposition. In: Proc. of the 10th lnternational COLING Conference, Stanford 1984, S.174-77
• 9: WE384 A.Wessel: aetrievalunberst#tzung durch Ausdehnungsrelationen (ProJekt InformationsbrOcke). Frankfurt 1984
• 10: Andrew E. Wessel, Progress report on project information bridge, Proceedings of the 6th annual international ACM SIGIR conference on Research and development in information retrieval, June 06-08, 1983, Bethesda, Maryland