Comparing vector space retrieval with the RUBRIC expert system

ABSTRACT

RUBRIC is an expert system for full-text information retrieval. The underlying model for RUBRIC's information retrieval process is based upon fuzzy set theory. The RUBRIC developers have compared RUBRIC to the boolean retrieval model, which it subsumes. This study compares RUBRIC to the Vector Space Model for information retrieval, using RUBRIC's own test collection of thirty news articles from the Reuters News Service and their test search for articles which satisfy the information need to find out about "violent acts of terrorism." Results indicate that the vector space model is comparable to RUBRIC for relevant documents, while RUBRIC performs better at retrieving marginally relevant documents.

REFERENCES

• 1: D. Harman, A failure analysis of the limitation of suffixing in an online environment, Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval, p.102-107, June 03-05, 1987, New Orleans, Louisiana, United States [doi>10.1145/42005.42017]
• 2: LUHN 58 Luhn, H. P., "The Automatic Creation of Literature Abstracts," IBM Journal of Research and Development, April, 1958. reprinted in Key Papers in Information Science, American Society for Information Science, Washington, D.C., 1971.
• 3: M. E. Maron, Automatic Indexing: An Experimental Inquiry, Journal of the ACM (JACM), v.8 n.3, p.404-417, July 1961 [doi>10.1145/321075.321084]
• 4: RaWo 86 Raghavan, V. V. and S.K.M. Wong, "A Critical Analysis of Vector Space Model for Information Retrieval," Journal of the American Society for Information Science, v. 37, 5, 279--287 (1986)
• 5: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 6: R. Tong , L. Appelbaum , V. Askman , J. Cunningham, Conceptual information retrieval using RUBRIC, Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval, p.247-253, June 03-05, 1987, New Orleans, Louisiana, United States [doi>10.1145/42005.42033]
• 7: ToAp 86 Tong, Richard M., Lee A. Applebaum, Victor N. Askman, James F. Cunningham, "RUBRIC III, An Object-Oriented Expert System for Information Retrieval," Proceedings of the Second Annual International IEEE Symposium on Expert Systems in Government, McLean, VA October, 1986, pp 106--115.
• 8: Richard M. Tong , Victor N. Askman , James F. Cunningham , Carl J. Tollander, RUBRIC: an environment for full text information retrieval, Proceedings of the 8th annual international ACM SIGIR conference on Research and development in information retrieval, p.243-251, June 05-07, 1985, Montreal, Quebec, Canada [doi>10.1145/253495.253531]
• 9: ToSh 85 Tong, Richard M., Daniel G Shapiro, "Experimental Investigations of Uncertainty in a Rule-Based System for Information Retrieval International Journal of Man-Machine Studies (1985) v. 22, pp 265--282.
• 10: ToAs 84 Tong, Richard M., Victor N. Askman, James F. Cunningham "RUBRIC An Artificial Intelligence Approach to Information Retrieval, Proceedings of the First International Workshop on Expert Database Systems, Kiawah Island, South Carolina, October 1984.
• 11: ToSh 83 Tong, Richard M, Daniel G. Shapiro, Jeffrey S. Dean and Brian P. McCune, "A Comparison of Uncertainty Calculi in an Expert System for Information Retrieval, Proc. International Joint Conference on Artificial Intelligence, Karlsruhe, W. Germany, August 1983.
• 12: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 13: S. K.M. Wong , W. Ziarko , V. V. Raghavan , P. C.N. Wong, On modeling of information retrieval concepts in vector spaces, ACM Transactions on Database Systems (TODS), v.12 n.2, p.299-321, June 1987 [doi>10.1145/22952.22957]