A dynamic cluster maintenance system for information retrieval

ABSTRACT

Partitioning by clustering of very large databases is a necessity to reduce the space/time complexity of retrieval operations. However, the contemporary and modern retrieval environments demand dynamic maintenance of clusters. A new cluster maintenance strategy is proposed and its similarity/stability characteristics, cost analysis, and retrieval behavior in comparison with unclustered and completely reclustered database environments have been examined by means of a series of experiments.

REFERENCES

• 1: Anderberg, M.R. Cluster Analysis for Applications. New York: Academic Press; 1973.
• 2: Fazli Can , Esen A. Ozkarahan, A clustering scheme, Proceedings of the 6th annual international ACM SIGIR conference on Research and development in information retrieval, June 06-08, 1983, Bethesda, Maryland
• 3: Can, F., 0zkarahan, E.A. Two Partitioning ~e C2ustering Algorithms. Journal of the erican Society for Information Science. Vol.35, No.5, pp.268-276; 1984.
• 4: Can, F. A New CZustering Scheme for Infovma: tion Retrieval Systems Incorporating the Support of a Database Machine. Ph.D. dissertation, Department of Computer Engineering, Middle East Technical University; Ankara, January 1985.
• 5: Fazli Can , Esen A. Ozkarahan, Concepts of the cover coefficient-based clustering methodology, Proceedings of the 8th annual international ACM SIGIR conference on Research and development in information retrieval, p.204-211, June 05-07, 1985, Montreal, Quebec, Canada [doi>10.1145/253495.253526]
• 6: Crouch, D.B., A File Organization and Maintenance Procedure for Dynamic Document Collec tions. Ii~orlTlIation Processing and Management. Vol. 11, pp. 11-21; 1975.
• 7: J. S. Deogun , V. V. Raghavan, User-oriented document clustering: a framework for learning in information retrieval, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.157-163, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253202]
• 8: Kutluay, S. Validity Analysis of the Cover Coefficient Concept on 52ustering. Msc Thesis, Dept. of Electrical and Electronic Eng., Middle East Technical University; Ankara, 1986.
• 9: Milligan, G.W., Soon, S.C., Sokol, L.M. The Effect of Cluster Size, D~mensionality, and Number of ~2usters on Recovery of True Cluster Structure. ~ Transactions on Pattern Analysis and Machine Intelligence. Vol.-PAMI-5 No. 1; 1983.
• 10: Esen A. Ozkarahan , Fazli Can, An integrated fact/document information system for office automation, Information Technology Research Development Applications, v.3 n.3, p.142-156, Aug. 1984
• 11: Esen Ozkarahan, Database machines and database management, Prentice-Hall, Inc., Upper Saddle River, NJ, 1986
• 12: Esen Ozkarahan , Fazli Can, An automatic and tunable document indexing system, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.234-243, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253218]
• 13: Gerard Salton, Dynamic information and library processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1975
• 14: G. Salton , A. Wong, Generation and search of clustered files, ACM Transactions on Database Systems (TODS), v.3 n.4, p.321-346, Dec. 1978 [doi>10.1145/320289.320291]
• 15: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 16: Ural, M.H. Performanze Evaluation of the Cover Coefficient Based ~2ustering and C~uster Maintenance Methodology in Information Retrieval. Msc Thesis, Dept. of Electrical and Electronic Eng., Middle East Technical University; Ankara, 1986.
• 17: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Algorithms, Experimentation, Performance