Keyword-based document clustering

ABSTRACT

Document clustering is an aggregation of related documents to a cluster based on the similarity evaluation task between documents and the representatives of clusters. Terms and their discriminating features of terms are the clue to the clustering and the discriminating features are based on the term and document frequencies. Feature selection method on the basis of frequency statistics has a limitation to the enhancement of the clustering algorithm because it does not consider the contents of the cluster objects. In this paper, we adopt a content-based analytic approach to refine the similarity computation and propose a keyword-based clustering algorithm. Experimental results show that content-based keyword weighting outperforms frequency-based weighting method.

REFERENCES

• 1: Anderberg, M. R., "Cluster Analysis for Applications", New York: Academic, 1973.
• 2: F. Can , E. A. Ozkarahan, Dynamic cluster maintenance, Information Processing and Management: an International Journal, v.25 n.3, p.275-291, May 1989 [doi>10.1016/0306-4573(89)90045-9]
• 3: Dubes, R., and A. K. Jain, "Clustering Methodologies in Exploratory Data Analysis", Advances in Computers, Vol. 19, pp. 113--227, 1980.
• 4: Frakes, W. B. and R. Baeza-Yates, Information Retrieval, Prentice Hall, 1992.
• 5: Kang, S. S., H. G. Lee, S. H. Son, G. C. Hong, and B. J. Moon, "Term Weighting Method by Postposition and Compound Noun Recognition", Proceedings of 13th Conference on Korean Language Computing, pp. 196--198, 2001.
• 6: Murtagh, F., "Complexities of Hierarchic Clustering Algorithms: State of the Art", Computational Statistics Quarterly, Vol. 1, pp. 101--113, 1984.
• 7: Perry, S. A., and P. Willett, "A Review of the Use of Inverted Files for Best Match Searching in Information Retrieval Systems", Journal of Information Science, Vol. 6, pp. 59--66, 1983.
• 8: Sibson, R. "SLINK: an Optimally Efficient Algorithm for the Single-Link Cluster Method", Computer Journal, Vol. 16, pp. 328--342, 1973.
• 9: Willett, P., "Document Clustering Using an Inverted File Approach", Journal of Information Science, Vol. 2, pp. 223--231, 1980.
• 10: Peter Willett, Recent trends in hierarchic document clustering: a critical review, Information Processing and Management: an International Journal, v.24 n.5, p.577-597, 1988 [doi>10.1016/0306-4573(88)90027-1]

INDEX TERMS

Keywords:
document clustering, feature selection, weighting scheme