A cluster-based approach to thesaurus construction

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

A cluster-based approach to thesaurus construction

Full text

Pdf (958 KB)

Source

Annual ACM Conference on Research and Development in Information Retrieval archive
Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval table of contents

Grenoble, France

Pages: 309 - 320

Year of Publication: 1988

ISBN:2-7061-0309-4

Author

C. J. Crouch

Department of Computer Science, Tulane University, New Orleans, LA

Sponsor

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 10, Downloads (12 Months): 60, Citation Count: 17

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/62437.62467 What is a DOI?

ABSTRACT

The importance of a thesaurus in the successful operation of an information retrieval system is well recognized. Yet techniques which support the automatic generation of thesauri remain largely undiscovered. This paper describes one approach to the automatic generation of global thesauri, based on the discrimination value model of Salton, Yang, and Yu and on an appropriate clustering algorithm. This method has been implemented and applied to two document collections. Preliminary results indicate that this method, which produces improvements in retrieval performance in excess of 10 and 15 percent in the test collections, is viable and worthy of continued investigation.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	ATTAR77	R. Attar , A. S. Fraenkel, Local Feedback in Full-Text Retrieval Systems, Journal of the ACM (JACM), v.24 n.3, p.397-417, July 1977 [doi>10.1145/322017.322021]
	BUCKLEY85	Chris Buckley, Implementation of the SMART Information Retrieval System, Cornell University, Ithaca, NY, 1985
	CRAWFORD75	Crawford, R., The Computation of Discrimination Values, Information mroces,.#ing and Management, 11 "249-253, 1975.
	CROUCH88	Carolyn J. Crouch, An analysis of approximate versus exact discrimination values, Information Processing and Management: an International Journal, v.24 n.1, p.5-16, January 1988 [doi>10.1016/0306-4573(88)90072-6]
	FOX83a	Edward Alan Fox, Extending the boolean and vector space models of information retrieval with p-norm queries and multiple concept types, 1983
	FOX83b	Fox, E., Characteri,#tics of Two New Experimental Collections in Computer and Informatio# Science Containing Textual and Bibliographic Concepts, Tech. Report 83-561, Dept. of Computer Science, Cornelt University, Sept. 1983.
	SALTON75a	Salton, G., C.S. Yang, and C.T. Yu, A Theory of Term Importance in Automatic Text Analysis, Journal of the ASIS , 26(1):33-44, 1975.
	SALTON75b	G. Salton , A. Wong , C. S. Yang, A vector space model for automatic indexing, Communications of the ACM, v.18 n.11, p.613-620, Nov. 1975 [doi>10.1145/361219.361220]
	SALTON76	Salton, G., and A. Wong, On the Role of Words and Phrases in Automatic Text Analysis, Computers and Humanities, 10:69-87, 1976.
	SALTON87	Gerard Salton , Chris Buckley, Term Weighting Approaches in Automatic Text Retrieval, Cornell University, Ithaca, NY, 1987
	VANRIJSB79	C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
	VOORHEES85	Ellen M. Voorhees, The Effectiveness and Efficiency of Agglomerative Hierarchic Clustering in Document Retrieval, Cornell University, Ithaca, NY, 1985
	VOORHEES86	Ellen M. Voorhees, Implementing Agglomerative Hierarchic Clustering Algorithms for Use in Document Retrieval, Cornell University, Ithaca, NY, 1986
	WILLET85	Peter Willett, An algorithm for the calculation of exact term discrimination values, Information Processing and Management: an International Journal, v.21 n.3, p.225-232, 1985 [doi>10.1016/0306-4573(85)90107-4]

CITED BY 17

	David D. Lewis, An evaluation of phrasal and clustered representations on a text categorization task, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.37-50, June 21-24, 1992, Copenhagen, Denmark
	D. D. Lewis , W. B. Croft, Term clustering of syntactic phrases, Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval, p.385-404, September 05-07, 1990, Brussels, Belgium
	Tomek Strzalkowski , Jose Perez-Carballo , Mihnea Marinescu, Natural language information retrieval in digital libraries, Proceedings of the first ACM international conference on Digital libraries, p.117-125, March 20-23, 1996, Bethesda, Maryland, United States
	P. Efraimidis , C. Glymidakis , B. Mamalis , P. Spirakis , B. Tampakas, Parallel text retrieval on a high performance supercomputer using the Vector Space Model, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.58-66, July 09-13, 1995, Seattle, Washington, United States
	Susan Gauch , John B. Smith, Search improvement via automatic query reformulation, ACM Transactions on Information Systems (TOIS), v.9 n.3, p.249-280, July 1991
	Carolyn J. Crouch , Bokyung Yang, Experiments in automatic statistical thesaurus construction, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.77-88, June 21-24, 1992, Copenhagen, Denmark
	Inderjit S. Dhillon, Co-clustering documents and words using bipartite spectral graph partitioning, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.269-274, August 26-29, 2001, San Francisco, California
	David D. Lewis, Representation quality in text classification: an introduction and experiment, Proceedings of the workshop on Speech and Natural Language, p.288-295, June 24-27, 1990, Hidden Valley, Pennsylvania
	Maria L. Silveira , Berthier Ribeiro-Neto, Concept-based ranking: a case study in the juridical domain, Information Processing and Management: an International Journal, v.40 n.5, p.791-805, September 2004
	Tomek Strzalkowski , Barbara Vauthey, Information retrieval using robust natural language processing, Proceedings of the 30th annual meeting on Association for Computational Linguistics, p.104-111, June 28-July 02, 1992, Newark, Delaware
	Tomek Strzalkowski, Building a lexical domain map from text corpora, Proceedings of the 15th conference on Computational linguistics, August 05-09, 1994, Kyoto, Japan
	James R. Curran , Marc Moens, Scaling context space, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania
	James R. Curran , Marc Moens, Improvements in automatic thesaurus extraction, Proceedings of the ACL-02 workshop on Unsupervised lexical acquisition, p.59-66, July 12-12, 2002, Philadelphia, Pennsylvania
	Tomek Strzalkowski, Information retrieval using robust natural language processing, Proceedings of the workshop on Speech and Natural Language, February 23-26, 1992, Harriman, New York
	Jun Wang, Automatic thesaurus development: Term extraction from title metadata, Journal of the American Society for Information Science and Technology, v.57 n.7, p.907-920, May 2006
	Stanislav Busygin , Oleg Prokopyev , Panos M. Pardalos, Biclustering in data mining, Computers and Operations Research, v.35 n.9, p.2964-2987, September, 2008
	Masahiro Ito , Kotaro Nakayama , Takahiro Hara , Shojiro Nishio, Association thesaurus construction methods based on link co-occurrence analysis for wikipedia, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA