Fast and effective text mining using linear-time document clustering

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Fast and effective text mining using linear-time document clustering

Full text

Pdf (898 KB)

Source

International Conference on Knowledge Discovery and Data Mining archive
Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining table of contents

San Diego, California, United States

Pages: 16 - 22

Year of Publication: 1999

ISBN:1-58113-143-7

Authors

Bjornar Larsen	SRA International, Inc., 4300 Fair Lakes Court, Fairfax, VA
Chinatsu Aone	SRA International, Inc., 4300 Fair Lakes Court, Fairfax, VA

Sponsors

SIGKDD: ACM Special Interest Group on Knowledge Discovery in Data
AAAI : Am Assoc for Artifical Intelligence
SIGART: ACM Special Interest Group on Artificial Intelligence
SIGMOD: ACM Special Interest Group on Management of Data

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 63, Downloads (12 Months): 453, Citation Count: 64

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/312129.312186 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
	2	Douglass R. Cutting , David R. Karger , Jan O. Pedersen, Constant interaction-time scatter/gather browsing of very large document collections, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.126-134, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160706]
	3	A. El-Hamdouchi , P. Willett, Hierarchic document classification using Ward's clustering method, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.149-156, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253200]
	4	Faber, V. "Clustering and the Continuous k-Means Algorithm", Los Alamos Science, November 22, 1994.
	5	Harman, D. and Voorhees, E., editors. Proceedings of the Fifth Text Retrieval Conference (TREC-5). National Institute of Standards and Technology, Department of Commerce. 1996.
	6	Marti A. Hearst , Jan O. Pedersen, Reexamining the cluster hypothesis: scatter/gather on retrieval results, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.76-84, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243216]
	7	Lagus, K., Honkela, T., Kaski, S., and Kohonen, T. "Self- Organizing Maps of Document Collections: A New Approach to Interactive Exploration," in Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, 1996.
	8	MacQueen, J. "Some methods for classification and analysis of multivariate observations," in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. Volume I, Statistics. Edited by Lucien M. Le Cam and Jerzy Neyman. University of California Press. 1967.
	9	Peter Pirolli , Patricia Schank , Marti Hearst , Christine Diehl, Scatter/gather browsing communicates the topic structure of a very large text collection, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.213-220, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238489]
	10	Mehran Sahami , Salim Yusufali , Michelle Q. W. Baldonaldo, SONIA: a service for organizing networked information autonomously, Proceedings of the third ACM conference on Digital libraries, p.200-209, June 23-26, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276675.276697]
	11	Gerard Salton, Automatic text processing: the transformation, analysis, and retrieval of information by computer, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
	12	Hinrich Schütze , Craig Silverstein, Projections for efficient document clustering, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, p.74-81, July 27-31, 1997, Philadelphia, Pennsylvania, United States
	13	Yiming Yang , Tom Pierce , Jaime Carbonell, A study of retrospective and on-line event detection, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.28-36, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290953]
	14	Zamir, O., Etzioni, O., Madani, O., and Karp, R. "Fast and Intuitive Clustering of Web Documents," in Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining, 1997.

CITED BY 66

	Martin Gavrilov , Dragomir Anguelov , Piotr Indyk , Rajeev Motwani, Mining the stock market (extended abstract): which measure is best?, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.487-496, August 20-23, 2000, Boston, Massachusetts, United States
	Yang Jianwu , Chen Xiaoou, A semi-structured document model for text mining, Journal of Computer Science and Technology, v.17 n.5, p.603-610, May 2002
	Ying Zhao , George Karypis, Evaluation of hierarchical clustering algorithms for document datasets, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA
	George Karypis , Eui-Hong (Sam) Han, Fast supervised dimensionality reduction algorithm with applications to document categorization & retrieval, Proceedings of the ninth international conference on Information and knowledge management, p.12-19, November 06-11, 2000, McLean, Virginia, United States
	Florian Beil , Martin Ester , Xiaowei Xu, Frequent term-based text clustering, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada
	Tu Bao Ho , Saori Kawasaki , Ngoc Binh Nguyen, Documents clustering using tolerance rough set model and its application to information retrieval, Intelligent exploration of the web, Physica-Verlag GmbH, Heidelberg, Germany, 2003
	Ying Zhao , George Karypis, Empirical and Theoretical Comparisons of Selected Criterion Functions for Document Clustering, Machine Learning, v.55 n.3, p.311-331, June 2004
	Samer Nassar , Jörg Sander , Corrine Cheng, Incremental and effective data summarization for dynamic hierarchical clustering, Proceedings of the 2004 ACM SIGMOD international conference on Management of data, June 13-18, 2004, Paris, France
	Pu-Jen Cheng , Lee-Feng Chien, Auto-generation of topic hierarchies for web images from users' perspectives, Proceedings of the twelfth international conference on Information and knowledge management, November 03-08, 2003, New Orleans, LA, USA
	David Cheng , Santosh Vempala , Ravi Kannan , Grant Wang, A divide-and-merge methodology for clustering, Proceedings of the twenty-fourth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 13-15, 2005, Baltimore, Maryland
	Shui-Lung Chuang , Lee-Feng Chien, Taxonomy generation for text segments: A practical web-based approach, ACM Transactions on Information Systems (TOIS), v.23 n.4, p.363-396, October 2005
	Richard T. Freeman , Hujun Yin, Adaptive topological tree structure for document organisation and visualisation, Neural Networks, v.17 n.8-9, p.1255-1271, October/November 2004
	Chih-Ping Wei , Chin-Sheng Yang , Han-Wei Hsiao , Tsang-Hsiang Cheng, Combining preference- and content-based approaches for improving document clustering effectiveness, Information Processing and Management: an International Journal, v.42 n.2, p.350-372, March 2006
	Louis Massey, On the quality of ART1 text clustering, Neural Networks, v.16 n.5-6, p.771-778, June 2003
	Shui-Lung Chuang , Lee-Feng Chien, A practical web-based approach to generating topic hierarchy for text segments, Proceedings of the thirteenth ACM international conference on Information and knowledge management, November 08-13, 2004, Washington, D.C., USA
	Illhoi Yoo , Xiaohua Hu , Il-Yeol Song, Integration of semantic-based bipartite graph representation and mutual refinement strategy for biomedical literature clustering, Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, August 20-23, 2006, Philadelphia, PA, USA
	Seth Hettich , Michael J. Pazzani, Mining for proposal reviewers: lessons learned at the national science foundation, Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, August 20-23, 2006, Philadelphia, PA, USA
	Reinhold Decker , Soren W. Scholz, Unsupervised Topic Detection in document collections: an application in marketing and business journals, International Journal of Business Intelligence and Data Mining, v.2 n.3, p.347-364, October 2007
	Shohei Kameda , Masayuki Yamamura, Spider algorithm for clustering time series, Proceedings of the 5th WSEAS International Conference on Artificial Intelligence, Knowledge Engineering and Data Bases, p.378-383, February 15-17, 2006, Madrid, Spain
	Dekang Lin , Patrick Pantel, DIRT @SBT@discovery of inference rules from text, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.323-328, August 26-29, 2001, San Francisco, California
	Yukio Uematsu , Ryoji Kataoka , Hiroshi Takeno, Clustering presentation of web image retrieval results using textual information and image features, Proceedings of the 24th IASTED international conference on Internet and multimedia systems and applications, p.217-222, February 13-15, 2006, Innsbruck, Austria
	Illhoi Yoo , Xiaohua Hu, A comprehensive comparison study of document clustering for a biomedical digital library MEDLINE, Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries, June 11-15, 2006, Chapel Hill, NC, USA
	Güneş Erkan, Language model-based document clustering using random walks, Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, p.479-486, June 04-09, 2006, New York, New York
	David Cheng , Ravi Kannan , Santosh Vempala , Grant Wang, A divide-and-merge methodology for clustering, ACM Transactions on Database Systems (TODS), v.31 n.4, p.1499-1525, December 2006
	Yasunori Yamamoto , Toshihisa Takagi, Biomedical knowledge navigation by literature clustering, Journal of Biomedical Informatics, v.40 n.2, p.114-130, April, 2007
	Chengkai Li , Min Wang , Lipyeow Lim , Haixun Wang , Kevin Chen-Chuan Chang, Supporting ranking and clustering as generalized order-by and group-by, Proceedings of the 2007 ACM SIGMOD international conference on Management of data, June 11-14, 2007, Beijing, China
	Gabriel Pui Cheong Fung , Jeffrey X. Yu , Hongjun Lu , Philip S. Yu, Text Classification without Negative Examples Revisit, IEEE Transactions on Knowledge and Data Engineering, v.18 n.1, p.6-20, January 2006
	Conglei Yao , Yongjian Yu , Sicong Shou , Xiaoming Li, Towards a global schema for web entities, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China
	Marina Meilă, Comparing clusterings---an information based distance, Journal of Multivariate Analysis, v.98 n.5, p.873-895, May, 2007
	Chin Pang Cheng , Gloria T. Lau , Kincho H. Law, Mapping regulations to industry-specific taxonomies, Proceedings of the 11th international conference on Artificial intelligence and law, June 04-08, 2007, Stanford, California
	Hung Chim , Xiaotie Deng, A new suffix tree similarity measure for document clustering, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada
	Shiyan Ou , Christopher Soo-Guan Khoo , Dion H. Goh, Design and development of a concept-based multi-document summarization system for research abstracts, Journal of Information Science, v.34 n.3, p.308-326, June 2008
	Bradley Malin , Edoardo Airoldi , Kathleen M. Carley, A Network Analysis Model for Disambiguation of Names in Lists, Computational & Mathematical Organization Theory, v.11 n.2, p.119-139, July 2005
	Rebecca J. Cathey , Eric C. Jensen , Steven M. Beitzel , Ophir Frieder , David Grossman, Exploiting parallelism to support scalable hierarchical clustering, Journal of the American Society for Information Science and Technology, v.58 n.8, p.1207-1221, June 2007
	Marco Degemmis , Pasquale Lops , Giovanni Semeraro, A content-collaborative recommender that exploits WordNet-based user profiles for neighborhood formation, User Modeling and User-Adapted Interaction, v.17 n.3, p.217-255, July 2007
	Daniela Godoy , Analía Amandi, A conceptual clustering approach for user profiling in personal information agents, AI Communications, v.19 n.3, p.207-227, August 2006
	Emilio Di Giacomo , Walter Didimo , Luca Grilli , Giuseppe Liotta, Graph Visualization Techniques for Web Clustering Engines, IEEE Transactions on Visualization and Computer Graphics, v.13 n.2, p.294-304, March 2007
	Ying Zhao , George Karypis , Usama Fayyad, Hierarchical Clustering Algorithms for Document Datasets, Data Mining and Knowledge Discovery, v.10 n.2, p.141-168, March 2005
	Maria Halkidi , Benjamin Nguyen , Iraklis Varlamis , Michalis Vazirgiannis, THESUS: Organizing Web document collections based on link semantics, The VLDB Journal — The International Journal on Very Large Data Bases, v.12 n.4, p.320-332, November 2003
	Dekang Lin , Patrick Pantel, Discovery of inference rules for question-answering, Natural Language Engineering, v.7 n.4, p.343-360, December 2001
	Shen Huang , Zheng Chen , Yong Yu , Wei-Ying Ma, Multitype Features Coselection for Web Document Clustering, IEEE Transactions on Knowledge and Data Engineering, v.18 n.4, p.448-459, April 2006
	Chih-Ping Wei , Paul Hu , Chia-Hung Tai , Chun-Neng Huang , Chin-Sheng Yang, Managing Word Mismatch Problems in Information Retrieval: A Topic-Based Query Expansion Approach, Journal of Management Information Systems, v.24 n.3, p.269-295, Number 3 / Winter 2007-2008
	Chih-Ping Wei , Chin-Sheng Yang , Han-Wei Hsiao, A collaborative filtering-based approach to personalized document clustering, Decision Support Systems, v.45 n.3, p.413-428, June, 2008
	Chin Pang Cheng , Jiayi Pan , Gloria T. Lau , Kincho H. Law , Albert Jones, Relating taxonomies with regulations, Proceedings of the 2008 international conference on Digital government research, May 18-21, 2008, Montreal, Canada
	Maryam Karimzadehgan , ChengXiang Zhai , Geneva Belford, Multi-aspect expertise matching for review assignment, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA
	Yanjun Li , Soon M. Chung , John D. Holt, Text document clustering based on frequent word meaning sequences, Data & Knowledge Engineering, v.64 n.1, p.381-404, January, 2008
	Chih-Ping Wei , Roger Chiang , Chia-Chen Wu, Accommodating Individual Preferences in the Categorization of Documents: A Personalized Clustering Approach, Journal of Management Information Systems, v.23 n.2, p.173-201, Number 2 / October 2006
	Rıdvan Saraçoğlu , Kemal Tütüncü , Novruz Allahverdi, A new approach on search for similar documents with multiple categories using fuzzy clustering, Expert Systems with Applications: An International Journal, v.34 n.4, p.2545-2554, May, 2008
	Illhoi Yoo , Xiaohua Hu , Il-Yeol Song, Biomedical ontology improves biomedical literature clustering performance: a comparison study, International Journal of Bioinformatics Research and Applications, v.3 n.3, p.414-428, September 2007
	Cyril Rohr , Dian Tjondronegoro, Aggregated cross-media news visualization and personalization, Proceeding of the 1st ACM international conference on Multimedia information retrieval, October 30-31, 2008, Vancouver, British Columbia, Canada
	Chih-Ping Wei , Christopher C. Yang , Chia-Min Lin, A Latent Semantic Indexing-based approach to multilingual document clustering, Decision Support Systems, v.45 n.3, p.606-620, June, 2008
	Morteza Haghir Chehreghani , Hassan Abolhassani , Mostafa Haghir Chehreghani, Improving density-based methods for hierarchical clustering of web pages, Data & Knowledge Engineering, v.67 n.1, p.30-50, October, 2008
	Fei Wang , Shouchun Chen , Changshui Zhang , Tao Li, Semi-supervised metric learning by maximizing constraint margin, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA
	Anna Povzner , Kimberly Keeton , Arif Merchant , Charles B. Morrey, III , Mustafa Uysal , Marcos K. Aguilera, Autograph: automatically extracting workflow file signatures, ACM SIGOPS Operating Systems Review, v.43 n.1, January 2009
	Chin Pang Cheng , Gloria T. Lau , Kincho H. Law , Jiayi Pan , Albert Jones, Regulation retrieval using industry specific taxonomies, Artificial Intelligence and Law, v.16 n.3, p.277-303, September 2008
	Mehrdad Mahdavi , Hassan Abolhassani, Harmony K-means algorithm for document clustering, Data Mining and Knowledge Discovery, v.18 n.3, p.370-391, June 2009
	Vijay K. Vaishnavi , Art Vandenberg , Yanqing Zhang , Saravanaraj Duraisamy, Towards design principles for effective context- and perspective-based web mining, Proceedings of the 4th International Conference on Design Science Research in Information Systems and Technology, May 07-08, 2009, Philadelphia, Pennsylvania
	Hai-Tao Zheng , Bo-Yeong Kang , Hong-Gee Kim, Exploiting noun phrases and semantic relationships for text document clustering, Information Sciences: an International Journal, v.179 n.13, p.2249-2262, June, 2009
	Chih-Ping Wei , Paul Hu , Yen-Hsien Lee, Preserving User Preferences in Automated Document-Category Management: An Evolution-Based Approach, Journal of Management Information Systems, v.25 n.4, p.109-144, Number 4 / Spring 2009
	Hui Xiong , Gaurav Pandey , Michael Steinbach , Vipin Kumar, Enhancing Data Analysis with Noise Removal, IEEE Transactions on Knowledge and Data Engineering, v.18 n.3, p.304-319, March 2006
	Yang Xiang, Managing email overload with an automatic nonparametric clustering system, The Journal of Supercomputing, v.48 n.3, p.227-242, June 2009
	Junjie Wu , Hui Xiong , Jian Chen, Towards understanding hierarchical clustering: A data distribution perspective, Neurocomputing, v.72 n.10-12, p.2319-2330, June, 2009
	Enrique Amigó , Julio Gonzalo , Javier Artiles , Felisa Verdejo, A comparison of extrinsic clustering evaluation metrics based on formal constraints, Information Retrieval, v.12 n.4, p.461-486, August 2009
	Hui Xiong , Junjie Wu , Jian Chen, K-means clustering versus validation measures: a data-distribution perspective, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, v.39 n.2, p.318-331, April 2009
	Junjie Wu , Hui Xiong , Jian Chen, Adapting the right measures for K-means clustering, Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, June 28-July 01, 2009, Paris, France
	Jiashu Hao , Chengzhi Zhang , Huilin Wang, Using Keywords Clustering to Construct Ontological Hierarchies, Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, p.247-250, September 15-18, 2009