Feature selection, perceptron learning, and a usability case study for text categorization

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Feature selection, perceptron learning, and a usability case study for text categorization

Full text

Pdf (1.45 MB)

Source

Annual ACM Conference on Research and Development in Information Retrieval archive
Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval table of contents

Philadelphia, Pennsylvania, United States

Pages: 67 - 73

Year of Publication: 1997

ISBN:0-89791-836-3

Also published in ...

Authors

Hwee Tou Ng	DSO National Laboratories, 20 Science Park Drive, Singapore
Wei Boon Goh	Ministry of Defence, Gombak Drive
Kok Leong Low	Ministry of Defence, Gombak Drive

Sponsor

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 15, Downloads (12 Months): 162, Citation Count: 71

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/258525.258537 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	Apte et at., 1994	Chidanand Apté , Fred Damerau , Sholom M. Weiss, Automated learning of decision rules for text categorization, ACM Transactions on Information Systems (TOIS), v.12 n.3, p.233-251, July 1994 [doi>10.1145/183422.183423]
	Cohen and Singer, 1996	William W. Cohen , Yoram Singer, Context-sensitive learning methods for text categorization, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.307-315, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243278]
	Hayes et al., 1990	P. J. Hayes , P. M. Andersen , I. B. Nirenburg , L. M. Schmandt, TCS: a shell for content-based text categorization, Proceedings of the sixth conference on Artificial intelligence applications, p.320-326, January 1990, Santa Barbara, California, United States
	Hearst et al., 1996	Marti Hearst, jan Pedexsen, Peter Pirolli, Hinrich Schutze, Gregory Grefenstette, and David Hull. Xerox TREC4 site report. In Proce#ings o.{ the Fourth Text Retrieval Conference TREC-4, 1996.
	Hull, 1994	David Hull, Improving text retrieval for the routing problem using latent semantic indexing, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.282-291, July 03-06, 1994, Dublin, Ireland
	Kohavi and John, 1995	Ran Kohavi and George H. John. Automatic parameter selection by minimizing estimated error. In Machine Learning: Proce#inga of the Twelfth International Con/erence, 1995.
	Lewis and Ringuette, 1994	David Lewis and Marc Ringuette. A comparison of two learning algori# for text categorization. In Symposium on Document Analysis and Information Retrieval, 1994.
	Lewis et al., 1996	David D. Lewis , Robert E. Schapire , James P. Callan , Ron Papka, Training algorithms for linear text classifiers, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.298-306, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243277]
	Lewis, 1992	David Dolan Lewis, Representation and learning in information retrieval, University of Massachusetts, Amherst, MA, 1992
	Masand et al., 1992	Brij Masand , Gordon Linoff , David Waltz, Classifying news stories using memory based reasoning, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.59-65, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133177]
	Miller, 1990	George A Miller. Five papers on WordNet. International Journal of Lezicology, 3(4), 1990.
	Mooney et al., 1989	R#ymond J. Mooney, Jude W. Sitarilk, G. Towell, and A. Gave. An experiemental comparison of symbolic and connectionist learning algorithms. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, pages 775-780, 1989.
	Rijsbergen, 1979	C. 3. Van Rijsbergen. In}orraation Retrieval. Butterwo#, London, 1979.
	Rocchio, 1971	J. Rocchio. Relevance feedback informarian retrieval. In Gerard Salton, editor, The Smart Retrieval Sltstem - Ez'periments in Automatic Docu. ment Processing, pages 313-323. Prentice-Hall, #ewood #, N J, 1971.
	Rosenblatt, 1958	F. Rosenblatt. The perceptron: A probabillstic model for information storage and organization in the brain. Psychological Review, 65:386-408, 1958.
	Schutze et al., 1995	Hinrich Schütze , David A. Hull , Jan O. Pedersen, A comparison of classifiers and document representations for the routing problem, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.229-237, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215365]
	Wiener et al., 1995	Erik Wiener, Jan O. Pedersen, and Andreas S. Weigend. A neur#d network approach to topic spotting. In Symposium on Document Analysis and In. formation Retrieval, 1995.

CITED BY 71

	Fabrizio Sebastiani, Machine learning in automated text categorization, ACM Computing Surveys (CSUR), v.34 n.1, p.1-47, March 2002
	Anton Leuski, Relevance and reinforcement in interactive browsing, Proceedings of the ninth international conference on Information and knowledge management, p.119-126, November 06-11, 2000, McLean, Virginia, United States
	Miguel E. Ruiz , Padmini Srinivasan, Hierarchical neural networks for text categorization (poster abstract), Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.281-282, August 15-19, 1999, Berkeley, California, United States
	Paolo Frasconi , Giovanni Soda , Alessandro Vullo, Text categorization for multi-page documents: a hybrid naive Bayes HMM approach, Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries, p.11-20, January 2001, Roanoke, Virginia, United States
	Filippo Menczer , Gautam Pant , Padmini Srinivasan , Miguel E. Ruiz, Evaluating topic-driven web crawlers, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.241-249, September 2001, New Orleans, Louisiana, United States
	Arnulfo P. Azcarraga , Teddy N. Yap, Jr., Extracting meaningful labels for WEBSOM text archives, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA
	Edmund S. Yu , Ping C. Koo , Elizabeth D. Liddy, Evolving intelligent text-based agents, Proceedings of the fourth international conference on Autonomous agents, p.388-395, June 03-07, 2000, Barcelona, Spain
	Koby Crammer , Yoram Singer, A new family of online algorithms for category ranking, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland
	Aitao Chen, A comparison of regression, neural net, and pattern recognition approaches to IR, Proceedings of the seventh international conference on Information and knowledge management, p.140-147, November 02-07, 1998, Bethesda, Maryland, United States
	Susan Dumais , Hao Chen, Hierarchical classification of Web content, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.256-263, July 24-28, 2000, Athens, Greece
	Hai Leong Chieu , Hwee Tou Ng, A maximum entropy approach to information extraction from semi-structured and free text, Eighteenth national conference on Artificial intelligence, p.786-791, July 28-August 01, 2002, Edmonton, Alberta, Canada
	William W. Cohen , Yoram Singer, Context-sensitive learning methods for text categorization, ACM Transactions on Information Systems (TOIS), v.17 n.2, p.141-173, April 1999
	Dimitris Meretakis , Dimitris Fragoudis , Hongjun Lu , Spiros Likothanassis, Scalable association-based text classification, Proceedings of the ninth international conference on Information and knowledge management, p.5-11, November 06-11, 2000, McLean, Virginia, United States
	Hang Li , Kenji Yamanishi, Text classification using ESC-based stochastic decision lists, Information Processing and Management: an International Journal, v.38 n.3, p.343-361, May 2002
	Yiming Yang, An Evaluation of Statistical Approaches to Text Categorization, Information Retrieval, v.1 n.1-2, p.69-90, 1999
	O. de Vel , A. Anderson , M. Corney , G. Mohay, Mining e-mail content for author identification forensics, ACM SIGMOD Record, v.30 n.4, December 2001
	Tao Li , Shenghuo Zhu , Mitsunori Ogihara, Efficient multi-way text categorization via generalized discriminant analysis, Proceedings of the twelfth international conference on Information and knowledge management, November 03-08, 2003, New Orleans, LA, USA
	Rey-Long Liu , Yun-Ling Lu, Incremental context mining for adaptive document classification, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada
	Hsinchun Chen, Introduction to the JASIST special topic section on web retrieval and mining: a machine learning perspective, Journal of the American Society for Information Science and Technology, v.54 n.7, p.621-624, May 2003
	Sheng Gao , Wen Wu , Chin-Hui Lee , Tat-Seng Chua, A maximal figure-of-merit learning approach to text categorization, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada
	Weiguo Fan , Michael D. Gordon , Praveen Pathak, Discovery of Context-Specific Ranking Functions for Effective Information Retrieval Using Genetic Programming, IEEE Transactions on Knowledge and Data Engineering, v.16 n.4, p.523-527, April 2004
	Verayuth Lertnattee , Thanaruk Theeramunkong, Effect of term distributions on centroid-based text categorization, Information Sciences—Informatics and Computer Science: An International Journal, v.158 n.1, p.89-115, January 2004
	Sung-Kwon Choi , Han-Min Jung , Chul-Min Sim , Taewan Kim , Dong-In Park , Jun-Sik Park , Key-Sun Choi, Hybrid approaches to improvement of translation quality in Web-based English-Korean machine translation, Proceedings of the 17th international conference on Computational linguistics, August 10-14, 1998, Montreal, Quebec, Canada
	Raymond J. Mooney , Loriene Roy, Content-based book recommending using learning for text categorization, Proceedings of the fifth ACM conference on Digital libraries, p.195-204, June 02-07, 2000, San Antonio, Texas, United States
	Yuen-Hsien Tseng , Da-Wei Juang, Document-self expansion for text categorization, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada
	Eibe Frank , Gordon W. Paynter, Predicting library of congress classifications from library of congress subject headings, Journal of the American Society for Information Science and Technology, v.55 n.3, p.214-227, February 2004
	Robert E. Schapire , Yoram Singer , Amit Singhal, Boosting and Rocchio applied to text filtering, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.215-223, August 24-28, 1998, Melbourne, Australia
	Paolo Frasconi , Giovanni Soda , Alessandro Vullo, Hidden Markov Models for Text Categorization in Multi-Page Documents, Journal of Intelligent Information Systems, v.18 n.2-3, p.195-217, March-May 2002
	Yan-Shi Dong , Ke-Song Han, Text classification based on data partitioning and parameter varying ensembles, Proceedings of the 2005 ACM symposium on Applied computing, March 13-17, 2005, Santa Fe, New Mexico
	Rey-Long Liu , Wan-Jung Lin, Mining for interactive identification of users' information needs, Information Systems, v.28 n.7, p.815-833, 1 October 2003
	Chih-Ping Wei , Yen-Hsien Lee, Event detection from online news documents for supporting environmental scanning, Decision Support Systems, v.36 n.4, p.385-401, March 2004
	Zhaohui Zheng , Xiaoyun Wu , Rohini Srihari, Feature selection for text categorization on imbalanced data, ACM SIGKDD Explorations Newsletter, v.6 n.1, June 2004
	Hwee Tou Ng , Leong Hwee Teo , Jennifer Lai Pheng Kwan, A machine learning approach to answering questions for reading comprehension tests, Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics, p.124-132, October 07-08, 2000, Hong Kong
	Kian Ming Adam Chai , Hai Leong Chieu , Hwee Tou Ng, Bayesian online classifiers for text classification and filtering, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland
	Sue J. Ker , Jen-Nan Chen, A text categorization based on summarization technique, Proceedings of the ACL-2000 workshop on Recent advances in natural language processing and information retrieval: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics, October 08-08, 2000, Hong Kong
	Dimitris Fragoudis , Dimitris Meretakis , Spiridon Likothanassis_aff1n3, Best terms: an efficient feature-selection algorithm for text categorization, Knowledge and Information Systems, v.8 n.1, p.16-33, July 2005
	Weiguo Fan , Michael D. Gordon , Praveen Pathak, Effective profiling of consumer information retrieval needs: a unified framework and empirical comparison, Decision Support Systems, v.40 n.2, p.213-233, August 2005
	Ying Liu , Han Tong Loh , Shu Beng Tor, Comparison of extreme learning machine with support vector machine for text classification, Proceedings of the 18th international conference on Innovations in Applied Artificial Intelligence, p.390-399, June 22-24, 2005, Bari, Italy
	Rudy Prabowo , Mike Thelwall, A comparison of feature selection methods for an evolving RSS feed corpus, Information Processing and Management: an International Journal, v.42 n.6, p.1491-1512, December 2006
	Abdelwadood Mesleh, Support vector machines based Arabic language text classification system: feature selection comparative study, Proceedings of the 12th WSEAS International Conference on Applied Mathematics, p.228-233, December 29-31, 2007, Cairo, Egypt
	Rafael A. Calvo , H. A. Ceccatto, Intelligent document classification, Intelligent Data Analysis, v.4 n.5, p.411-420, October 2000
	Michael Chau , Hsinchun Chen, A machine learning approach to web page filtering using content and structure analysis, Decision Support Systems, v.44 n.2, p.482-494, January, 2008
	Bong Chih How , K. Narayanan, An Empirical Study of Feature Selection for Text Categorization based on Term Weightage, Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence, p.599-602, September 20-24, 2004
	Yiming Yang , Xin Liu, A re-examination of text categorization methods, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.42-49, August 15-19, 1999, Berkeley, California, United States
	Fernando Ruiz-Rico , Jose Luis Vicedo , María-Consuelo Rubio-Sánchez, NEWPAR: an automatic feature selection and weighting schema for category ranking, Proceedings of the 2006 ACM symposium on Document engineering, October 10-13, 2006, Amsterdam, The Netherlands
	Weiguo Fan , Michael D. Gordon , Praveen Pathak, An integrated two-stage model for intelligent information routing, Decision Support Systems, v.42 n.1, p.362-374, October 2006
	Sheng Gao , Wen Wu , Chin-Hui Lee , Tat-Seng Chua, A maximal figure-of-merit (MFoM)-learning approach to robust classifier design for text categorization, ACM Transactions on Information Systems (TOIS), v.24 n.2, p.190-218, April 2006
	Yuen-Hsien Tseng , Chi-Jen Lin , Yu-I Lin, Text mining techniques for patent analysis, Information Processing and Management: an International Journal, v.43 n.5, p.1216-1247, September, 2007
	Jae-Ho Kim , Key-Sun Choi, Patent document categorization based on semantic structural information, Information Processing and Management: an International Journal, v.43 n.5, p.1200-1215, September, 2007
	B. Barla Cambazoglu , Evren Karaca , Tayfun Kucukyilmaz , Ata Turk , Cevdet Aykanat, Architecture of a grid-enabled Web search engine, Information Processing and Management: an International Journal, v.43 n.3, p.609-623, May, 2007
	Michelangelo Ceci , Donato Malerba, Classifying web documents in a hierarchy of categories: a comprehensive study, Journal of Intelligent Information Systems, v.28 n.1, p.37-78, February 2007
	M. T. Martín-Valdivia , L. A. Ureña-López , M. García-Vega, The learning vector quantization algorithm applied to automatic text classification tasks, Neural Networks, v.20 n.6, p.748-756, August, 2007
	Nayer M. Wanas , Dina A. Said , Nadia H. Hegazy , Nevin M. Darwish, A study of local and global thresholding techniques in text categorization, Proceedings of the fifth Australasian conference on Data mining and analystics, p.91-101, November 29-30, 2006, Sydney, Australia
	Huilin Ye , Bruce W. N. Lo, Feature Competitive Algorithm for Dimension Reduction of the Self-Organizing Map Input Space, Applied Intelligence, v.13 n.3, p.215-230, November-December 2000
	Robert E. Schapire , Yoram Singer, BoosTexter: A Boosting-based Systemfor Text Categorization, Machine Learning, v.39 n.2-3, p.135-168, May-June 2000
	Marko Balabanović, Exploring Versus Exploiting when Learning User Models for Text Recommendation, User Modeling and User-Adapted Interaction, v.8 n.1-2, p.71-102, 1998
	Koby Crammer , Yoram Singer, A family of additive online algorithms for category ranking, The Journal of Machine Learning Research, 3, 3/1/2003
	Miguel E. Ruiz , Padmini Srinivasan, Hierarchical Text Categorization Using Neural Networks, Information Retrieval, v.5 n.1, p.87-118, January 2002
	Tao Li , Shenghuo Zhu , Mitsunori Ogihara, Text categorization via generalized discriminant analysis, Information Processing and Management: an International Journal, v.44 n.5, p.1684-1697, September, 2008
	Yuen-Hsien Tseng , Yeong-Ming Wang , Yu-I Lin , Chi-Jen Lin , Dai-Wei Juang, Patent surrogate extraction and evaluation in the context of patent mapping, Journal of Information Science, v.33 n.6, p.718-736, December 2007
	Cyntrica Eaton , Atif M. Memon, An empirical approach to evaluating web application compliance across diverse client platform configurations, International Journal of Web Engineering and Technology, v.3 n.3, p.227-253, January 2007
	Andrea Esuli , Tiziano Fagni , Fabrizio Sebastiani, Boosting multi-label hierarchical text categorization, Information Retrieval, v.11 n.4, p.287-313, August 2008
	Bo Yu , Zong-ben Xu , Cheng-hua Li, Latent semantic analysis for text categorization using neural network, Knowledge-Based Systems, v.21 n.8, p.900-904, December, 2008
	Ying Liu , Han Tong Loh , Aixin Sun, Imbalanced text classification: A term weighting approach, Expert Systems with Applications: An International Journal, v.36 n.1, p.690-701, January, 2009
	Cheng Hua Li , Soon Choel Park, An efficient document classification model using an improved back propagation neural network and singular value decomposition, Expert Systems with Applications: An International Journal, v.36 n.2, p.3208-3215, March, 2009
	Chung-Hong Lee , Hsin-Chang Yang, Construction of supervised and unsupervised learning systems for multilingual text categorization, Expert Systems with Applications: An International Journal, v.36 n.2, p.2400-2410, March, 2009
	Yaakov HaCohen-Kerner , Dror Mughaz , Hananya Beck , Elchai Yehudai, WORDS AS CLASSIFIERS OF DOCUMENTS ACCORDING TO THEIR HISTORICAL PERIOD AND THE ETHNIC ORIGIN OF THEIR AUTHORS, Cybernetics and Systems, v.39 n.3, p.213-228, April 2008
	Lars Asker , Atelach Alemu Argaw , Björn Gambäck , Samuel Eyassu Asfeha , Lemma Nigussie Habte, Classifying Amharic webnews, Information Retrieval, v.12 n.3, p.416-435, June 2009
	Cheng Hua Li , Soon Cheol Park, Combination of modified BPNN algorithms and an efficient feature selection method for text categorization, Information Processing and Management: an International Journal, v.45 n.3, p.329-340, May, 2009
	Yen-Hsien Lee , Tsang-Hsiang Cheng , Ci-Wei Lan , Chih-Ping Wei , Paul Jen-Hwa Hu, Overcoming small-size training set problem in content-based recommendation: a collaboration-based training set expansion approach, Proceedings of the 11th International Conference on Electronic Commerce, August 12-15, 2009, Taipei, Taiwan
	Roberto Basili , Alessandro Moschitti , Maria Teresa Pazienza, NLP-driven IR: evaluating performances over a text classification task, Proceedings of the 17th international joint conference on Artificial intelligence, p.1286-1291, August 04-10, 2001, Seattle, WA, USA