Evaluating and optimizing autonomous text classification systems

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Evaluating and optimizing autonomous text classification systems

Full text

Pdf (870 KB)

Source

Annual ACM Conference on Research and Development in Information Retrieval archive
Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval table of contents

Seattle, Washington, United States

Pages: 246 - 254

Year of Publication: 1995

ISBN:0-89791-714-6

Author

David D. Lewis

AT&T Bell Laboratories, Murray Hill, NJ

Sponsors

BCS-ISRG : BCS-ISRG
CEPIS : Council of European Professional Informatics Societies
AICA : Assoc Italianai de Calcolo Automatico
BCS-IRSG : BCS/Information Retrieval Specialist Group
German Comp Soc : GI - Gesellshaft for Informatik
IPSJ : Information Processing Society of Japan
SIGIR: ACM Special Interest Group on Information Retrieval
DD :

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 5, Downloads (12 Months): 56, Citation Count: 46

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/215206.215366 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Donna Harman, Overview of the second text retrieval conference (TREC-2), Proceedings of the second conference on Text retrieval conference, p.271-289, May 1995, Washington, D.C., United States
	2	William S. Cooper. On selecting a measure of retrieval effectiveness. Journal of the American Society for information Science, 24:87-100. March-April 1973~
	3	Alexander M. Mood, Franklin A. Graybill, and Duane C. Boes. Introduction to the Theory of Statistics. Mcgraw-Hill, New York, 3rd edition, 1974.
	4	Tefko Saracevic. Relevance: A review of and a framework for the thinking on the notion in information science. Journal of the American Society for Information Science, pages 321-343, November-December 1975.
	5	C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
	6	S. E. Robertson. The probability ranking principle in IR. Journal of Documentation, 33(4):294-304, December 1977.
	7	Richard O. Duda and Peter E. Hart. Pattern Classification and Scene Analysis. Wiley-lnterscience, New York, 1973.
	8	William S. Cooper. On selecting a measure of retrieval effectiveness. Part II. Implementation of a philosophy. Journal of the American Society for Information Science, 24:413-424, November-December 1973.
	9	Davis B. McCarn. Online systems--techniques and services. In Martha E. Williams, editor, Annual Review of Information Science and Technology, Vol. 13, pages 85-124. Knowledge Industry Publications, Inc., 1978.
	10	Davis B. McCarn and Craig M. Lewis. A mathematical model of retrieval system performance. Journal of the American Soczety for Information Science, 41(7):495-500, October 1990.
	11	Bernard W. Lindgren. Statistical Theory. Chapman & Hall, New York, 4th edition, 1993.
	12	T. Thomas, C. Kruger, C. Scovel, and J. Shumate. Text to information: Sampling uncertainty in an example from physician/patient encounters. In Symposium on Document Analysis and Information Retrieval, 1995. To appear.
	13	Norbert Fuhr and Hubert Htither. Optimum probability estimation from empirical distributions. Information Processing and Management, pages 493-507, 1989.
	14	Norbert Fuhr , Ulrich Pfeifer, Probabilistic information retrieval as a combination of abstraction, inductive learning, and probabilistic assumptions, ACM Transactions on Information Systems (TOIS), v.12 n.1, p.92-115, Jan. 1994 [doi>10.1145/174608.174612]
	15	David D. Lewis , William A. Gale, A sequential algorithm for training text classifiers, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.3-12, July 03-06, 1994, Dublin, Ireland
	16	Win. S. Cooper, Aitao Chen, and Frederic C. Gey. Full text retrieval based on probabilistic equations with coefficients fitted by logistic regression. In D. K. Harman, editor, The Second Text Retrieval Conference (TREC-2), pages 57-65, Gaithersburg, MD, 1994. National Institute of Standards and Technology. NIST Special Publication 500-215.
	17	Arthur S. Pollitt. CANCERLINE evaluation project: Final report. Technical report, Medical Library, School of Medicine, The University of Leeds, Leeds, England, 1977.
	18	Richard yon Mises. Mathematical Theory of Probability and Statistics. Academic Press, New York, 1964.

CITED BY 46

	Leah S. Larkey , W. Bruce Croft, Combining classifiers in text categorization, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.289-297, August 18-22, 1996, Zurich, Switzerland
	Fabrizio Sebastiani , Alessandro Sperduti , Nicola Valdambrini, An improved boosting algorithm and its application to text categorization, Proceedings of the ninth international conference on Information and knowledge management, p.78-85, November 06-11, 2000, McLean, Virginia, United States
	Marie-Francine Moens , Caroline Uyttendaele , Jos Dumortier, Abstracting of legal cases: the SALOMON experience, Proceedings of the 6th international conference on Artificial intelligence and law, p.114-122, June 30-July 03, 1997, Melbourne, Australia
	Yan Liu , Yiming Yang , Jaime Carbonell, Boosting to correct inductive bias in text classification, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA
	David D. Lewis , Robert E. Schapire , James P. Callan , Ron Papka, Training algorithms for linear text classifiers, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.298-306, August 18-22, 1996, Zurich, Switzerland
	Carsten Lanquillon , Ingrid Renz, Adaptive information filtering: detecting changes in text streams, Proceedings of the eighth international conference on Information and knowledge management, p.538-544, November 02-06, 1999, Kansas City, Missouri, United States
	Yu-Hwan Kim , Shang-Yoon Hahn , Byoung-Tak Zhang, Text filtering by boosting naive Bayes classifiers, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.168-175, July 24-28, 2000, Athens, Greece
	Fabrizio Sebastiani, Machine learning in automated text categorization, ACM Computing Surveys (CSUR), v.34 n.1, p.1-47, March 2002
	Dunja Mladenić , Marko Grobelnik, Feature selection on hierarchy of web documents, Decision Support Systems, v.35 n.1, p.45-87, 01 April 2003
	Avi Arampatzis , André van Hameran, The score-distributional threshold optimization for adaptive binary classification tasks, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.285-293, September 2001, New Orleans, Louisiana, United States
	Chris Buckley , Ellen M. Voorhees, Evaluating evaluation measure stability, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.33-40, July 24-28, 2000, Athens, Greece
	David A. Hull , Jan O. Pedersen , Hinrich Schütze, Method combination for document filtering, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.279-287, August 18-22, 1996, Zurich, Switzerland
	Joo-Hwee Lim, Learnable visual keywords for image classification, Proceedings of the fourth ACM conference on Digital libraries, p.139-145, August 11-14, 1999, Berkeley, California, United States
	Franca Debole , Fabrizio Sebastiani, Supervised term weighting for automated text categorization, Proceedings of the 2003 ACM symposium on Applied computing, March 09-12, 2003, Melbourne, Florida
	Ali Selamat , Sigeru Omatu, Web page feature selection and classification using neural networks, Information Sciences—Informatics and Computer Science: An International Journal, v.158 n.1, p.69-88, January 2004
	Robert E. Schapire , Yoram Singer , Amit Singhal, Boosting and Rocchio applied to text filtering, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.215-223, August 24-28, 1998, Melbourne, Australia
	B. Uygar Oztekin , George Karypis , Vipin Kumar, Expert agreement and content based reranking in a meta search environment using Mearf, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA
	Le Zhang , Jingbo Zhu , Tianshun Yao, An evaluation of statistical spam filtering techniques, ACM Transactions on Asian Language Information Processing (TALIP), v.3 n.4, p.243-269, December 2004
	Harris Drucker , Behzad Shahrary , David C. Gibbon, Support vector machines: relevance feedback and information retrieval, Information Processing and Management: an International Journal, v.38 n.3, p.305-323, May 2002
	Kian Ming Adam Chai, Expectation of f-measures: tractable exact computation and some empirical observations of its properties, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil
	Franca Debole , Fabrizio Sebastiani, An analysis of the relative hardness of Reuters-21578 subsets: Research Articles, Journal of the American Society for Information Science and Technology, v.56 n.6, p.584-596, April 2005
	Ding-Yi Chen , Xue Li , Zhao Yang Dong , Xia Chen, Determining the fitness of a document model by using conflict instances, Proceedings of the sixteenth Australasian database conference, p.125-133, January 01, 2005, Newcastle, Australia
	Javed A. Aslam , Emine Yilmaz , Virgiliu Pavlu, The maximum entropy method for analyzing retrieval measures, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil
	Yueyu Fu , Weimao Ke , Javed Mostafa, Automated text classification using a multi-agent framework, Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2005, Denver, CO, USA
	Thorsten Joachims, A support vector method for multivariate performance measures, Proceedings of the 22nd international conference on Machine learning, p.377-384, August 07-11, 2005, Bonn, Germany
	Rey-Long Liu , Wan-Jung Lin, Adaptive sampling for thresholding in document filtering and classification, Information Processing and Management: an International Journal, v.41 n.4, p.745-758, July 2005
	Kian Ming Adam Chai , Hai Leong Chieu , Hwee Tou Ng, Bayesian online classifiers for text classification and filtering, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland
	David D. Lewis , Yiming Yang , Tony G. Rose , Fan Li, RCV1: A New Benchmark Collection for Text Categorization Research, The Journal of Machine Learning Research, 5, p.361-397, 12/1/2004
	Rehab M. Duwairi, Machine learning for Arabic text categorization: Research Articles, Journal of the American Society for Information Science and Technology, v.57 n.8, p.1005-1010, June 2006
	I. E. Kuralenok , I. S. Nekrestyanov, Evaluation of Text Retrieval Systems, Programming and Computing Software, v.28 n.4, p.226-242, July-August 2002
	Tatjana Eitrich , Bruno Lang, Efficient optimization of support vector machine learning parameters for unbalanced datasets, Journal of Computational and Applied Mathematics, v.196 n.2, p.425-436, 15 November 2006
	Michael Taylor , Hugo Zaragoza , Nick Craswell , Stephen Robertson , Chris Burges, Optimisation methods for ranking functions with multiple parameters, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA
	Hinrich Schütze , Emre Velipasaoglu , Jan O. Pedersen, Performance thresholding in practical text classification, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA
	Weimao Ke , Javed Mostafa , Yueyu Fu, Collaborative classifier agents: studying the impact of learning in distributed document classification, Proceedings of the 2007 conference on Digital libraries, June 18-23, 2007, Vancouver, BC, Canada
	Steven M. Beitzel , Eric C. Jensen , David D. Lewis , Abdur Chowdhury , Ophir Frieder, Automatic classification of Web queries using very large unlabeled query logs, ACM Transactions on Information Systems (TOIS), v.25 n.2, p.9-es, April 2007
	Rey-Long Liu, Dynamic category profiling for text filtering and classification, Information Processing and Management: an International Journal, v.43 n.1, p.154-168, January 2007
	Gordon V. Cormack , Thomas R. Lynam, Online supervised spam filter evaluation, ACM Transactions on Information Systems (TOIS), v.25 n.3, p.11-es, July 2007
	Saravadee Sae Tan , Gan Keng Hoon , Tang Enya Kong, A Lazy Approach for Category Model Construction Using Training Texts, Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, p.1005-1011, December 18-22, 2006
	David Eichmann , Padmini Srinivasan, Adaptive Filtering of Newswire Stories using Two-Level Clustering, Information Retrieval, v.5 n.2-3, p.209-237, April-July 2002
	Chung-Chih Wu , Chien-Hsing Chou , Fu Chang, A machine-learning approach for analyzing document layout structures with two reading orders, Pattern Recognition, v.41 n.10, p.3200-3213, October, 2008
	Fernando Mourão , Leonardo Rocha , Renata Araújo , Thierson Couto , Marcos Gonçalves , Wagner Meira, Jr., Understanding temporal aspects in document classification, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA
	Yuefeng Li , Sheng-Tang Wu , Xiaohui Tao, Effective pattern taxonomy mining in text documents, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA
	Steven M. Beitzel , Eric C. Jensen , Abdur Chowdhury , Ophir Frieder, Analysis of varying approaches to topical web query classification, Proceedings of the 3rd international conference on Scalable information systems, June 04-06, 2008, Vico Equense, Italy
	Xiaohui Tao , Yuefeng Li , Richi Nayak, A knowledge retrieval model using ontology mining and user profiling, Integrated Computer-Aided Engineering, v.15 n.4, p.313-329, December 2008
	Leonardo Rocha , Fernando Mourão , Adriano Pereira , Marcos André Gonçalves , Wagner Meira, Jr., Exploiting temporal contexts in text classification, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA
	Fabio Aiolli , Riccardo Cardin , Fabrizio Sebastiani , Alessandro Sperduti, Preferential text classification: learning algorithms and evaluation measures, Information Retrieval, v.12 n.5, p.559-580, October 2009