Noise reduction in a statistical approach to text categorization

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Noise reduction in a statistical approach to text categorization

Full text

Pdf (895 KB)

Source

Annual ACM Conference on Research and Development in Information Retrieval archive
Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval table of contents

Seattle, Washington, United States

Pages: 256 - 263

Year of Publication: 1995

ISBN:0-89791-714-6

Author

Yiming Yang

Section of Medical Information Resources, Mayo Clinic/Foundation, Rochester, Minnesota

Sponsors

BCS-ISRG : BCS-ISRG
CEPIS : Council of European Professional Informatics Societies
AICA : Assoc Italianai de Calcolo Automatico
BCS-IRSG : BCS/Information Retrieval Specialist Group
German Comp Soc : GI - Gesellshaft for Informatik
IPSJ : Information Processing Society of Japan
SIGIR: ACM Special Interest Group on Information Retrieval
DD :

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 8, Downloads (12 Months): 73, Citation Count: 23

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/215206.215367 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Yiming Yang , Christopher G. Chute, A Linear Least Squares Fit mapping method for information retrieval from natural language texts, Proceedings of the 14th conference on Computational linguistics, August 23-28, 1992, Nantes, France [doi>10.3115/992133.992139]
	2	Yiming Yang , Christopher G. Chute, An application of least squares fit mapping to text information retrieval, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.281-290, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160738]
	3	Yiming Yang , Christopher G. Chute, An example-based mapping method for text categorization and retrieval, ACM Transactions on Information Systems (TOIS), v.12 n.3, p.252-277, July 1994 [doi>10.1145/183422.183424]
	4	Fuhr N, Hartmann S, Lustig G, et al. (1991) AIR/X - a rulebased multistage indexing systems for large subject fields. Proceedings of the RIAO'91, 606-623.
	5	Kostas Tzeras , Stephan Hartmann, Automatic indexing based on Bayesian inference networks, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.22-35, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160691]
	6	Brij Masand , Gordon Linoff , David Waltz, Classifying news stories using memory based reasoning, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.59-65, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133177]
	7	Yiming Yang, Expert network: effective and efficient learning from human decisions in text categorization and retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.13-22, July 03-06, 1994, Dublin, Ireland
	8	Gene H. Golub , Charles F. Van Loan, Matrix computations (3rd ed.), Johns Hopkins University Press, Baltimore, MD, 1996
	9	Dongarra JJ, Moler CB, Bunch JR, Stewart GW. (1979) LIN- PACK Users' Guide. , Philadelphia, PA: SIAM.
	10	Jane K. Cullum , Ralph A. Willoughby, Lanczos Algorithms for Large Symmetric Eigenvalue Computations, Vol. 1, Society for Industrial and Applied Mathematics, Philadelphia, PA, 2002
	11	Berry MW. (1992) Large-Scale Sparse Singular Value Computations. The International Journal of Super-computer Applications Vol. 6 No. t: 13-49.
	12	David D. Lewis, Evaluating text categorization, Proceedings of the workshop on Speech and Natural Language, p.312-318, February 19-22, 1991, Pacific Grove, California [doi>10.3115/112405.112471]
	13	Fox EA. (Ed.). (1990) ~rginia Disc One. Virginia Polytechnic Institute and State University, Nimbus Records.
	14	A CM Guide to Computing Literature Baltimore, MD: Association for Computing Machinery, 1984: 657-658.
	15	Buckley C, Salton G, Allan J. (1993) Automatic Retrieval With Locality Information Using SMART. In: DK Harman, Ed. The First Text REtrieval Conference (TREC-1):59-65.
	16	W. John Wilbur , Karl Sirotkin, The automatic identification of stop words, Journal of Information Science, v.18 n.1, p.45-55, 1992 [doi>10.1177/016555159201800106]
	17	Gerard Salton, Automatic text processing: the transformation, analysis, and retrieval of information by computer, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
	18	Yiming Yang , John Wilbur, Using corpus statistics to remove redundant words in text categorization, Journal of the American Society for Information Science, v.47 n.5, p.357-369, May 1996 [doi>10.1002/(SICI)1097-4571(199605)47:5<357::AID-ASI3>3.3.CO;2-0]
	19	Jackson JE. (1978) Review of "Methods for statistical data analysis of multivariate observations" Technometrics Vol 20: 210-211.
	20	Deerwester S., Dumais ST, Fumas GW, Landauer TK, Harshman R. (1990) Indexing by Latent Semantic analysis. J Amer Soc lnf Sci 41, 6, 391-407.
	21	Chute CG, Yang Y. (1991) Latent semantic indexing of medical diagnoses using UMLS Semantic Structures. Proceedings of the Fifteenth Annual Symposium on Computer Applications in Medical Care (SCAMC 91): 185-189.
	22	Dumais S. (1994) Latent Semantic Indexing (LSI) and TREC-2. In: DK Harman, Ed. The Second Text REtrieval Conference (TREC-2): 105-116.

CITED BY 23

	Yiming Yang , Jian Zhang , Bryan Kisiel, A scalability analysis of classifiers in text categorization, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada
	Chris H. Q. Ding, A similarity-based probability model for latent semantic indexing, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.58-65, August 15-19, 1999, Berkeley, California, United States
	Fabrizio Sebastiani, Machine learning in automated text categorization, ACM Computing Surveys (CSUR), v.34 n.1, p.1-47, March 2002
	Yiming Yang, An Evaluation of Statistical Approaches to Text Categorization, Information Retrieval, v.1 n.1-2, p.69-90, 1999
	Wen-Lin Hsu , Sheau-Dong Lang, Classification algorithms for NETNEWS articles, Proceedings of the eighth international conference on Information and knowledge management, p.114-121, November 02-06, 1999, Kansas City, Missouri, United States
	Lijuan Cai , Thomas Hofmann, Text categorization by boosting automatically extracted concepts, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada
	Wahyu Wibowo , Hugh E. Williams, Simple and accurate feature selection for hierarchical categorisation, Proceedings of the 2002 ACM symposium on Document engineering, November 08-09, 2002, McLean, Virginia, USA
	Chris H. Q. Ding, A probabilistic model for latent semantic indexing in information retrieval and filtering, Computational information retrieval, Society for Industrial and Applied Mathematics, Philadelphia, PA, 2001
	L. Douglas Baker , Andrew Kachites McCallum, Distributional clustering of words for text classification, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.96-103, August 24-28, 1998, Melbourne, Australia
	Robert E. Schapire , Yoram Singer , Amit Singhal, Boosting and Rocchio applied to text filtering, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.215-223, August 24-28, 1998, Melbourne, Australia
	Fang Liu , Clement Yu , Weiyi Meng, Personalized Web Search For Improving Retrieval Effectiveness, IEEE Transactions on Knowledge and Data Engineering, v.16 n.1, p.28-40, January 2004
	Fang Liu , Clement Yu , Weiyi Meng, Personalized web search by mapping user queries to categories, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA
	Bill B. Wang , R. I. Bob Mckay , Hussein A. Abbass , Michael Barlow, A comparative study for domain ontology guided feature extraction, Proceedings of the twenty-sixth Australasian conference on Computer science: research and practice in information technology, p.69-78, February 01, 2003, Adelaide, Australia
	Chris H. Q. Ding, A probabilistic model for Latent Semantic Indexing: Research Articles, Journal of the American Society for Information Science and Technology, v.56 n.6, p.597-608, April 2005
	Kai Zhang , Jian Sun , Bin Wang, A WordNet-based approach to feature selection in text categorization, Intelligent information processing II, Springer-Verlag, London, 2004
	Nayer M. Wanas , Dina A. Said , Nadia H. Hegazy , Nevin M. Darwish, A study of local and global thresholding techniques in text categorization, Proceedings of the fifth Australasian conference on Data mining and analystics, p.91-101, November 29-30, 2006, Sydney, Australia
	Stanley Loh , Leandro Krug Wives , José Palazzo M. de Oliveira, Concept-based knowledge discovery in texts extracted from the Web, ACM SIGKDD Explorations Newsletter, v.2 n.1, p.29-39, June, 2000
	Anirban Dasgupta , Petros Drineas , Boulos Harb , Vanja Josifovski , Michael W. Mahoney, Feature selection methods for text classification, Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, August 12-15, 2007, San Jose, California, USA
	Costin-Anton Boiangiu , Andrei-Iulian Dvornic, Bitonal image creation for automatic content conversion, Proceedings of the 9th WSEAS International Conference on International Conference on Automation and Information, p.454-459, June 24-26, 2008, Bucharest, Romania
	Bo Yu , Zong-ben Xu , Cheng-hua Li, Latent semantic analysis for text categorization using neural network, Knowledge-Based Systems, v.21 n.8, p.900-904, December, 2008
	Cheng Hua Li , Soon Choel Park, An efficient document classification model using an improved back propagation neural network and singular value decomposition, Expert Systems with Applications: An International Journal, v.36 n.2, p.3208-3215, March, 2009
	Cheng Hua Li , Soon Cheol Park, Combination of modified BPNN algorithms and an efficient feature selection method for text categorization, Information Processing and Management: an International Journal, v.45 n.3, p.329-340, May, 2009
	Hui Xiong , Gaurav Pandey , Michael Steinbach , Vipin Kumar, Enhancing Data Analysis with Noise Removal, IEEE Transactions on Knowledge and Data Engineering, v.18 n.3, p.304-319, March 2006

INDEX TERMS

Primary Classification:
G. Mathematics of Computing

Additional Classification:
H. Information Systems
H.3 INFORMATION STORAGE AND RETRIEVAL

I. Computing Methodologies
I.2 ARTIFICIAL INTELLIGENCE

General Terms:
Theory

Collaborative Colleagues:

Yiming Yang: colleagues

Adobe Acrobat

QuickTime

Windows Media Player

Real Player