Evolving Lucene search queries for text classification

ABSTRACT

We describe a method for generating accurate, compact, human understandable text classifiers. Text datasets are indexed using Apache Lucene and Genetic Programs are used to construct Lucene search queries. Genetic programs acquire fitness by producing queries that are effective binary classifiers for a particular category when evaluated against a set of training documents. We describe a set of functions and terminals and provide results from classification tasks.

REFERENCES

• 1: Chidanand Apté , Fred Damerau , Sholom M. Weiss, Automated learning of decision rules for text categorization, ACM Transactions on Information Systems (TOIS), v.12 n.3, p.233-251, July 1994 [doi>10.1145/183422.183423]
• 2: Maria-Luiza Antonie , Osmar R. Zaïane, Text Document Categorization by Term Association, Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM'02), p.19, December 09-12, 2002
• 3: Kristin P. Bennett , Nello Cristianini , John Shawe-Taylor , Donghui Wu, Enlarging the Margins in Perceptron Decision Trees, Machine Learning, v.41 n.3, p.295-313, Dec. 2000 [doi>10.1023/A:1007600130808]
• 4: Agneta Bergström , Patricija Jaksetic , Peter Nordin, Enhancing information retrieval by automatic acquisition of textual relations using genetic programming, Proceedings of the 5th international conference on Intelligent user interfaces, p.29-32, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325763]
• 5: Chris Clack , Johnny Farringdon , Peter Lidwell , Tina Yu, Autonomous document classification for business, Proceedings of the first international conference on Autonomous agents, p.201-208, February 05-08, 1997, Marina del Rey, California, United States [doi>10.1145/267658.267716]
• 6: Cohen, W. 1995 Fast effective rule induction. In Proceedings of the Twelfth International Conference on Machine Learning, pages 115--123
• 7: Franca Debole , Fabrizio Sebastiani, An analysis of the relative hardness of Reuters-21578 subsets: Research Articles, Journal of the American Society for Information Science and Technology, v.56 n.6, p.584-596, April 2005 [doi>10.1002/asi.v56:6]
• 8: P. J. Hayes , P. M. Andersen , I. B. Nirenburg , L. M. Schmandt, TCS: a shell for content-based text categorization, Proceedings of the sixth conference on Artificial intelligence applications, p.320-326, January 1990, Santa Barbara, California, United States
• 9: Hirsch L., Saeedi M. and Hirsch R., Evolving Text Classification Rules with Genetic Programming Applied Artificial Intelligence, (AAI 19/7), Taylor & Francis, August 2005
• 10: Thorsten Joachims, Text Categorization with Suport Vector Machines: Learning with Many Relevant Features, Proceedings of the 10th European Conference on Machine Learning, p.137-142, April 21-23, 1998
• 11: John R. Koza, Genetic programming: on the programming of computers by means of natural selection, MIT Press, Cambridge, MA, 1992
• 12: Montana, D. 1995. Strongly Typed Genetic Programming. In Evolutionary Computation. 3:2, 199----230. The MIT Press, Cambridge MA.
• 13: Quinlan, J. R. Bagging, boosting, and C4.5. In Proceedings, Fourteenth National Conference on Artificial Intelligence, 1996.
• 14: Gerard Salton , Amit Singhal , Chris Buckley , Mandar Mitra, Automatic text decomposition using text segments and text themes, Proceedings of the the seventh ACM conference on Hypertext, p.53-65, March 16-20, 1996, Bethesda, Maryland, United States [doi>10.1145/234828.234834]
• 15: Fabrizio Sebastiani, Machine learning in automated text categorization, ACM Computing Surveys (CSUR), v.34 n.1, p.1-47, March 2002 [doi>10.1145/505282.505283]
• 16: Chade-Meng Tan , Yuan-Fang Wang , Chan-Do Lee, The use of bigrams to enhance text categorization, Information Processing and Management: an International Journal, v.38 n.4, p.529-546, July 2002 [doi>10.1016/S0306-4573(01)00045-0]
• 17: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 18: Vasile, F., Silvescu, A., Kang, D-K. and Honavar, V. 2006. TRIPPER: An Attribute Value Taxonomy Guided Rule Learner. Proceedings of the Tenth Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), Berlin: Springer--Verlag. pp. 55--59

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.3 Language Constructs and Features

General Terms:
Algorithms

Keywords:
apache lucene, genetic programming, text classification