Variable selection and ranking for analyzing automobile traffic accident data

ABSTRACT

Variable ranking and feature selection are important concepts in data mining and machine learning. This paper introduces a new variable ranking technique named Sum Max Gain Ratio (SMGR). The new technique is evaluated within the domain of traffic accident data and against a more generalized dataset. In certain cases, SMGR is empirically shown to provide similar results to established approaches with significantly better runtime performance.

REFERENCES

• 1: Mark A. Hall , Lloyd A. Smith, Feature Selection for Machine Learning: Comparing a Correlation-Based Filter Approach to the Wrapper, Proceedings of the Twelfth International Florida Artificial Intelligence Research Society Conference, p.235-239, May 01-05, 1999
• 2: Isabelle Guyon , André Elisseeff, An introduction to variable and feature selection, The Journal of Machine Learning Research, 3, 3/1/2003
• 3: Ron Kohavi , George H. John, Wrappers for feature subset selection, Artificial Intelligence, v.97 n.1-2, p.273-324, Dec. 1997 [doi>10.1016/S0004-3702(97)00043-X]
• 4: Allen S. Parrish , Brandon Dixon , David Cordes , Susan Vrbsky , David Brown, CARE: An Automobile Crash Data Analysis Tool, Computer, v.36 n.6, p.22-32, June 2003 [doi>10.1109/MC.2003.1204320]
• 5: Dunja Mladenic , Marko Grobelnik, Feature Selection for Unbalanced Class Distribution and Naive Bayes, Proceedings of the Sixteenth International Conference on Machine Learning, p.258-267, June 27-30, 1999
• 6: Isabelle Guyon , Jason Weston , Stephen Barnhill , Vladimir Vapnik, Gene Selection for Cancer Classification using Support Vector Machines, Machine Learning, v.46 n.1-3, p.389-422, 2002 [doi>10.1023/A:1012487302797]
• 7: T. Furey, N. Cristianini, N. Duffy, D. W. Bednarski, M. Schummer and D. Haussler. Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics, 16:906--914, 2000.
• 8: T. R. Golub et al. Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science, 286:531--537, October 1999.
• 9: D. W. Stockburger. Introductory statistics: Concepts, Models, and Applications.
• 10: Donna K. Slonim , Pablo Tamayo , Jill P. Mesirov , Todd R. Golub , Eric S. Lander, Class prediction and discovery using gene expression data, Proceedings of the fourth annual international conference on Computational molecular biology, p.263-272, April 2000, Tokyo, Japan [doi>10.1145/332306.332564]
• 11: Jason Weston , André Elisseeff , Bernhard Schölkopf , Mike Tipping, Use of the zero norm with linear models and kernel methods, The Journal of Machine Learning Research, 3, 3/1/2003
• 12: P. Pavlidis, J. Weston, J. Cai, and W. N. Grundy. Learning gene functional classifications from multiple data types. Journal of Computational Biology, 9(2): 401--411, 2002.
• 13: Christopher M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, Inc., New York, NY, 1995
• 14: George Forman, An extensive empirical study of feature selection metrics for text classification, The Journal of Machine Learning Research, 3, 3/1/2003
• 15: W. Hawley. Foundations of statistics. Harcourt Brace & Company, 1996.
• 16: Robert Zembowicz , Jan M. Żytkow, From contingency tables to various forms of knowledge in databases, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 17: M. Grimaldi, P. Cunningham and A. Kokaram. An evaluation of alternative feature selection strategies and ensemble techniques for classifying music. The 14th European Conference on Machine Learning and the 7th European Conference on Principles and Practice of Knowledge Discovery in Databases, Dubrovnik, Croatia 2003.
• 18: Yiming Yang , Jan O. Pedersen, A Comparative Study on Feature Selection in Text Categorization, Proceedings of the Fourteenth International Conference on Machine Learning, p.412-420, July 08-12, 1997
• 19: http://clopinet.com/isabelle/Projects/NIPS2003/.
• 20: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 21: Hervé Stoppiglia , Gérard Dreyfus , Rémi Dubois , Yacine Oussar, Ranking a random feature for variable and feature selection, The Journal of Machine Learning Research, 3, 3/1/2003
• 22: G. John, R. Kohavi and K. Pfleeger. Irrelevant features and the subset selection problem. In Proceedings of the 11th International Conference on Machine Learning, pp. 121--129, 1994.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

General Terms:
Algorithms, Experimentation, Performance

Keywords:
decision tree, traffic accident data, variable and feature selection, variable ranking