Customer targeting models using actively-selected web content

ABSTRACT

We consider the problem of predicting the likelihood that a company will purchase a new product from a seller. The statistical models we have developed at IBM for this purpose rely on historical transaction data coupled with structured firmographic information like the company revenue, number of employees and so on. In this paper, we extend this methodology to include additional text-based features based on analysis of the content on each company's website. Empirical results demonstrate that incorporating such web content can significantly improve customer targeting. Furthermore, we present methods to actively select only the web content that is likely to improve our models, while reducing the costs of acquisition and processing.

REFERENCES

• 1: Chris Buckley , Gerard Salton , James Allan, The effect of adding relevance information in a relevance feedback environment, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.292-300, July 03-06, 1994, Dublin, Ireland
• 2: David Cohn , Les Atlas , Richard Ladner, Improving Generalization with Active Learning, Machine Learning, v.15 n.2, p.201-221, May 1994 [doi>10.1023/A:1022673506211]
• 3: D. A. Cohn, Z. Ghahramani, and M. I. Jordan. Active learning with statistical models. Journal of Artificial Intelligence Research, 4:129--145, 1996.
• 4: V. Federov. Theory of optimal experiments. Academic Press, 1972.
• 5: George Forman, An extensive empirical study of feature selection metrics for text classification, The Journal of Machine Learning Research, 3, 3/1/2003
• 6: E. Frank and R. R. Bouckaert. Naive bayes for text classification with unbalanced classes. In Proc 10th European Conference on Principles and Practice of Knowledge Discovery in Databases, pages 503--510, 2006.
• 7: Thorsten Joachims, Text Categorization with Suport Vector Machines: Learning with Many Relevant Features, Proceedings of the 10th European Conference on Machine Learning, p.137-142, April 21-23, 1998
• 8: J. Keifer. Optimal experimental designs. Journal of the Royal Statistical Society, 21B:272--304, 1959.
• 9: R. Lawrence , C. Perlich , S. Rosset , J. Arroyo , M. Callahan , J. M. Collins , A. Ershov , S. Feinzig , I. Khabibrakhmanov , S. Mahatma , M. Niemaszyk , S. M. Weiss, Analytics-driven solutions for customer targeting and sales-force allocation, IBM Systems Journal, v.46 n.4, p.797-816, October 2007
• 10: A. McCallum and K. Nigam. A comparison of event models for naive Bayes text classification. In Papers from the AAAI-98 Workshop on Text Categorization, pages 41--48, Madison, WI, July 1998.
• 11: Prem Melville , Maytal Saar-Tsechansky , Foster Provost , Raymond Mooney, Active Feature-Value Acquisition for Classifier Induction, Proceedings of the Fourth IEEE International Conference on Data Mining, p.483-486, November 01-04, 2004
• 12: Prem Melville , Maytal Saar-Tsechansky , Foster Provost , Raymond Mooney, An Expected Utility Approach to Active Feature-Value Acquisition, Proceedings of the Fifth IEEE International Conference on Data Mining, p.745-748, November 27-30, 2005 [doi>10.1109/ICDM.2005.23]
• 13: Dunja Mladenic , Marko Grobelnik, Feature Selection for Unbalanced Class Distribution and Naive Bayes, Proceedings of the Sixteenth International Conference on Machine Learning, p.258-267, June 27-30, 1999
• 14: J. Rennie, L. Shih, J. Teevan, and D. Karger. Tackling the poor assumptions of naive bayes text classifiers. In Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), pages 616--623, 2003.
• 15: S. Rosset and R. D. Lawrence. Data enhanced predictive modeling for sales targeting. In Proceedings of the 2005 SIAM International Conference on Data Mining (SDM-05), 2005.
• 16: M. Saar-Tsechansky and F. J. Provost. Active learning for class probability estimation and ranking. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-2001), pages 911--920, 2001.
• 17: R. E. Schapire, Y. Freund, P. Bartlett, and W. S. Lee. Boosting the margin: A new explanation for the effectiveness of voting methods. The Annals of Statistics, 26(5):1651--1686, 1998.
• 18: Yiming Yang , Jan O. Pedersen, A Comparative Study on Feature Selection in Text Categorization, Proceedings of the Fourteenth International Conference on Machine Learning, p.412-420, July 08-12, 1997
• 19: Zhiqiang Zheng , Balaji Padmanabhan, On Active Learning for Data Acquisition, Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM'02), p.562, December 09-12, 2002
• 20: Zhaohui Zheng , Xiaoyun Wu , Rohini Srihari, Feature selection for text categorization on imbalanced data, ACM SIGKDD Explorations Newsletter, v.6 n.1, June 2004 [doi>10.1145/1007730.1007741]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models

General Terms:
Algorithms, Economics, Experimentation, Management

Keywords:
active feature-value acquisition, active learning, text categorization, web mining