Red Opal: product-feature scoring from reviews

ABSTRACT

Online shoppers are generally highly task-driven: they have a certain goal in mind, and they are looking for a product with features that are consistent with that goal. Unfortunately, finding a product with specific features is extremely time-consuming using the search functionality provided by existing web sites.In this paper, we present a new search system called Red Opal that enables users to locate products rapidly based on features. Our fully automatic system examines prior customer reviews, identifies product features, and scores each product on each feature. Red Opal uses these scores to determine which products to show when a user specifies a desired product feature. We evaluate our system on four dimensions: precision of feature extraction, efficiency of feature extraction, precision of product scores, and estimated time savings to customers. On each dimension, Red Opal performs better than a comparison system.

REFERENCES

• 1: James Allen, Natural language understanding (2nd ed.), Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, 1995
• 2: Lynette Barnard , Janet L. Wesson, Usability issues for E-commerce in South Africa: an empirical investigation, Proceedings of the 2003 annual research conference of the South African institute of computer scientists and information technologists on Enablement through technology, p.258-267, September 17-19, 2003
• 3: Damerau, F. An Experiment in Automatic Indexing. American Documentation, 16, 4 (Oct 1965), 283--289.
• 4: Kushal Dave , Steve Lawrence , David M. Pennock, Mining the peanut gallery: opinion extraction and semantic classification of product reviews, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775226]
• 5: Soo-Min Kim , Eduard Hovy, Determining the sentiment of opinions, Proceedings of the 20th international conference on Computational Linguistics, p.1367-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220555]
• 6: Nan Hu , Paul A. Pavlou , Jennifer Zhang, Can online reviews reveal a product's true quality?: empirical findings and analytical modeling of Online word-of-mouth communication, Proceedings of the 7th ACM conference on Electronic commerce, p.324-330, June 11-15, 2006, Ann Arbor, Michigan, USA [doi>10.1145/1134707.1134743]
• 7: Minqing Hu , Bing Liu, Mining and summarizing customer reviews, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014073]
• 8: Kageura, K., Umino, B. Methods of Automatic Term Recognition: A Review. Terminology, 3, 2 (1996), 259--289.
• 9: Kohavi, R., Parekh, R. Ten Supplementary Analyses to Improve E-Commerce Web Sites. Proc. 5th WEBKDD Workshop, 2003.
• 10: Leech, G., Rayson, P., Wilson, A. Word Frequencies in Written and Spoken English: Based on the British National Corpus, Longman Press, 2001.
• 11: Bing Liu , Minqing Hu , Junsheng Cheng, Opinion observer: analyzing and comparing opinions on the Web, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060797]
• 12: Liu, H. MontyLingua: An End-To-End Natural Language Processor with Common Sense, Available at: http://web.media.mit.edu/~hugo/montylingua.
• 13: Matsuo, Y., Ishizuka, M. Keyword Extraction from a Single Document Using Word Co-Occurrence Statistical Information. Proc. 16th Intl. Florida AI Research Society, 2003, 392--396.
• 14: Satoshi Morinaga , Kenji Yamanishi , Kenji Tateishi , Toshikazu Fukushima, Mining product reputations on the Web, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775098]
• 15: Hiroshi Nakagawa , Tatsunori Mori, A simple but powerful automatic term extraction method, COLING-02 on COMPUTERM 2002: second international workshop on computational terminology, p.1-7, August 31, 2002 [doi>10.3115/1118771.1118778]
• 16: Ana-Maria Popescu , Oren Etzioni, Extracting product features and opinions from reviews, Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, p.339-346, October 06-08, 2005, Vancouver, British Columbia, Canada [doi>10.3115/1220575.1220618]
• 17: Vijay Raghavan , Peter Bollmann , Gwang S. Jung, A critical investigation of recall and precision as measures of retrieval system performance, ACM Transactions on Information Systems (TOIS), v.7 n.3, p.205-229, July 1989 [doi>10.1145/65943.65945]
• 18: S. E. Robertson , C. J. van Rijsbergen , M. F. Porter, Probabilistic models of indexing and searching, Proceedings of the 3rd annual ACM conference on Research and development in information retrieval, p.35-56, June 23-27, 1980, Cambridge, England
• 19: G. Salton , A. Wong , C. S. Yang, A vector space model for automatic indexing, Communications of the ACM, v.18 n.11, p.613-620, Nov. 1975 [doi>10.1145/361219.361220]
• 20: Scaffidi, C. Application of a Probability-Based Algorithm to Extraction of Product Features from Online Reviews. Tech. Report CMU-ISRI-06-111, School of Computer Science, Carnegie Mellon University, 2006.
• 21: Sista, S., Srinivasan, S. Polarized Lexicon for Review Classification. Proc. Intl. Conf. on Machine Learning, Models, Technologies & Applications, 2004.
• 22: Wackerly, D., Mendenhall, W., Scheaffer, R. Mathematical Statistics with Applications, Duxbury Press, 2001.
• 23: Wolfinbarger, M., Gilly, M. Consumer Motivations for Online Shopping. Proc. 6th Americas Conf. on Info. Sys., 2000, 1362--1366.
• 24: Harry Wu , Gerard Salton, A comparison of search term weighting: term relevance vs. inverse document frequency, Proceedings of the 4th annual international ACM SIGIR conference on Information storage and retrieval: theoretical issues in information retrieval, p.30-39, May 31-June 02, 1981, Oakland, California
• 25: Zahir, S. Designing a Knowledge-Based System for the Web to Support Consumers' Online Decisions. Proc. Intl. Conf. Comp. & Info. Tech., 2002, 381--386.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models; Search process

General Terms:
Algorithms, Design

Keywords:
e-commerce, feature extraction, product reviews, search