Entity discovery and assignment for opinion mining applications

ABSTRACT

Opinion mining became an important topic of study in recent years due to its wide range of applications. There are also many companies offering opinion mining services. One problem that has not been studied so far is the assignment of entities that have been talked about in each sentence. Let us use forum discussions about products as an example to make the problem concrete. In a typical discussion post, the author may give opinions on multiple products and also compare them. The issue is how to detect what products have been talked about in each sentence. If the sentence contains the product names, they need to be identified. We call this problem entity discovery. If the product names are not explicitly mentioned in the sentence but are implied due to the use of pronouns and language conventions, we need to infer the products. We call this problem entity assignment. These problems are important because without knowing what products each sentence talks about the opinion mined from the sentence is of little use. In this paper, we study these problems and propose two effective methods to solve the problems. Entity discovery is based on pattern discovery and entity assignment is based on mining of comparative sentences. Experimental results using a large number of forum posts demonstrate the effectiveness of the technique. Our system has also been successfully tested in a commercial setting.

REFERENCES

• 1: Johan Bos , Malvina Nissim, An empirical approach to the interpretation of superlatives, Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, July 22-23, 2006, Sydney, Australia
• 2: Kushal Dave , Steve Lawrence , David M. Pennock, Mining the peanut gallery: opinion extraction and semantic classification of product reviews, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775226]
• 3: Denis, P., and Baldridge, J, A Ranking Approach to Pronoun Resolution, IJCAI'07, 2007.
• 4: Xiaowen Ding , Bing Liu , Philip S. Yu, A holistic lexicon-based approach to opinion mining, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA [doi>10.1145/1341531.1341561]
• 5: Esuli, A., and Sebastiani, F. Determining Term Subjectivity and Term Orientation for Opinion Mining, EACL'06, 2006.
• 6: Ronen Feldman , Moshe Fresco , Jacob Goldenberg , Oded Netzer , Lyle Ungar, Extracting Product Comparisons from Discussion Boards, Proceedings of the 2007 Seventh IEEE International Conference on Data Mining, p.469-474, October 28-31, 2007 [doi>10.1109/ICDM.2007.27]
• 7: Murthy Ganapathibhotla , Bing Liu, Mining opinions in comparative sentences, Proceedings of the 22nd International Conference on Computational Linguistics, p.241-248, August 18-22, 2008, Manchester, United Kingdom
• 8: Jiawei Han, Data Mining: Concepts and Techniques, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005
• 9: Vasileios Hatzivassiloglou , Kathleen R. McKeown, Predicting the semantic orientation of adjectives, Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, p.174-181, July 07-12, 1997, Madrid, Spain
• 10: Minqing Hu , Bing Liu, Mining and summarizing customer reviews, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014073]
• 11: Jing Jiang , ChengXiang Zhai, Exploiting domain structure for named entity recognition, Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, p.74-81, June 04-09, 2006, New York, New York [doi>10.3115/1220835.1220845]
• 12: Nitin Jindal , Bing Liu, Mining comparative sentences and relations, proceedings of the 21st national conference on Artificial intelligence, p.1331-1336, July 16-20, 2006, Boston, Massachusetts
• 13: Kaji, N., and Kitsuregawa, M. Building Lexicon for Sentiment Analysis from Massive Collection of HTML Documents. EMNLP'07, 2007.
• 14: Hiroshi Kanayama , Tetsuya Nasukawa, Fully automatic lexicon expansion for domain-oriented sentiment analysis, Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, July 22-23, 2006, Sydney, Australia
• 15: Soo-Min Kim , Eduard Hovy, Determining the sentiment of opinions, Proceedings of the 20th international conference on Computational Linguistics, p.1367-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220555]
• 16: John D. Lafferty , Andrew McCallum , Fernando C. N. Pereira, Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data, Proceedings of the Eighteenth International Conference on Machine Learning, p.282-289, June 28-July 01, 2001
• 17: Qiaozhu Mei , Xu Ling , Matthew Wondra , Hang Su , ChengXiang Zhai, Topic sentiment mixture: modeling facets and opinions in weblogs, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242596]
• 18: Ng, V. Supervised ranking for pronoun resolution: Some recent improvements. AAAI'05, 2005.
• 19: Bo Pang , Lillian Lee , Shivakumar Vaithyanathan, Thumbs up?: sentiment classification using machine learning techniques, Proceedings of the ACL-02 conference on Empirical methods in natural language processing, p.79-86, July 06, 2002 [doi>10.3115/1118693.1118704]
• 20: Ana-Maria Popescu , Oren Etzioni, Extracting product features and opinions from reviews, Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, p.339-346, October 06-08, 2005, Vancouver, British Columbia, Canada [doi>10.3115/1220575.1220618]
• 21: Ellen Riloff , Janyce Wiebe, Learning extraction patterns for subjective expressions, Proceedings of the 2003 conference on Empirical methods in natural language processing, p.105-112, July 11, 2003 [doi>10.3115/1119355.1119369]
• 22: Sarawagi, S. Information Extraction (Survey). Forthcoming.
• 23: Peter D. Turney, Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073153]
• 24: Wiebe, J., and Riloff, E. Creating Subjective and Objective sentence classifiers from unannotated texts. CICLing, 2005.
• 25: Xiaofeng Yang , Jian Su , Chew Lim Tan, Improving pronoun resolution using statistics-based semantic compatibility information, Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, p.165-172, June 25-30, 2005, Ann Arbor, Michigan [doi>10.3115/1219840.1219861]
• 26: http://crf.sourceforge.net/
• 27: http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=NE

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Text analysis

General Terms:
Algorithms, Experimentation

Keywords:
entity discovery, sentiment analysis