Sentiment analysis of blogs by combining lexical knowledge with text classification

ABSTRACT

The explosion of user-generated content on the Web has led to new opportunities and significant challenges for companies, that are increasingly concerned about monitoring the discussion around their products. Tracking such discussion on weblogs, provides useful insight on how to improve products or market them more effectively. An important component of such analysis is to characterize the sentiment expressed in blogs about specific brands and products. Sentiment Analysis focuses on this task of automatically identifying whether a piece of text expresses a positive or negative opinion about the subject matter. Most previous work in this area uses prior lexical knowledge in terms of the sentiment-polarity of words. In contrast, some recent approaches treat the task as a text classification problem, where they learn to classify sentiment based only on labeled training data. In this paper, we present a unified framework in which one can use background lexical information in terms of word-class associations, and refine this information for specific domains using any available training examples. Empirical results on diverse domains show that our approach performs better than using background knowledge or training data in isolation, as well as alternative approaches to using lexical knowledge with text classification.

REFERENCES

• 1: Rakesh Agrawal , Roberto J. Bayardo, Jr. , Ramakrishnan Srikant, Athena: Mining-Based Interactive Management of Text Database, Proceedings of the 7th International Conference on Extending Database Technology: Advances in Database Technology, p.365-379, March 27-31, 2000
• 2: Blogpulse: A service of nielsen buzzmetrics. http://www.blogpulse.com/.
• 3: R. T. Clemen and R. L. Winkler. Combining probability distributions from experts in risk analysis. Risk Analysis, 19:187--203, 1999.
• 4: W. Dai, G.-R. Xue, Q. Yang, and Y. Yu. Transferring naive Bayes classifiers for text classification. In AAAI, 2007.
• 5: S. Das and M. Chen. Yahoo! for Amazon: Extracting market sentiment from stock message boards. In Asia Pacific Finance Association, 2001.
• 6: Aynur Dayanik , David D. Lewis , David Madigan , Vladimir Menkov , Alexander Genkin, Constructing informative prior distributions from domain knowledge in text classification, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148255]
• 7: Gregory Druck , Gideon Mann , Andrew McCallum, Learning from labeled features using generalized expectation criteria, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390436]
• 8: K. T. Durant and M. D. Smith. Advances in Web Mining and Web Usage Analysis, chapter Predicting the Political Sentiment of Web Log Posts Using Supervised Machine Learning Techniques Coupled with Feature Selection. Springer, 2007.
• 9: Extracting the main content from a webpage. http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/.
• 10: S. French. Group consensus probability distributions: A critical survey. In Bayesian Statistics 2, pages 183--197. North-Holland, 1985.
• 11: C. Genest and J. V. Zidek. Combining probability distributions: A critique and an annotated bibliography. Statistical Science, 1:114--135, 1986.
• 12: Minqing Hu , Bing Liu, Mining and summarizing customer reviews, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014073]
• 13: Soo-Min Kim , Eduard Hovy, Determining the sentiment of opinions, Proceedings of the 20th international conference on Computational Linguistics, p.1367-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220555]
• 14: B. Liu. Web Data Mining. Springer, 2007.
• 15: Bing Liu , Xiaoli Li , Wee Sun Lee , Philip S. Yu, Text classification by labeling words, Proceedings of the 19th national conference on Artifical intelligence, p.425-430, July 25-29, 2004, San Jose, California
• 16: A. McCallum and K. Nigam. A comparison of event models for naive Bayes text classification. In AAAI Workshop on Text Categorization, 1998.
• 17: Vincent Ng , Sajib Dasgupta , S. M. Niaz Arifin, Examining the role of linguistic knowledge sources in the automatic identification and classification of reviews, Proceedings of the COLING/ACL on Main conference poster sessions, p.611-618, July 17-18, 2006, Sydney, Australia
• 18: Kanal Paul Nigam , Tom M. Mitchell, Using unlabeled data to improve text classification, Carnegie Mellon University, Pittsburgh, PA, 2001
• 19: Bo Pang , Lillian Lee, A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts, Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, p.271-es, July 21-26, 2004, Barcelona, Spain [doi>10.3115/1218955.1218990]
• 20: Bo Pang , Lillian Lee , Shivakumar Vaithyanathan, Thumbs up?: sentiment classification using machine learning techniques, Proceedings of the ACL-02 conference on Empirical methods in natural language processing, p.79-86, July 06, 2002 [doi>10.3115/1118693.1118704]
• 21: M. F. Porter, An algorithm for suffix stripping, Readings in information retrieval, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
• 22: Ganesh Ramakrishnan , Apurva Jadhav , Ashutosh Joshi , Soumen Chakrabarti , Pushpak Bhattacharyya, Question Answering via Bayesian inference on lexical relations, Proceedings of the ACL 2003 workshop on Multilingual summarization and question answering, p.1-10, July 11, 2003, Sapporo, Japan [doi>10.3115/1119312.1119313]
• 23: Robert E. Schapire, The Strength of Weak Learnability, Machine Learning, v.5 n.2, p.197-227, Jun. 1990 [doi>10.1023/A:1022648800760]
• 24: Robert E. Schapire , Marie Rochery , Mazin G. Rahim , Narendra Gupta, Incorporating Prior Knowledge into Boosting, Proceedings of the Nineteenth International Conference on Machine Learning, p.538-545, July 08-12, 2002
• 25: Jude W. Shavlik, Combining Symbolic and Neural Learning, Machine Learning, v.14 n.3, p.321-331, March 1994 [doi>10.1023/A:1022665814563]
• 26: Vikas Sindhwani , Prem Melville, Document-Word Co-regularization for Semi-supervised Sentiment Analysis, Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, p.1025-1030, December 15-19, 2008 [doi>10.1109/ICDM.2008.113]
• 27: Scott Spangler , Ying Chen , Larry Proctor , Ana Lelescu , Amit Behal , Bin He , Thomas D. Griffin , Anna Liu , Brad Wade , Trevor Davis, COBRA - Mining Web for Corporate Brand and Reputation Analysis, Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence, p.11-17, November 02-05, 2007 [doi>10.1109/WI.2007.34]
• 28: Peter D. Turney, Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073153]
• 29: Theresa Wilson , Janyce Wiebe , Paul Hoffmann, Recognizing contextual polarity in phrase-level sentiment analysis, Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, p.347-354, October 06-08, 2005, Vancouver, British Columbia, Canada [doi>10.3115/1220575.1220619]
• 30: R. L. Winkler. The consensus of subjective probability distributions. Management Science, 15:361--375, 1968.
• 31: Xiaoyun Wu , Rohini Srihari, Incorporating prior knowledge with weighted margin support vector machines, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014089]
• 32: Hong Yu , Vasileios Hatzivassiloglou, Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences, Proceedings of the 2003 conference on Empirical methods in natural language processing, p.129-136, July 11, 2003 [doi>10.3115/1119355.1119372]
• 33: Li Zhuang , Feng Jing , Xiao-Yan Zhu, Movie review mining and summarization, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA [doi>10.1145/1183614.1183625]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models

General Terms:
Algorithms, Economics, Experimentation

Keywords:
background knowledge, blog analysis, dual supervision, movie reviews, naive bayes, opinion mining, political blogs, prior knowledge, sentiment analysis, technology blogs, text mining