Adaptive subjective triggers for opinionated document retrieval

ABSTRACT

This paper proposes a novel application of a statistical language model to opinionated document retrieval targeting weblogs (blogs). In particular, we explore the use of the trigger model---originally developed for incorporating distant word dependencies---in order to model the characteristics of personal opinions that cannot be properly modeled by standard n-grams. Our primary assumption is that there are two constituents to form a subjective opinion. One is the subject of the opinion or the object that the opinion is about, and the other is a subjective expression; the former is regarded as a triggering word and the latter as a triggered word. We automatically identify those subjective trigger patterns to build a language model from a corpus of product customer reviews. Experimental results on the TREC Blog Track test collections show that, when used for reranking initial search results, our proposed model significantly improves opinionated document retrieval by over 20% in MAP. In addition, we report on an experiment on dynamic adaptation of the model to a given query, which is found effective for most of difficult queries categorized under politics and organizations.

REFERENCES

• 1: Eytan Adar , Lada A. Adamic, Tracking Information Epidemics in Blogspace, Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence, p.207-214, September 19-22, 2005 [doi>10.1109/WI.2005.151]
• 2: Nitin Agarwal , Huan Liu , Lei Tang , Philip S. Yu, Identifying the influential bloggers in a community, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA [doi>10.1145/1341531.1341559]
• 3: Xiaowen Ding , Bing Liu , Philip S. Yu, A holistic lexicon-based approach to opinion mining, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA [doi>10.1145/1341531.1341561]
• 4: Jonathan L. Elsas , Jaime Arguello , Jamie Callan , Jaime G. Carbonell, Retrieval and feedback models for blog feed search, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390394]
• 5: A. Esuli and F. Sebastiani. PageRanking WordNet synsets: An application to opinion mining. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, 2007.
• 6: D. Hannah, C. Macdonald, J. Peng, B. He, and I. Ounis. University of Glasgow at TREC 2007: Experiments in blog and enterprise tracks with Terrier. In Proceesings of the 16th Text Retrieval Conference, 2007.
• 7: Nitin Jindal , Bing Liu, Opinion spam and analysis, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA [doi>10.1145/1341531.1341560]
• 8: Daniel Jurafsky , James H. Martin, Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, Prentice Hall PTR, Upper Saddle River, NJ, 2000
• 9: R. Lau, R. Rosenfeld, and S. Roukos. Trigger-based language models: a maximum entropy approach. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 2, pages 45--48, 1993.
• 10: Victor Lavrenko , W. Bruce Croft, Relevance based language models, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.120-127, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383972]
• 11: Craig Macdonald , Ben He , Iadh Ounis , Ian Soboroff, Limits of opinion-finding baseline systems, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390483]
• 12: C. Macdonald, I. Ounis, and I. Soboroff. Overview of the TREC-2007 blog track. In Proceesings of the 16th Text Retrieval Conference, 2007.
• 13: Christopher D. Manning , Hinrich Schütze, Foundations of statistical natural language processing, MIT Press, Cambridge, MA, 1999
• 14: Qiaozhu Mei , Xu Ling , Matthew Wondra , Hang Su , ChengXiang Zhai, Topic sentiment mixture: modeling facets and opinions in weblogs, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242596]
• 15: Donald Metzler , W. Bruce Croft, Combining the language model and inference network approaches to retrieval, Information Processing and Management: an International Journal, v.40 n.5, p.735-750, September 2004 [doi>10.1016/j.ipm.2004.05.001]
• 16: G. Mishne. Multiple ranking strategies for opinion retrieval in blogs. In Proceesings of the 15th Text Retrieval Conference, 2006.
• 17: D. Oard, T. Elsayed, J. Wang, Y. Wu, P. Zhang, E. Abels, J. Lin, and D. Soergel. TREC-2006 at Maryland: Blog, enterprise, legal and QA tracks. In Proceesings of the 15th Text Retrieval Conference, 2006.
• 18: I. Ounis, M. de Rijke, C. Macdonald, G. Mishne, and I. Soboroff. Overview of the TREC-2006 blog track. In Proceesings of the 15th Text Retrieval Conference, 2006.
• 19: Tetsuya Sakai , Toshihiko Manabe , Makoto Koyama, Flexible pseudo-relevance feedback via selective sampling, ACM Transactions on Asian Language Information Processing (TALIP), v.4 n.2, p.111-135, June 2005 [doi>10.1145/1105696.1105699]
• 20: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 21: K. Seki, Y. Kino, S. Sato, and K. Uehara. TREC 2007 blog track experiments at Kobe University. In Proceesings of the 16th Text Retrieval Conference, 2007.
• 22: Kazuhiro Seki , Javed Mostafa, An application of text categorization methods to gene ontology annotation, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076060]
• 23: K. Sparck Jones. Statistical interpretation of term specificity and its application in retrieval. Journal of Documentation, 28(1):11--20, 1972.
• 24: Tao Tao , ChengXiang Zhai, Regularized estimation of mixture models for robust pseudo-relevance feedback, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148201]
• 25: Christoph Tillmann , Hermann Ney, Selection criteria for word trigger pairs in language modelling, Proceedings of the 3rd International Colloquium on Grammatical Inference: Learning Syntax from Sentences, p.95-106, September 25-27, 1996
• 26: O. Vechtomova. Using subjective adjectives in opinion retrieval from blogs. In Proceesings of the 16th Text Retrieval Conference, 2007.
• 27: K. Yang, N. Yu, A. Valerio, and H. Zhang. WIDIT in trec-2006 blog track. In Proceesings of the 15th Text Retrieval Conference, 2006.
• 28: K. Yang, N. Yu, and H. Zhang. WIDIT in TREC 2007 blog track: Combining lexicon-based methods to detect opinionated blogs. In Proceesings of the 16th Text Retrieval Conference, 2007.
• 29: Min Zhang , Xingyao Ye, A generation model to unify topic relevance and lexicon-based sentiment for opinion retrieval, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390405]
• 30: W. Zhang and C. Yu. UIC at TREC 2006 blog track. In Proceesings of the 15th Text Retrieval Conference, 2006.
• 31: Wei Zhang , Clement Yu , Weiyi Meng, Opinion retrieval from blogs, Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10, 2007, Lisbon, Portugal [doi>10.1145/1321440.1321555]
• 32: G. Zhou, H. Joshi, and C. Bayrak. Topic categorization for relevancy and opinion detection. In Proceesings of the 16th Text Retrieval Conference, 2007.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Selection process

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Language models; Text analysis

General Terms:
Algorithms, Experimentation, Languages

Keywords:
opinion retrieval, trigger language models, weblog