Ranking opinionated blog posts using OpinionFinder

ABSTRACT

The aim of an opinion finding system is not just to retrieve relevant documents, but to also retrieve documents that express an opinion towards the query target entity. In this work, we propose a way to use and integrate an opinion-identification toolkit, OpinionFinder, into the retrieval process of an Information Retrieval (IR) system, such that opinionated, relevant documents are retrieved in response to a query. In our experiments, we vary the number of top-ranked documents that must be parsed in response to a query, and investigate the effect on opinion retrieval performance and required parsing time. We find that opinion finding retrieval performance is improved by integrating OpinionFinder into the retrieval system, and that retrieval performance grows as more posts are parsed by OpinionFinder. However, the benefit eventually tails off at a deep rank, suggesting that an optimal setting for the system has been achieved.

REFERENCES

• 1: D. Hannah, C. Macdonald, B. He, J. Peng, and I. Ounis. University of Glasgow at TREC 2007: Experiments in Blog and Enterprise Tracks with Terrier. In Proceedings of TREC 2007.
• 2: C. Macdonald, I. Ounis, and I. Soboroff. Overview of the TREC 2007 Blog Track. In Proceedings of TREC 2007.
• 3: C. Macdonald, and I. Ounis. The TREC Blog06 Collection : Creating and Analysing a Blog Test Collection DCS Technical Report TR-2006-224. University of Glasgow. 2006.
• 4: I. Ounis, M. de Rijke, C. Macdonald, G. Mishne, and I. Soboroff. Overview of the TREC 2006 Blog Track. In Proceedings of TREC 2006.
• 5: I. Ounis, G. Amati, V. Plachouras, B. He, C. Macdonald, and C. Lioma. Terrier: A High Performance and Scalable Information Retrieval Platform. In Proceedings of OSIR 2006.
• 6: J. Rennie, L. Shih, J. Teevan, and D. Karger. Tackling the Poor Assumptions of Naive Bayes Text Classifiers. In Proceedings of ICML 2003.
• 7: Ellen Riloff , Janyce Wiebe, Learning extraction patterns for subjective expressions, Proceedings of the 2003 conference on Empirical methods in natural language processing, p.105-112, July 11, 2003 [doi>10.3115/1119355.1119369]
• 8: Theresa Wilson , Paul Hoffmann , Swapna Somasundaran , Jason Kessler , Janyce Wiebe , Yejin Choi , Claire Cardie , Ellen Riloff , Siddharth Patwardhan, OpinionFinder: a system for subjectivity analysis, Proceedings of HLT/EMNLP on Interactive Demonstrations, p.34-35, October 07-07, 2005, Vancouver, British Columbia, Canada [doi>10.3115/1225733.1225751]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Experimentation, Performance

Keywords:
blogs, opinion finding