A bayesian learning approach to promoting diversity in ranking for biomedical information retrieval

ABSTRACT

In this paper, we propose a Bayesian learning approach to promoting diversity for information retrieval in biomedicine and a re-ranking model to improve retrieval performance in the biomedical domain. First, the re-ranking model computes the maximum posterior probability of the hidden property corresponding to each retrieved passage. Then it iteratively groups the passages into subsets according to their properties. Finally, these passages are re-ranked from the subsets as our output. There is no need for our proposed method to use any external biomedical resource. We evaluate our Bayesian learning approach by conducting extensive experiments on the TREC 2004-2007 Genomics data sets. The experimental results show the effectiveness of the proposed Bayesian learning approach for promoting diversity in ranking for biomedical information retrieval on four years TREC data sets.

REFERENCES

• 1: M. Beaulieu, M.Gatford, X. Huang, S. Robertson, S. Walker and P. Williams (1997). Okapi at TREC--5. In Proc. of TREC-5, NIST Special Publication, Nov. 1997. pp.143--166.
• 2: Stefan Buttcher, Charles L. A. Clarke and Gordon V. Cormack (2004). Domain-Specific Synonym Expansion and Validation for Biomedical Information Retrieval (MultiText Experiments for TREC 2004). Proc. of TREC-13, 2004.
• 3: Jaime Carbonell , Jade Goldstein, The use of MMR, diversity-based reranking for reordering documents and producing summaries, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.335-336, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291025]
• 4: Dina Demner-Fushman et al (2007). Combining resources to find answers to biomedical questions. In Proc. of TREC-16, NIST Special Publication, Nov. 2007.
• 5: Andrew B. Goldberg et al (2006). Ranking Biomedical Passages for Relevance and Diversity. In Proc. of TREC-15, NIST Special Publication, Nov. 2006.
• 6: William Hersh et al (2005). TREC 2005 Genomics Track Overview. In Proc. of TREC-14, NIST Special Publication, Gaithersburg, MD, Nov. 2005.
• 7: William Hersh et al (2007). TREC 2007 Genomics Track Overview. In Proc. of TREC-16, NIST Special Publication, Gaithersburg, MD, Nov. 2007.
• 8: Qinmin Hu and Xiangji Huang (2009). Passage Extraction and Result Combination for Genomics Information Retrieval. To appear in Journal of Intelligent Information Systems, 2009.
• 9: Xiangji Huang, Ming Zhong and Si Luo (2005). York University at TREC 2005: Genomics Track. In Proc. of TREC-14, NIST Special Publication, Gaithersburg, MD, November 2005.
• 10: Xiangji Huang, Bin Hu and Hashmat Rohian (2006). York University at TREC 2006: Genomics Track. In Proc. of TREC-15, NIST Special Publication, Gaithersburg, MD, November 2006.
• 11: Xiangji Huang , Yan Rui Huang , Miao Wen , Aijun An , Yang Liu , Josiah Poon, Applying Data Mining to Pseudo-Relevance Feedback for High Performance Text Retrieval, Proceedings of the Sixth International Conference on Data Mining, p.295-306, December 18-22, 2006 [doi>10.1109/ICDM.2006.22]
• 12: Xiangji Huang , Miao Wen , Aijun An , Yan-Rui Huang, A platform for Okapi-based contextual information retrieval, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148341]
• 13: Harold Jeffreys (1961). Theory of Probability, 3rd Edition, Oxford University Press, 1961.
• 14: J. B. MacQueen (1967). Some Methods for Classification and Analysis of Multivariate Observations. Proc. of 5th Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, University of California Press, pp 281--297, 1967.
• 15: S. E. Robertson , S. Walker, Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.232-241, July 03-06, 1994, Dublin, Ireland
• 16: Cheng Xiang Zhai , William W. Cohen , John Lafferty, Beyond independent relevance: methods and evaluation metrics for subtopic retrieval, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860440]
• 17: Yi Zhang , Jamie Callan , Thomas Minka, Novelty and redundancy detection in adaptive filtering, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564393]
• 18: Benyu Zhang , Hua Li , Yi Liu , Lei Ji , Wensi Xi , Weiguo Fan , Zheng Chen , Wei-Ying Ma, Improving web search results using affinity graph, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076120]
• 19: Ming Zhong , Xiangji Huang, Concept-based biomedical text retrieval, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148336]
• 20: Wei Zhou and Clement Yu (2007). TREC Genomics Track at UIC. In Proc. of TREC-16, NIST Special Publication, Gaithersburg, MD, Nov. 2007.
• 21: X. Zhu et al (2007). Improving Diversity in Ranking Using Absorbing Random Walks. Proc. of NAACL-HLT, Rochester, USA, April 22-27, 2007.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms

Keywords:
beyesian learning, biomedical IR, promoting diversity