Passage relevance models for genomics search

ABSTRACT

We present a passage relevance model for integrating semantic and statistical evidence of biomedical concepts and topics using a probabilistic graphical model. Component models of topics, concepts, terms, and document are represented as potential functions within a Markov Random Field. The probability of a passage being relevant to a biologist's information need is represented as the joint distribution across all potential functions. Relevance model feedback of top ranked passages is used to improve distributional estimates of concepts and topics in context, and a dimensional indexing strategy is used for efficient aggregation of concept and term statistics. By integrating multiple sources of evidence including dependencies between topics, concepts, and terms, we seek to improve genomics literature passage retrieval precision. Using this model, we are able to demonstrate statistically significant improvements in retrieval precision using a large genomics literature corpus.

REFERENCES

• 1: Azzopardi, L., Girolami, M., & van Rijsbergen, C. J. (2004). Topic Based Language Models for ad hoc Information Retrieval. Proceedings of the International Joint Conference on Neural Networks.
• 2: Blei, D., Jordan, M., & Ng, A. (2003). Hierarchical Bayesian models for applications in information retrieval, In: Bernardo, J. M., Bayarri, M., Berger, J. O., Dawid, A. P., Heckerman, D., Smith, A. F. M., & West, M. (Eds.), Bayesian Statistics 7.
• 3: James P. Callan, Passage-level evidence in document retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.302-310, July 03-06, 1994, Dublin, Ireland
• 4: W. Bruce Croft , Howard R. Turtle , David D. Lewis, The use of phrases and structured queries in information retrieval, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.32-45, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122864]
• 5: Demner-Fushman, D., Humphrey, S. M., Ide, N. C., Loane, R. F., Mork, J. G., Ruiz, M.E., Smith, L. H., Wilbur, W. J., Aronson, A. R., & Ruch, P. (2007). Combining Resources to Find Answers to Biomedical Questions. The Sixteenth Text REtrieval Conference Proceedings.
• 6: Firth, J. R. (1957). A Synopsis of Linguistic Theory, 1930-1955. Studies in Linguistic Analysis. Oxford: Blackwell, 1--32.
• 7: Jim Gray , Surajit Chaudhuri , Adam Bosworth , Andrew Layman , Don Reichart , Murali Venkatrao , Frank Pellow , Hamid Pirahesh, Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals, Data Mining and Knowledge Discovery, v.1 n.1, p.29-53, 1997 [doi>10.1023/A:1009726021843]
• 8: David A. Grossman , Ophir Frieder , David O. Holmes , David C. Roberts, Integrating structured data and text: a relational approach, Journal of the American Society for Information Science, v.48 n.2, p.122-132, Feb. 1997 [doi>10.1002/(SICI)1097-4571(199702)48:2<122::AID-ASI3>3.0.CO;2-#]
• 9: Hersh W., et al. (2007). TREC 2007 Genomics Track Overview. The Sixteenth Text REtrieval Conference Proceedings.
• 10: Berthier A. N. Ribeiro , Richard Muntz, A belief network model for IR, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.253-260, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243272]
• 11: Ittycheriah, A., & Roukos, S. (2001). IBM's Statistical Question Answering System. TREC-11.
• 12: Marcin Kaszkiel , Justin Zobel, Passage retrieval revisited, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, p.178-185, July 27-31, 1997, Philadelphia, Pennsylvania, United States
• 13: Ralph Kimball, The data warehouse toolkit: practical techniques for building dimensional data warehouses, John Wiley & Sons, Inc., New York, NY, 1996
• 14: Victor Lavrenko , W. Bruce Croft, Relevance based language models, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.120-127, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383972]
• 15: Jimmy Lin, The role of information retrieval in answering complex questions, Proceedings of the COLING/ACL on Main conference poster sessions, p.523-530, July 17-18, 2006, Sydney, Australia
• 16: Xiaoyong Liu , W. Bruce Croft, Cluster-based retrieval using language models, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009026]
• 17: Donald Metzler , W. Bruce Croft, A Markov random field model for term dependencies, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076115]
• 18: Porter, M. F. (1980). An algorithm for suffix stripping. Program, 14,130--137.
• 19: Rijsbergen, C. J. (1977). A theoretical basis for using co-occurrence data in information retrieval. Journal of Documentation, 33(2):106--119.
• 20: Robertson, S. (1977). The probability ranking principle in IR. Journal of Documentation, 33(4):294--303.
• 21: Schwartz, A., & Hearst, M. (2003). A simple algorithm for identifying abbreviation definitions in biomedical text. Pacific Symposium on Biocomputing.
• 22: Steyvers, M. (2006). Probabilistic Topic Models. In Landauer, T., McNamara, D., Dennis, S., & Kintch W. (eds), Latent Semantic Analysis: A Road to Meaning. Laurence Erlbaum.
• 23: Stefanie Tellex , Boris Katz , Jimmy Lin , Aaron Fernandes , Gregory Marton, Quantitative evaluation of passage retrieval algorithms for question answering, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860445]
• 24: Urbain, J., Goharian, N., & Frieder, O. (2006). IIT TREC-2006: Genomics Track. Proceedings of the Fifteenth Text REtrieval Conference.
• 25: Urbain, J., Goharian, N., & Frieder, O. (2007a, October). Combining Semantics, Context, and Statistical Evidence in Genomics Literature Search. IEEE 7th International Symposium on BioInformatics and BioEngineering.
• 26: Urbain, J., Goharian, N., & Frieder, O. (2007b, November). IIT TREC 2007 Genomics Track: Using Concept-Based Semantics in Context for Genomics Literature Passage Retrieval. The Sixteenth Text REtrieval Conference (TREC 2007) Conference Proceedings.
• 27: Jay Urbain , Nazli Goharian , Ophir Frieder, Probabilistic passage models for semantic search of genomics literature, Journal of the American Society for Information Science and Technology, v.59 n.12, p.2008-2023, October 2008 [doi>10.1002/asi.v59:12]
• 28: Jay Urbain , Ophir Frieder , Nazli Goharian, Passage relevance models for genomics search, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA [doi>10.1145/1458082.1458277]
• 29: Xing Wei , W. Bruce Croft, LDA-based document models for ad-hoc retrieval, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148204]
• 30: David Yarowsky, Word-sense disambiguation using statistical models of Roget's categories trained on large corpora, Proceedings of the 14th conference on Computational linguistics, August 23-28, 1992, Nantes, France [doi>10.3115/992133.992140]
• 31: Zhou, W., & Yu, C. (2007, November). TREC Genomics Track at UIC. The Sixteenth Text REtrieval Conference Proceedings.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Experimentation, Theory

Keywords:
dimensional modeling, genomics search, graphical models, information retrieval, passage retrieval, relevance modeling, semantic search