Generating hypotheses from the web

ABSTRACT

Hypothesis generation is a crucial initial step for making scientific discoveries. This paper addresses the problem of automatically discovering interesting hypotheses from the web. Given a query containing one or two entities of interest, our algorithm automatically generates a semantic profile describing the specified entity or provides the potential connections between two entities of interest. We implemented a prototype on top of the Google search engine and the experimental results demonstrate the effectiveness of our algorithms.

REFERENCES

• 1: Don R. Swanson, Complementary structures in disjoint science literatures, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.280-289, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122889]
• 2: Smalheiser, N. R. The Arrowsmith Project: 2005 Status Report. Discovery Science 2005: 26--43.
• 3: Padmini Srinivasan, Text mining: generating hypotheses from MEDLINE, Journal of the American Society for Information Science and Technology, v.55 n.5, p.396-413, March 2004 [doi>10.1002/asi.10389]
• 4: Fernando Das-Neves , Edward A. Fox , Xiaoyan Yu, Connecting topics in document collections with stepping stones and pathways, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099573]
• 5: Gang Luo , Chunqiang Tang , Ying-li Tian, Answering relationship queries on the web, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242648]
• 6: Jin, W., Srihari, R. K., Ho, H. and Wu, X. Improving Knowledge Discovery in Document Collections through Combining Text Retrieval and Link Analysis Techniques. (ICDM'07), pp.193--202.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Algorithms, Experimentation

Keywords:
hypothesis generation, link analysis, web search