Modeling search response time

ABSTRACT

Modeling the response time of search engines is an important task for many applications such as resource selection in federated text search. Limited research has been conducted to address this task. Prior research calculated the search response time of all queries in the same way either with the average response time of several sample queries or with a single probability distribution, which is irrelevant to the characteristics of queries. However, the search response time may vary a lot for different types of queries. This paper proposes a novel query-specific and source-specific approach to model search response time. Some training data is acquired by measuring the search response time of some sample queries from a search engine. Then, a query-specific model is estimated with the training data and their corresponding response times by utilizing Ridge Regression. The obtained model can be used to predict search response times for new queries. A set of empirical studies are conducted to show the effectiveness of the proposed method.

REFERENCES

• 1: J. Callan. Distributed information retrieval. Advances in Information Retrieval, pages 127--150, 2000.
• 2: Daniel Dreilinger , Adele E. Howe, Experiences with selecting search engines using metasearch, ACM Transactions on Information Systems (TOIS), v.15 n.3, p.195-222, July 1997 [doi>10.1145/256163.256164]
• 3: J. French, A. Powell, and J. Callan. Effective and Efficient Automatic Database Selection. 1999.
• 4: Arthur E. Hoerl , Robert W. Kennard, Ridge regression: biased estimation for nonorthogonal problems, Technometrics, v.42 n.1, p.80-86, Feb. 2000 [doi>10.2307/1271436]
• 5: Kartik Hosanagar, A utility theoretic approach to determining optimal wait times in distributed information retrieval, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076052]
• 6: Alan L. Montgomery , Kartik Hosanagar , Ramayya Krishnan , Karen B. Clay, Designing a Better Shopbot, Management Science, v.50 n.2, p.189-206, February 2004 [doi>10.1287/mnsc.1030.0151]
• 7: Clement Yu , King-Lup Liu , Weiyi Meng , Zonghuan Wu , Naphtali Rishe, A Methodology to Retrieve Text Documents from Multiple Databases, IEEE Transactions on Knowledge and Data Engineering, v.14 n.6, p.1347-1361, November 2002 [doi>10.1109/TKDE.2002.1047772]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Experimentation, Performance, Theory

Keywords:
response time, ridge regression, source selection