Multiple approaches to analysing query diversity

ABSTRACT

In this paper we examine user queries with respect to diversity: providing a mix of results across different interpretations. Using two query log analysis techniques (click entropy and reformulated queries), 14.9 million queries from the Microsoft Live Search log were analysed. We found that a broad range of query types may benefit from diversification. Additionally, although there is a correlation between word ambiguity and the need for diversity, the range of results users may wish to see for an ambiguous query stretches well beyond traditional notions of word sense.

REFERENCES

• 1: Rakesh Agrawal , Sreenivas Gollapudi , Alan Halverson , Samuel Ieong, Diversifying search results, Proceedings of the Second ACM International Conference on Web Search and Data Mining, February 09-12, 2009, Barcelona, Spain [doi>10.1145/1498759.1498766]
• 2: Erik Vee , Utkarsh Srivastava , Jayavel Shanmugasundaram , Prashant Bhat , Sihem Amer Yahia, Efficient Computation of Diverse Query Results, Proceedings of the 2008 IEEE 24th International Conference on Data Engineering, p.228-236, April 07-12, 2008 [doi>10.1109/ICDE.2008.4497431]
• 3: Ruihua Song , Zhenxiao Luo , Jian-Yun Nie , Yong Yu , Hsiao-Wuen Hon, Identification of ambiguous queries in web search, Information Processing and Management: an International Journal, v.45 n.2, p.216-229, March, 2009 [doi>10.1016/j.ipm.2008.09.005]
• 4: Filip Radlinski , Susan Dumais, Improving personalized web search using result diversification, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148320]
• 5: Mark Sanderson, Ambiguous queries: test collections need more sense, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390420]
• 6: Charles L.A. Clarke , Maheedhar Kolla , Gordon V. Cormack , Olga Vechtomova , Azin Ashkan , Stefan Büttcher , Ian MacKinnon, Novelty and diversity in information retrieval evaluation, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390446]
• 7: Jing Bai , Jian-Yun Nie, Adapting information retrieval to query contexts, Information Processing and Management: an International Journal, v.44 n.6, p.1901-1922, November, 2008 [doi>10.1016/j.ipm.2008.07.006]
• 8: R. Richardson and A.F. Smeaton, "Using WordNet in a Knowledge--Based Approach to Information Retrieval," In Proceedings of the BCS-IRSG Colloquium, Crewe, 1995.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Experimentation, Measurement

Keywords:
ambiguity, diversity