From x-rays to silly putty via Uranus: serendipity and its role in web search

ABSTRACT

The act of encountering information unexpectedly has long been identified as valuable, both as a joy in itself and as part of task-focused problem solving. There has been a concern that highly accurate search engines and targeted personalization may reduce opportunities for serendipity on the Web. We examine whether there is the potential for serendipitous encounters during Web search, and whether improving search relevance through personalization reduces this potential. By studying Web search query logs and the results people judge relevant and interesting, we find many of the queries people perform return interesting (potentially serendipitous) results that are not directly relevant. Rather than harming serendipity, personalization appears to identify interesting results in addition to relevant ones.

REFERENCES

• 1: Oscar De Bruijn , Robert Spence, A New Framework for Theory-Based Interaction Design Applied to Serendipitous Information Retrieval, ACM Transactions on Computer-Human Interaction (TOCHI), v.15 n.1, p.1-38, May 2008 [doi>10.1145/1352782.1352787]
• 2: Erdelez, S. Information encountering: It's more than just bumping into information, Bulletin of the American Society for Information Science 25,3(1999) 25--29.
• 3: Sanda Erdelez, Investigation of information encountering in the controlled research environment, Information Processing and Management: an International Journal, v.40 n.6, p.1013-1025, November 2004 [doi>10.1016/j.ipm.2004.02.002]
• 4: Foster, A.&Ford, N. Serendipity and information seeking: An empirical study, J. Documentation 59,3 (2003) 321--340.
• 5: Jonathan L. Herlocker , Joseph A. Konstan , Loren G. Terveen , John T. Riedl, Evaluating collaborative filtering recommender systems, ACM Transactions on Information Systems (TOIS), v.22 n.1, p.5-53, January 2004 [doi>10.1145/963770.963772]
• 6: Johnson, S. B. (2006), Can we please kill this meme now. Retrieved 14 Sep 2008: http://tinyurl.com/sbjohnson
• 7: McKeen, W. (2006), The endangered joy of serendipity, St. Petersburg Times Retrieved Sep 2008 http://tinyurl.com/mckeen
• 8: Ranie, L.&Shermak, J. (2005), Pew Internet and American Life Project: Data memo on search engine use. Retrieved 14 Sep 2008: http://pewinternet.org/pdfs/PIP_SearchData_1105.pdf
• 9: Badrul Sarwar , George Karypis , Joseph Konstan , John Reidl, Item-based collaborative filtering recommendation algorithms, Proceedings of the 10th international conference on World Wide Web, p.285-295, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372071]
• 10: Xuehua Shen , Bin Tan , ChengXiang Zhai, Implicit user modeling for personalized search, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099747]
• 11: Amanda Spink , Howard Greisdorf , Judy Bateman, From highly relevant to not relevant: examining different regions of relevance, Information Processing and Management: an International Journal, v.34 n.5, p.599-621, Sept. 1998 [doi>10.1016/S0306-4573(98)00025-9]
• 12: Teevan, J., Dumais, S.T.&Horvitz, E. Beyond the commons: on the value of personalizing Web search. Proc PIA'05, 84--92.
• 13: Jaime Teevan , Susan T. Dumais , Eric Horvitz, Personalizing search via automated analysis of interests and activities, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076111]
• 14: Toms, E. Serendipitous information retrieval, Proc of the First DELOS Network of Excellence Workshop on Information Seeking, Searching and Querying in Digital Libraries, 2000.
• 15: Van Andel, P. Anatomy of the Unsought Finding. Serendipity: Origin, history, domains, traditions, appearances, patterns and programmability, The British Journal for the Philosophy of Science45, 2 (1994), 631--648.
• 16: Wolfe, M., Schreiner, M., Rehder, B., Laham, D., Foltz, P., Kintsch, W.&Landauer, T. Learning from text: Matching readers and texts by Latent Semantic Analysis, Discourse Processes 25, (1998) 309--336.
• 17: Cai-Nicolas Ziegler , Sean M. McNee , Joseph A. Konstan , Georg Lausen, Improving recommendation lists through topic diversification, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060754]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Human Factors, Measurement

Keywords:
partially relevant results, personalization, serendipity, web search