How people recall, recognize, and reuse search results

ABSTRACT

When a person issues a query, that person has expectations about the search results that will be returned. These expectations can be based on the current information need, but are also influenced by how the searcher believes the search engine works, where relevant results are expected to be ranked, and any previous searches the individual has run on the topic. This paper looks in depth at how the expectations people develop about search result lists during an initial query affect their perceptions of and interactions with future repeat search result lists. Three studies are presented that give insight into how people recall, recognize, and reuse results. The first study (a study of recall) explores what people recall about previously viewed search result lists. The second study (a study of recognition) builds on the first to reveal that people often recognize a result list as one they have seen before even when it is quite different. As long as those aspects that the searcher remembers about the initial list remain the same, other aspects can change significantly. This is advantageous because, as the third study (a study of reuse) shows, when a result list appears to have changed, people have trouble re-using the previously viewed content in the list. They are less likely to find what they are looking for, less happy with the result quality, more likely to find the task hard, and more likely to take a long time searching. Although apparent consistency is important for reuse, people's inability to recognize change makes consistency without stagnation possible. New relevant results can be presented where old results have been forgotten, making both old and new content easy to find.

REFERENCES

• 1: David Ahlström, Modeling and improving selection in cascading pull-down menus using Fitts' law, the steering law and force fields, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1054982]
• 2: Anne Aula , Natalie Jhaveri , Mika Käki, Information search and re-access strategies of experienced web users, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060831]
• 3: Bruce, H., Jones, W., and Dumais, S. 2004. Keeping and refinding information on the Web: What do people do and what do they need? In Proceedings of the 67th Annual Meeting of the American Society for Information Science and Technology (ASIS&T). Information Today, Medford, NJ.
• 4: Robert G. Capra, III , Manuel A. Pérez-Quiñones, Using Web Search Engines to Find and Refind Information, Computer, v.38 n.10, p.36-42, October 2005 [doi>10.1109/MC.2005.355]
• 5: Susan Dumais , Edward Cutrell , JJ Cadiz , Gavin Jancke , Raman Sarin , Daniel C. Robbins, Stuff I've seen: a system for personal information retrieval and re-use, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860451]
• 6: Paula Durlach, Change blindness and its implications for complex monitoring and control systems design and operator training, Human-Computer Interaction, v.19 n.4, p.423-451, December 2004 [doi>10.1207/s15327051hci1904_10]
• 7: Laura A. Granka , Thorsten Joachims , Geri Gay, Eye-tracking analysis of user behavior in WWW search, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009079]
• 8: Koichi Hayashi , Takahiko Nomura , Tan Hazama , Makoto Takeoka , Sunao Hashimoto , Stephan Gumundson, Temporally threaded workspace: a model for providing activity-based perspectives on document spaces, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.87-96, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276637]
• 9: Henson, R. 1998. Short-term memory for serial order: The start-end model. Cognitive Psych. 36, 73--137.
• 10: Thorsten Joachims , Laura Granka , Bing Pan , Helene Hembrooke , Geri Gay, Accurately interpreting clickthrough data as implicit feedback, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076063]
• 11: Jones, W. 2007. Personal information management. Ann. Rev. Inform. Science Tech. 41, 453--504.
• 12: Diane Kelly , Jaime Teevan, Implicit feedback for inferring user preference: a bibliography, ACM SIGIR Forum, v.37 n.2, p.18-28, Fall 2003 [doi>10.1145/959258.959260]
• 13: Komlodi, A. 2004. Task management support in information seeking: A case for search histories. Comput. Hum. Behav. 20, 163--184.
• 14: Anita Komlodi , Dagobert Soergel , Gary Marchionini, Search histories for user support in user interfaces, Journal of the American Society for Information Science and Technology, v.57 n.6, p.803-807, April 2006 [doi>10.1002/asi.v57:6]
• 15: David M. Levy, Fixed or fluid?: document stability and new media, Proceedings of the 1994 ACM European conference on Hypermedia technology, p.24-31, September 19-23, 1994, Edinburgh, Scotland [doi>10.1145/192757.192760]
• 16: Bonnie MacKay , Melanie Kellar , Carolyn Watters, An evaluation of landmarks for re-finding information on the web, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056978]
• 17: J. Mitchell , B. Shneiderman, Dynamic versus static menus: an exploratory comparison, ACM SIGCHI Bulletin, v.20 n.4, p.33-37, April 1989 [doi>10.1145/67243.67247]
• 18: Murdock, B. B. 1962. The serial position effect of free recall. J. Experi. Psych. 64, 482--488.
• 19: Lucy Nowell , Elizabeth Hetzler , Ted Tanasse, Change Blindness in Information Visualization: A Case Study, Proceedings of the IEEE Symposium on Information Visualization 2001 (INFOVIS'01), p.15, October 22-23, 2001
• 20: Hartmut Obendorf , Harald Weinreich , Eelco Herder , Matthias Mayer, Web page revisitation revisited: implications of a long-term click-stream study of browser usage, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240719]
• 21: Patil, S., Alpert, S. R., Karat, J., and Wolf, C. 2005. “THAT's what I was looking for”: Comparing user-rated relevance with search engine rankings. In Proceedings of the International Conference on Human-Computer Interaction (INTERACT'05), Costabile, M. F. and Paterno, F., Eds. Springer, Berlin, Germany, 117--129.
• 22: Jun Rekimoto, Time-machine computing: a time-centric approach for the information environment, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.45-54, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322582]
• 23: Sanderson, M. and Dumais S. 2007. Examining repetition in user search behavior. In Proceedings of the 29th European Conference on IR Research, Advances in Information Retrieval. Amati, G., Carpineto, C., and Romano, G., Eds. Springer, Berlin, Germany, 597--604.
• 24: Selberg, E. and Etzioni, O. 2000. On the instability of Web search engines. In Proceedings of the 6th Conference on Content-Based Multimedia Information Access, Recherche d'Informations Assistee par Ordinateur (RIAO'00), Mariani, J. and Harman, D., Eds. CID, Paris, France, 223--235.
• 25: Simons, D. J. and Rensink, R. A. 2005. Change blindness: Past, present, and future. Trends Cognitive Sciences 9, 1, 16--20.
• 26: Benjamin L. Somberg, A comparison of rule-based and positionally constant arrangements of computer menu items, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.255-260, April 05-09, 1987, Toronto, Ontario, Canada
• 27: Amanda Spink , Dietmar Wolfram , Major B. J. Jansen , Tefko Saracevic, Searching the Web: the public and their queries, Journal of the American Society for Information Science and Technology, v.52 n.3, p.226-234, Feb. 1, 2001 [doi>10.1002/1097-4571(2000)9999:9999<::AID-ASI1591>3.3.CO;2-I]
• 28: Jaime Teevan, How people recall search result lists, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125712]
• 29: Jaime Teevan, The re:search engine: simultaneous support for finding and re-finding, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294217]
• 30: Jaime Teevan , Eytan Adar , Rosie Jones , Michael A. S. Potts, Information re-retrieval: repeat queries in Yahoo's logs, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277770]
• 31: Tognazzini, B. 1999. A quiz designed to give you Fitts. http://asktog.com/columns/022Designed ToGiveFitts.html.
• 32: D. Alexander Varakin , Daniel T. Levin , Roger Fidler, Unseen and unaware: implications of recent research on failures of visual awareness for human-computer interface design, Human-Computer Interaction, v.19 n.4, p.389-422, December 2004 [doi>10.1207/s15327051hci1904_9]
• 33: Ryen W. White , Ian Ruthven , Joemon M. Jose, Finding relevant documents using top ranking sentences: an evaluation of two alternative schemes, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564389]
• 34: Gui-Rong Xue , Hua-Jun Zeng , Zheng Chen , Yong Yu , Wei-Ying Ma , WenSi Xi , WeiGuo Fan, Optimizing web search using web click-through data, Proceedings of the thirteenth ACM international conference on Information and knowledge management, November 08-13, 2004, Washington, D.C., USA [doi>10.1145/1031171.1031192]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: User issues

Keywords:
Refinding, dynamic information, personal information management, recall, recognition, reuse, search