Improved search engines and navigation preference in personal information management

ABSTRACT

Traditionally users access their personal files mainly by using folder navigation. We evaluate whether recent improvements in desktop search have changed this fundamental aspect of Personal Information Management (PIM). We tested this in two studies using the same questionnaire: (a) The Windows Studya longitudinal comparison of Google Desktop and Windows XP Search Companion, and (b) The Mac Studya large scale comparison of Mac Spotlight and Sherlock. There were few effects for improved search. First, regardless of search engine, there was a strong navigation preference: on average, users estimated that they used navigation for 56-68% of file retrieval events but searched for only 4-15% of events. Second, the effect of improving the quality of the search engine on search usage was limited and inconsistent. Third, search was used mainly as a last resort when users could not remember file location. Finally, there was no evidence that using improved desktop search engines leads people to change their filing habits to become less reliant on hierarchical file organization. We conclude by offering theoretical explanations for navigation preference, relating to differences between PIM and Internet retrieval, and suggest alternative design directions for PIM systems.

REFERENCES

• 1: Eytan Adar , David Karger , Lynn Andrea Stein, Haystack: per-user information environments, Proceedings of the eighth international conference on Information and knowledge management, p.413-422, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319950.323231]
• 2: Ame Elliott, Flamenco image browser: using metadata to improve image search during architectural design, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634112]
• 3: Deborah K. Barreau, Context as a factor in personal information management systems, Journal of the American Society for Information Science, v.46 n.5, p.327-339, June 1995 [doi>10.1002/(SICI)1097-4571(199506)46:5<327::AID-ASI4>3.0.CO;2-C]
• 4: Deborah Barreau , Bonnie A. Nardi, Finding and reminding: file organization from the desktop, ACM SIGCHI Bulletin, v.27 n.3, p.39-43, July 1995 [doi>10.1145/221296.221307]
• 5: Belkin, N. J., Cool, C., Stein, A., and Thiel, U. 1995. Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems. Expert Syst. Applic. 9, 379--395.
• 6: N. J. Belkin , P. G. Marchetti , C. Cool, Braque: design of an interface to support user interaction in information retrieval, Information Processing and Management: an International Journal, v.29 n.3, p.325-344, May–June, 1993 [doi>10.1016/0306-4573(93)90059-M]
• 7: Victoria Bellotti , Ian Smith, Informing the design of an information management system with iterative fieldwork, Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques, p.227-237, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347728]
• 8: Bergman, O. 2006. The use of subjective attributes in personal information management systems. PhD. dissertation, Tel Aviv University, Tel Aviv, 135.
• 9: Ofer Bergman , Ruth Beyth-Marom , Rafi Nachmias, The user-subjective approach to personal information management systems, Journal of the American Society for Information Science and Technology, v.54 n.9, p.872-878, June 2003 [doi>10.1002/asi.10283]
• 10: Ofer Bergman , Ruth Beyth-Marom , Rafi Nachmias, The project fragmentation problem in personal information management, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124813]
• 11: Ofer Bergman , Ruth Beyth-Marom , Rafi Nachmias, The user-subjective approach to personal information management systems design: Evidence and implementations, Journal of the American Society for Information Science and Technology, v.59 n.2, p.235-246, January 2008 [doi>10.1002/asi.v59:2]
• 12: Boardman, R. 2004. Improving tool support for personal information management. PhD. dissertation, Electrical and Electronic Engineering, Imperial College, London. 285.
• 13: Richard Boardman , M. Angela Sasse, "Stuff goes into the computer and doesn't come out": a cross-tool study of personal information management, Proceedings of the SIGCHI conference on Human factors in computing systems, p.583-590, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985766]
• 14: Robert G. Capra, III , Manuel A. Pérez-Quiñones, Using Web Search Engines to Find and Refind Information, Computer, v.38 n.10, p.36-42, October 2005 [doi>10.1109/MC.2005.355]
• 15: W. B. Croft , R. H. Thompson, I³R: a new approach to the design of document retrieval systems, Journal of the American Society for Information Science, v.38 n.6, p.389-404, Nov. 1987 [doi>10.1002/(SICI)1097-4571(198711)38:6<389::AID-ASI1>3.0.CO;2-4]
• 16: Edward Cutrell , Susan T. Dumais , Jaime Teevan, Searching to eliminate personal information management, Communications of the ACM, v.49 n.1, January 2006 [doi>10.1145/1107458.1107492]
• 17: Edward Cutrell , Daniel Robbins , Susan Dumais , Raman Sarin, Fast, flexible filtering with phlat, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124812]
• 18: Paul Dourish , W. Keith Edwards , Anthony LaMarca , John Lamping , Karin Petersen , Michael Salisbury , Douglas B. Terry , James Thornton, Extending document management systems with user-specific active properties, ACM Transactions on Information Systems (TOIS), v.18 n.2, p.140-170, April 2000 [doi>10.1145/348751.348758]
• 19: Paul Dourish , W. Keith Edwards , Anthony LaMarca , Michael Salisbury, Presto: an experimental architecture for fluid interactive document spaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.2, p.133-161, June 1999 [doi>10.1145/319091.319099]
• 20: Susan Dumais , Edward Cutrell , JJ Cadiz , Gavin Jancke , Raman Sarin , Daniel C. Robbins, Stuff I've seen: a system for personal information retrieval and re-use, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860451]
• 21: Farina, P. A. 2005. A comparison of two desktop search engines: Google Desktop Search (beta) vs. Windows XP Search Companion. In Proceedings of the 21st Computer Science Seminar. Hartford CT.
• 22: Scott Fertig , Eric Freeman , David Gelernter, “Finding and reminding” reconsidered, ACM SIGCHI Bulletin, v.28 n.1, p.66-69, Jan. 1996 [doi>10.1145/249170.249187]
• 23: Eric Freeman , David Gelernter, Lifestreams: a storage model for personal data, ACM SIGMOD Record, v.25 n.1, p.80-86, March 1996 [doi>10.1145/381854.381893]
• 24: M. E. Frisse , S. B. Cousins, Information retrieval from hypertext: update on the dynamic medical handbook project, Proceedings of the second annual ACM conference on Hypertext, p.199-212, November 1989, Pittsburgh, Pennsylvania, United States [doi>10.1145/74224.74241]
• 25: Jim Gemmell , Gordon Bell , Roger Lueder , Steven Drucker , Curtis Wong, MyLifeBits: fulfilling the Memex vision, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641053]
• 26: Marti A. Hearst, Clustering versus faceted categories for information exploration, Communications of the ACM, v.49 n.4, April 2006 [doi>10.1145/1121949.1121983]
• 27: William Jones , Ammy Jiranida Phuwanartnurak , Rajdeep Gill , Harry Bruce, Don't take my folders away!: organizing personal information to get ghings done, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056952]
• 28: Alison Kidd, The marks are on the knowledge worker, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.186-191, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191740]
• 29: David Kirk , Abigail Sellen , Carsten Rother , Ken Wood, Understanding photowork, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124885]
• 30: Mei Kobayashi , Koichi Takeda, Information retrieval on the web, ACM Computing Surveys (CSUR), v.32 n.2, p.144-173, June 2000 [doi>10.1145/358923.358934]
• 31: Lakoff, G. and Johnson, M. 1980. Metaphors We Live By. University of Chicago Press, Chicago, IL.
• 32: Lansdale, M. W. 1988. The psychology of personal information management. Appl. Ergonomics 19, 55--66.
• 33: Lowe, M. 2006. Evaluation of desktop search applications. Tech. rep. Kalio, Sydney, Australia.
• 34: Thomas W. Malone, How do people organize their desks?: Implications for the design of office information systems, ACM Transactions on Information Systems (TOIS), v.1 n.1, p.99-112, Jan. 1983 [doi>10.1145/357423.357430]
• 35: Christopher Olston , Ed H. Chi, ScentTrails: Integrating browsing and searching on the Web, ACM Transactions on Computer-Human Interaction (TOCHI), v.10 n.3, p.177-197, September 2003 [doi>10.1145/937549.937550]
• 36: Saverio Perugini , Naren Ramakrishnan, Interacting with Web Hierarchies, IT Professional, v.8 n.4, p.19-28, July 2006 [doi>10.1109/MITP.2006.91]
• 37: Piaget, J. 1928. Judgement and Reasoning in the Child. Routledge and Kegan Paul, London, UK.
• 38: Jef Raskin, The humane interface: new directions for designing interactive systems, ACM Press/Addison-Wesley Publishing Co., New York, NY, 2000
• 39: Pamela Ravasio , Sissel Guttormsen Schär , Helmut Krueger, In pursuit of desktop evolution: User problems and practices with modern desktop systems, ACM Transactions on Computer-Human Interaction (TOCHI), v.11 n.2, p.156-180, June 2004 [doi>10.1145/1005361.1005363]
• 40: Russell, D. and Lawrence, S. 2007. Search everything. In Personal information management, W. Jones and J. Teevan, Eds., University of Washington Press, Seattle, WA, 153--166.
• 41: Ben Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1997
• 42: Jaime Teevan , Christine Alvarado , Mark S. Ackerman , David R. Karger, The perfect search engine is not enough: a study of orienteering behavior in directed search, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985745]
• 43: Teevan, J., Capra, R. G., and Pérez-Quiñones, M. A. 2007. How people find personal information. In Personal Information Management, W. Jones and J. Teevan, Eds. University of Washington Press, Seattle, WA, 22--34.
• 44: Tulving, E. and Thomson, D. M. 1973. Encoding specificity and retrieval processes in episodic memory. Psych. Rev. 80, 342--373.
• 45: Steve Whittaker , Julia Hirschberg, The character, value, and management of personal paper archives, ACM Transactions on Computer-Human Interaction (TOCHI), v.8 n.2, p.150-170, June 2001 [doi>10.1145/376929.376932]
• 46: Steve Whittaker , Candace Sidner, Email overload: exploring personal information management of email, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.276-283, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238530]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  E. Data
  E.5 FILES
      Subjects: Sorting/searching; Organization/structure

General Terms:
Design, Human Factors, Measurement

Keywords:
Personal information management, files retrieval, navigation preference, personal search engines, search preference, user study