An empirical evaluation of user interfaces for topic management of Web sites

ABSTRACT

Topic management is the task of gathering, evaluating, organizing, and sharing a set of web sites for a specific topic. Current web tools do not provide adequate support for this task. We created the TopicShop system to address this need. TopicShop includes (1) a webcrawler that discovers relevant web sites and builds site profiles, and (2) user interfaces for exploring and organizing sites. We conducted an empirical study comparing user performance with TopicShop vs. YahooTM. TopicShop subjects found over 80% more high-quality sites (where quality was determined by independent expert judgements) while browsing only 8 1% as many sites and completing their task in 89% of the time. The site profile data that TopicShop provides - in particular, the number of pages on a site and the number of other sites that link to it - was the key to these results, as users exploited it to identify the most promising sites quickly and easily.

REFERENCES

• 1: David Abrams , Ron Baecker , Mark Chignell, Information archiving with bookmarks: personal Web space construction and organization, Proceedings of the SIGCHI conference on Human factors in computing systems, p.41-48, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274651]
• 2: Michelle Q. Wang Baldonado , Terry Winograd, SenseMaker: an information-exploration interface supporting the contextual evolution of a user's interests, Proceedings of the SIGCHI conference on Human factors in computing systems, p.11-18, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258563]
• 3: Stuart K. Card , George G. Robertson , William York, The WebBook and the Web Forager: an information workspace for the World-Wide Web, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.111-ff., April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238446]
• 4: S. Jeromy Carrière , Rick Kazman, WebQuery: searching and visualizing the Web through connectivity, Selected papers from the sixth international conference on World Wide Web, p.1257-1267, September 1997, Santa Clara, California, United States
• 5: Garfield, E. Citation Indexing. ISI Press, Philadelphia, PA, 1979.
• 6: Jansen, B. J., Spink, A., Bateman, J., and Saracevic, T. Searchers, the Subjects They Search, and Sufficiency: A Study of a Large Sample of EXCITE Searches, submitted to WebNet'98.
• 7: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, p.668-677, January 25-27, 1998, San Francisco, California, United States
• 8: Jock D. Mackinlay , Ramana Rao , Stuart K. Card, An organic user interface for searching citation links, Proceedings of the SIGCHI conference on Human factors in computing systems, p.67-73, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223913]
• 9: Deborah Barreau , Bonnie A. Nardi, Finding and reminding: file organization from the desktop, ACM SIGCHI Bulletin, v.27 n.3, p.39-43, July 1995 [doi>10.1145/221296.221307]
• 10: Peter Pirolli , James Pitkow , Ramana Rao, Silk from a sow's ear: extracting usable structures from the Web, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.118-125, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238450]
• 11: Peter Pirolli , Patricia Schank , Marti Hearst , Christine Diehl, Scatter/gather browsing communicates the topic structure of a very large text collection, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.213-220, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238489]
• 12: James Pitkow , Peter Pirolli, Life, death, and lawfulness on the electronic frontier, Proceedings of the SIGCHI conference on Human factors in computing systems, p.383-390, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258805]
• 13: Loren Terveen , Will Hill, Finding and visualizing inter-site clan graphs, Proceedings of the SIGCHI conference on Human factors in computing systems, p.448-455, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274705]
• 14: Loren Terveen , Will Hill, Evaluating emergent collaboration on the Web, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.355-362, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289510]
• 15: What is twURL ? http://www.roir.com/whatis.html

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Web-based interaction

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

General Terms:
Design, Management, Verification

Keywords:
computer supported cooperative work, human-computer interaction, information access, information retrieval, information visualization, social filtering