Static reformulation: a user study of static hypertext for query-based reformulation

ABSTRACT

Hypertext allows users to navigate between related materials in digital libraries. The most fundamental automated hypertexts are those constructed on the basis of semantic similarity. Such hypertexts have been evaluated by a variety of means, but seldom by real users given simulated real-world tasks. We claim that while other methods exist, one of the best ways to prove the usefulness of hypertext is to show the benefits for users performing realistic tasks. We compare the reformulation of queries that users perform in keyword searching, to the query reformulation implicit in browsing between documents linked by similarity of content. We find that a static automatically-constructed similarity hypertext provides useful linking between related items, improving the retrieval of targets when used to augment standard keyword search.

REFERENCES

• 1: Maristella Agosti , Fabio Crestani , Massimo Melucci, On the use of information retrieval techniques for the automatic construction of hypertext, Information Processing and Management: an International Journal, v.33 n.2, p.133-144, March 1997 [doi>10.1016/S0306-4573(96)00058-1]
• 2: Einat Amitay , Adam Darlow , David Konopnicki , Uri Weiss, Queries as anchors: selection by association, Proceedings of the sixteenth ACM conference on Hypertext and hypermedia, September 06-09, 2005, Salzburg, Austria [doi>10.1145/1083356.1083393]
• 3: Barabàsi, A. Linked: The New Science of Networks. Perseus Publishing, Cambridge, MA, 2002.
• 4: F. C. Berger , P. Van Bommel , Th. P. Van Der Weide, Ranking Strategies for Navigation Based Query Formulation, Journal of Intelligent Information Systems, v.12 n.1, p.5-25, April 1999 [doi>10.1023/A:1026412702628]
• 5: Bhavnani, S. K., Drabenstott, K. and Radev, D. Towards a Unified Framework of IR Tasks and Strategies. In Proceedings of the 2001 ASIST Annual Meeting, 2001.
• 6: Bodner, R. C. and Chignell, M. H. ClickIR: Text Retrieval using a Dynamic Hypertext Interface. In Text REtrieval Conference 1998: 506--515.
• 7: Rodrigo A. Botafogo , Ehud Rivlin , Ben Shneiderman, Structural analysis of hypertexts: identifying hierarchies and useful metrics, ACM Transactions on Information Systems (TOIS), v.10 n.2, p.142-180, April 1992 [doi>10.1145/146802.146826]
• 8: F. Crestani, Application of Spreading Activation Techniques in InformationRetrieval, Artificial Intelligence Review, v.11 n.6, p.453-482, Dec. 1997 [doi>10.1023/A:1006569829653]
• 9: Gene Golovchinsky, What the query told the link: the integration of hypertext and information retrieval, Proceedings of the eighth ACM conference on Hypertext, p.67-74, April 06-11, 1997, Southampton, United Kingdom [doi>10.1145/267437.267445]
• 10: Google Desktop API. http://desktop.google.com/developer.html
• 11: Google Guide: Similar Pages. http://www.googleguide.com/similar_pages.html
• 12: Stephen J. Green, Building Hypertext Links By Computing Semantic Similarity, IEEE Transactions on Knowledge and Data Engineering, v.11 n.5, p.713-730, September 1999 [doi>10.1109/69.806932]
• 13: Hawkins, D. T. and Wagers, R. Online bibliographic search strategy development. Online, 6 (3). 12--19, 1982.
• 14: Scott Henninger, Using Iterative Refinement to Find Reusable Software, IEEE Software, v.11 n.5, p.48-59, September 1994 [doi>10.1109/52.311059]
• 15: Hunt, E. and Waller, D. "Orientation and Wayfinding: A Review," Office of Naval Research, Arlington, VA, Tech. Rep. N00014-96-0380, 1999.
• 16: Jansen, B. J., Spink, A., Bateman, J. and Saracevic, T. What do they Search for on the Web and how are they Searching: A Study of a Large Sample of Excite Searches. In Proceedings of SIGIR 1998: 5--17.
• 17: William P. Jones , George W. Furnas, Pictures of relevance: a geometric analysis of similarity measures, Journal of the American Society for Information Science, v.38 n.6, p.420-442, Nov. 1987 [doi>10.1002/(SICI)1097-4571(198711)38:6<420::AID-ASI3>3.0.CO;2-S]
• 18: Richard W. Kopak, Functional link typing in hypertext, ACM Computing Surveys (CSUR), v.31 n.4es, Dec. 1999 [doi>10.1145/345966.346005]
• 19: Gary Marchionini, Information seeking in electronic environments, Cambridge University Press, New York, NY, 1995
• 20: Christopher Olston , Ed H. Chi, ScentTrails: Integrating browsing and searching on the Web, ACM Transactions on Computer-Human Interaction (TOCHI), v.10 n.3, p.177-197, September 2003 [doi>10.1145/937549.937550]
• 21: Saverio Perugini , Marcos André Gonçalves , Edward A. Fox, Recommender Systems Research: A Connection-Centric Survey, Journal of Intelligent Information Systems, v.23 n.2, p.107-143, September 2004 [doi>10.1023/B:JIIS.0000039532.05533.99]
• 22: Reuters--21578 Test Collection. http://www.daviddlewis.com/resources/testcollections/reuters21578
• 23: Salton, G. and Allan, J. Automatic Text Decomposition and Structuring. In Proceedings of the RIAO Conference: Intelligent Text and Image handling 1994: 6--20.
• 24: Smeaton, A. F. Building Hypertexts Under the Influence of Topology Metrics. In IWHD'95: International Workshop on Hypermedia Design 1995: 105--106.
• 25: Jaime Teevan , Christine Alvarado , Mark S. Ackerman , David R. Karger, The perfect search engine is not enough: a study of orienteering behavior in directed search, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985745]
• 26: Text REtrieval Conference (TREC) Home Page. http://trec.nist.gov/
• 27: TweakGDS Google Desktop Search Plug-in. http://desktop.google.com/plugins/tweakgds.html
• 28: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 29: Ross Wilkinson , Alan F. Smeaton, Automatic link generation, ACM Computing Surveys (CSUR), v.31 n.4es, Dec. 1999 [doi>10.1145/345966.346024]
• 30: Michael David Williams, What makes RABBIT run?, International Journal of Man-Machine Studies, v.21 n.4, p.333-352, Oct. 1984 [doi>10.1016/S0020-7373(84)80052-8]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

General Terms:
Experimentation, Human Factors

Keywords:
associative similarity networks, automatically-constructed hypertext, query by reformulation, search versus browse