Connecting topics in document collections with stepping stones and pathways

ABSTRACT

In this paper, we present Stepping Stones and Pathways (SSP), an alternative model of building and presenting answers for the cases when queries on document collections cannot be answered just by a ranked list. Stepping Stones can handle questions like: "What is the relation of topics X and Y?" SSP addresses when the contents of a small set of related documents is needed as an answer rather than a single document, or when "query splitting" is required to satisfactorily explore a document space. Query results are networks of document groups representing topics, each group relating to and connecting (by documents) to other groups in the network. Thus, a network answers the user's information need. We devise new and more effective representations and techniques to visualize such answers, and to involve users as part of the answer-finding process. In order to verify the validity of our approach, and since the questions we aim to answer involve multiple topics, we performed a study involving a custom built broad collection of operating systems research papers, and evaluated the results with interested computer science students, using multiple measures.

REFERENCES

• 1: Borodin, A., Kerr. L., Lews, F. Query Splitting in Relevance Feedback Systems. Scientific Report No. ISR-14, Dept. of Computer Science, Cornell University, Ithaca NY, 1968.
• 2: Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
• 3: Das Neves, F. Stepping Stones and Pathways: Improving Retrieval by Chains of Relationships between Documents. PhD Dissertation, Virginia Tech, 2004.
• 4: Garfield, E. Essays of an Information Scientist, Vol. 1, pp.84--90, 1965.
• 5: Garfield, E. ABCs of Cluster Mapping. Part 1: Most Active Field in the Life Sciences in 1978. In Essays of an Information Scientist, Vol. 4 (Oct. 1980) pp. 634--641.
• 6: C. Lee Giles , Kurt D. Bollacker , Steve Lawrence, CiteSeer: an automatic citation indexing system, Proceedings of the third ACM conference on Digital libraries, p.89-98, June 23-26, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276675.276685]
• 7: Michael D. Gordon , Susan Dumais, Using latent semantic indexing for literature based discovery, Journal of the American Society for Information Science, v.49 n.8, p.674-685, June 1998 [doi>10.1002/(SICI)1097-4571(199806)49:8<674::AID-ASI2>3.0.CO;2-Q]
• 8: Robert K. Lindsay , Michael D. Gordon, Literature-based discovery by lexical statistics, Journal of the American Society for Information Science, v.50 n.7, p.574-587, May 15, 1999 [doi>10.1002/(SICI)1097-4571(1999)50:7<574::AID-ASI3>3.0.CO;2-Q]
• 9: Morickz M., Marais J., Hensinger M., Silverstein C. Analysis of a Very Large Alta Vista Query Log. Technical Report 1998-014 COMPAQ Systems Research, 1998.
• 10: Naren Ramakrishnan , Deept Kumar , Bud Mishra , Malcolm Potts , Richard F. Helm, Turning CARTwheels: an alternating algorithm for mining redescriptions, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014083]
• 11: Mark A. Spasser, The enacted fate of undiscovered public knowledge, Journal of the American Society for Information Science, v.48 n.8, p.707-717, Aug. 1997 [doi>10.1002/(SICI)1097-4571(199708)48:8<707::AID-ASI4>3.3.CO;2-B]
• 12: Amanda Spink , Dietmar Wolfram , Major B. J. Jansen , Tefko Saracevic, Searching the Web: the public and their queries, Journal of the American Society for Information Science and Technology, v.52 n.3, p.226-234, Feb. 1, 2001 [doi>10.1002/1097-4571(2000)9999:9999<::AID-ASI1591>3.3.CO;2-I]
• 13: Swanson, D. Two Medical Literatures that are logically but not Bibliographically Connected. JASIS 38(4), pp. 228--233, 1987.
• 14: Don R. Swanson , Neil R. Smalheiser , A. Bookstein, Information discovery from complementary literatures: categorizing viruses as potential weapons, Journal of the American Society for Information Science and Technology, v.52 n.10, p.797-812, August 2001 [doi>10.1002/asi.1135.abs]
• 15: Raúl E. Valdés-Pérez, Discovery tools for science apps, Communications of the ACM, v.42 n.11, p.37-41, Nov. 1999 [doi>10.1145/319382.319389]
• 16: Michael David Williams, What makes RABBIT run?, International Journal of Man-Machine Studies, v.21 n.4, p.333-352, Oct. 1984 [doi>10.1016/S0020-7373(84)80052-8]
• 17: Oren Zamir , Oren Etzioni, Web document clustering: a feasibility demonstration, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.46-54, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290956]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Design, Experimentation

Keywords:
cluster labeling, collection building from syllabi, pathways, query splitting, stepping stones, suffix-tree clustering