Using librarian techniques in automatic text summarization for information retrieval

ABSTRACT

A current application of automatic text summarization is to provide an overview of relevant documents coming from an information retrieval (IR) system. This paper examines how Centrifuser, one such summarization system, was designed with respect to methods used in the library community. We have reviewed these librarian expert techniques to assist information seekers and codified them into eight distinct strategies. We detail how we have operationalized six of these strategies in Centrifuser by computing an informative extract, indicative differences between documents, as well as navigational links to narrow or broaden a user's query. We conclude the paper with results from a preliminary evaluation.

REFERENCES

• 1: E. Amitay. What Lays in the Layout: Using anchor-paragraph arrangements to extract descriptions of Web documents. PhD thesis, Macquarie University, Sydney, Australia, Unpublished
• 2: ANSI. American national standard for describing books in advertisements, catalogs, promotional materials and book jackets. New York, USA, 1979
• 3: R. Balay, editor. Guide to Reference Books. American Library Association, Chicago, USA, 11th edition edition, 1996
• 4: M. J. Bates. Information search tactics. Journal of the American Society for Information Science, 30(7):205--214, 79
• 5: C. Borgman. Why are online catalogs hard to use? lessons learned from information-retrieval studies. Journal of the American Society for Information Science, 37(6):387--400, 1986
• 6: Matthew Chalmers , Paul Chitson, Bead: explorations in information visualization, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.330-337, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133215]
• 7: Junyan Ding , Luis Gravano , Narayanan Shivakumar, Computing Geographical Scopes of Web Resources, Proceedings of the 26th International Conference on Very Large Data Bases, p.545-556, September 10-14, 2000
• 8: R. Fidel. Writing abstracts for free-text searching. Journal of Documentation, 42(1):11--21, March 1986
• 9: V. Hatzivassiliglou, J. L. Klavans, M. L. Holcombe, R. Barzilay, M.-Y. Kan, and K. R. McKeown. Simfinder: A flexible clustering tool for summarization. In Proc. of the Workshop on Automatic Summarization, NAACL 2001, 2001
• 10: Marti A. Hearst, TileBars: visualization of term distribution information in full text information access, Proceedings of the SIGCHI conference on Human factors in computing systems, p.59-66, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223912]
• 11: E. Z. Jennerich and E. J. Jennerich. The Reference Interview as a Creative Art. Libraries Unlimited, Littleton, Colorado, 1987
• 12: M.-Y. Kan, K. McKeown, and J. Klavans. Domain-specific informative and indicative summarization for information retrieval. In Proc. of the Document Understanding Conference (DUC), pages 19--26, New Orleans, USA, 2001
• 13: W. A. Katz, editor. Introduction to Reference Work. McGraw-Hill, New York, USA, fifth edition edition, 1987
• 14: Jürgen Koenemann , Nicholas J. Belkin, A case for interaction: a study of interactive information retrieval behavior and effectiveness, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.205-212, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238487]
• 15: Library of Congress. Marc 21 format for classification data : including guidelines for content designation. Washington, D.C., USA, 2000. ISN 0660179903
• 16: Elizabeth DuRoss Liddy, The discourse-level structure of empirical abstracts: an exploratory study, Information Processing and Management: an International Journal, v.27 n.1, p.55-81, Jan. 1991 [doi>10.1016/0306-4573(91)90031-G]
• 17: Simon Lok , Steven K. Feiner, The AIL automated interface layout system, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502757]
• 18: Inderjeet Mani , Eric Bloedorn, Summarizing Similarities and Differences Among Related Documents, Information Retrieval, v.1 n.1-2, p.35-67, 1999 [doi>10.1023/A:1009930203452]
• 19: Kathleen R. McKeown , Shih-Fu Chang , James Cimino , Steven Feiner , Carol Friedman , Luis Gravano , Vasileios Hatzivassiloglou , Steven Johnson , Desmond A. Jordan , Judith L. Klavans , André Kushniruk , Vimla Patel , Simone Teufel, PERSIVAL, a system for personalized search and summarization over multimedia healthcare information, Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries, p.331-340, January 2001, Roanoke, Virginia, United States [doi>10.1145/379437.379722]
• 20: Emile Morse , Michael Lewis , Kai A. Olsen, Testing visual information retrieval methodologies case study: comparative analysis of textual, icon, graphical, and "spring" displays, Journal of the American Society for Information Science and Technology, v.53 n.1, p.28-40, January 1, 2002 [doi>10.1002/asi.10006]
• 21: B. Nicolas J. Interaction with texts: Information retrieval as information-seeking behavior. Information Retrieval, pages 55--66, 1993
• 22: ODP. Open Directory Project guidelines. http://dmoz.org/guidelines.html, Last accessed November 2000
• 23: C. D. Paice, Constructing literature abstracts by computer: techniques and prospects, Information Processing and Management: an International Journal, v.26 n.1, p.171-186, 1990 [doi>10.1016/0306-4573(90)90014-S]
• 24: Diane H. Sonnenwald, Developing a theory to guide the process of designing information retrieval systems, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.310-317, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133213]
• 25: C. Witcombe. Art history resources on the web. http://witcombe.sbc.edu/ARTHLinks.html, Last accessed January 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries
          Subjects: User issues

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Text analysis

Keywords:
automatic text summarization, information retrieval user interfaces, reference librarian techniques