CiteSeer: an autonous Web agent for automatic retrieval and identification of interesting publications

ABSTRACT

Research papers available on the World Wide Web (WWW or Web) are often poorly organized, often exist in forms opaque to search engines (e.g. Postscript), and increase in quantity daily. Significant amounts of time and effort are typically needed in order to find interesting and relevant publications on the Web. We have developed a Web based information agent that assists the user in the process of performing a scientific literature search. Given a set of keywords, the agent uses Web search engines and heuristics to locate and download papers. The papers are parsed in order to extract information features such as the abstract and individually identified citations. The agents Web interface can be used to find relevant papers in the database using keyword searches, or by navigating the links between papers formed by the citations. Links to both citing and cited publications can be followed. In addition to simple browsing and keyword searches, the agent can find papers which are similar to a given paper using word information and by analyzing common citations made by the papers.

REFERENCES

• 1: Institute for scientific information (http://www. isinet.com), 1997.
• 2: Keycite (http://www.westgroup.com/keycite/), 1997.
• 3: Marko Balabanović, An adaptive Web page recommendation service, Proceedings of the first international conference on Autonomous agents, p.378-385, February 05-08, 1997, Marina del Rey, California, United States [doi>10.1145/267658.267744]
• 4: CAMERON, R. D, A universal citation database as a catalyst for reform in scholarly communication. First Monday (February 1997).
• 5: EDWARDS, P., GREEN, C. L., LOCKIER, P. C., AND LUKINS, T. Exploiting learning technologies for World Wide Web agents, In IEEE Colloquium on intelligent World Wide Web Agents, Digest No: 97/118 (March 1997).
• 6: GARFIELD, E. The concept of citation indexing: A unique and innovative tool for navigating the research literature. Current Contents January 3 (1994).
• 7: LEVENSHTEIN, V. I. Binary codes capable of correcting spurious insertions and deletions of ones (original in Russian). Russian Problemy Peredachi lnfonnatsii 1 (3anuary 1965), 12-25.
• 8: LOKE, S. W., DAVlSON, A., AND STERLING, L. ClFI: An intelligent agent for citation finding on the World-Wide Web. Technical Report 96~4 Dept. of Computer Science, University of Melbourne, 1996.
• 9: Filippo Menczer, ARCCHNID: Adaptive Retrieval Agents Choosing Heuristic Neighborhoods, Proceedings of the Fourteenth International Conference on Machine Learning, p.227-235, July 08-12, 1997
• 10: MOUKAS, A. Amalthaea: Information discovery and filtering using a multiagent evolving ecosystem. In Proceedings of the Cottference on Practical Applications of Agents and Mul. tlagent Technology (April 1996).
• 11: PAZZANI, M,, MURAMATSU, J., AND BILLSUS, D. "Syskill & Webert; Identifying interesting Web sites". In Proceedhtgs of the National Conference on Artificial Intelligence (AAA I96) (1996),
• 12: PORTER, M, F. "an algorithm for suffix stripping". Program 14 (3 1980), 130--137.
• 13: Salton, G. Automatic indexing using bibliographic citations, Journal of Docmnentation 27 (2 1971), 98-110.
• 14: Gerard Salton , Chris Buckley, Term Weighting Approaches in Automatic Text Retrieval, Cornell University, Ithaca, NY, 1987
• 15: SALTON, G,, AND YANG, C. On the specification of term values in automatic indexing. Journal of Documentation 29 (April 1973), 351-372.
• 16: Ellen Spertus, ParaSite: mining structural information on the Web, Selected papers from the sixth international conference on World Wide Web, p.1205-1215, September 1997, Santa Clara, California, United States
• 17: STARR, B., ACKERMAN, M. S., AND PAZZANI, M. Do-I- Care: Tell me what's changed on the Web. In Proceedings of the AAAI Spring Symposium on Machine Learning in lnfor. mation Access Technical Papers (March 1996).
• 18: Yianilos, P. The Likelt intelligent string comparison facility. NEC Institute Tech Report 97-093, 1997.
• 19: Peter N. Yianilos, Data structures and algorithms for nearest neighbor search in general metric spaces, Proceedings of the fourth annual ACM-SIAM Symposium on Discrete algorithms, p.311-321, January 25-27, 1993, Austin, Texas, United States

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.11 Distributed Artificial Intelligence
            Subjects: Intelligent agents

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods
      H.3.3 Information Search and Retrieval
          Subjects: Search process
      H.3.4 Systems and Software

          Nouns: World Wide Web (WWW)

General Terms:
Algorithms, Languages