STARTS: Stanford proposal for Internet meta-searching

ABSTRACT

Document sources are available everywhere, both within the internal networks of organizations and on the Internet. Even individual organizations use search engines from different vendors to index their internal document collections. These search engines are typically incompatible in that they support different query models and interfaces, they do not return enough information with the query results for adequate merging of the results, and finally, in that they do not export metadata about the collections that they index (e.g., to assist in resource discovery). This paper describes STARTS, an emerging protocol for Internet retrieval and search that facilitates the task of querying multiple document sources. STARTS has been developed in a unique way. It is not a standard, but a group effort coordinated by Stanford's Digital Library project, and involving over 11 companies and organizations. The objective of this paper is not only to give an overview of the STARTS protocol proposal, but also to discuss the process that led to its definition.

REFERENCES

• 1: Luis Gravano , Kevin Chang , Hector Garcia-Molina , Andreas Paepcke, STARTS: Stanford Protocol Proposal for Internet Retrieval and Search, Stanford University, Stanford, CA, 1997
• 2: Gerard Salton, Automatic text processing: the transformation, analysis, and retrieval of information by computer, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 3: Kevin Chen-Chuan Chang , Hector Garcia-Molina , Andreas Paepcke, Boolean Query Mapping Across Heterogeneous Information Sources, IEEE Transactions on Knowledge and Data Engineering, v.8 n.4, p.515-521, August 1996 [doi>10.1109/69.536244]
• 4: Chen Chang , Hector Garcia-Molina , Andreas Paepcke, Predicate Rewriting for Translating Boolean Queries in a Heterogeneous Information System, Stanford University, Stanford, CA, 1998
• 5: James P. Callan , Zhihong Lu , W. Bruce Croft, Searching distributed collections with inference networks, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.21-28, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215328]
• 6: Ellen M. Voorhees, Narendra K. Gupta, and Ben Johnson-Laird. The collection fusion problem. In Proceedings o} the 3~a Text Retrieval Conlerence (TREC- 3), 1995.
• 7: Luis Gravano , Héctor García-Molina , Anthony Tomasic, The effectiveness of GIOSS for the text database discovery problem, Proceedings of the 1994 ACM SIGMOD international conference on Management of data, p.126-137, May 24-27, 1994, Minneapolis, Minnesota, United States
• 8: Luis Gravano , Hector Garcia-Molina, Generalizing GlOSS to Vector-Space Databases and Broker Hierarchies, Proceedings of the 21th International Conference on Very Large Data Bases, p.78-89, September 11-15, 1995
• 9: CORPORATE National Information Standards Organization Staff, Information Retrieval: Application Service Definition and Protocol Specification, Z39.50-1995, NISO Press, 1995
• 10: ZDSR profile: Z39.50 profile for simple distributed search and ranked retrieval, Draft 4, October 1996. Accessible at http://lcweb.loc.gov/z3950/agency/- prof iles/zdsr .html.
• 11: C. Mic Bowman, Peter B. Danzig, Darren R. Hardy, Udi Manber, Michael F. Schwartz, and Duane P. Wessels. Harvest: A scalable, customizable discovery and access system. Technical Report CU-CS-732-94, Department of Computer Science, University of Colorado, Boulder, Colorado, August 1994. Accessible at http ://harvest. transarc, coml.
• 12: Darren Hardy. Resource description messages (RDM), July 1996. Accessible at http://www.w3.org/pub/- WWW / T R/NO TE- rdm. h t ml.
• 13: Z39.50 Maintenance Agency. Attribute set Bib-1 (Z39.50-1995): Semantics. Accessible at ftp://- ftp.loc.gov/pub/z3950/defs/b~bl.txt, September 1995.
• 14: Stuart Weibel, Jean Godby, Eric Miller, and Ron Daniel, Jr. OCLC/NCSA metadata workshop report. Accessible at http://www.oclc.org:5047/- oc i c / r e search/pub i i c at i ons /w e i bel/me tadat a/- dublin_core_report.html, March 1995.
• 15: Carl Lagoze , Clifford A. Lynch , Ron Daniel, Jr., The Warwick Framework: A Container Architecture for Aggregating Sets of Metadata, Cornell University, Ithaca, NY, 1996
• 16: Efiot Christian. Application profile for the government information locator service (GILS), Version 2, October 1996. Accessible at http://www.usgs.gov/gils/- prof_v2 .html.
• 17: Erik Selberg and Oren Etzioni. Multi-service search and comparison using the MetaCrawler. In Proceedings oJ the 4th International WWW Conference, 1995.
• 18: Andreas Paepcke, Steve B. Cousins, Hdctor Garo'a- Molina, Scott W. Hassan, Steven K. K etchpel, Martin RSscheisen, and Terry Winograd. Towards interoperability in digital libraries: Overview and selected highfights of the Stanford Digital Library Project. IEEE Computer Magazine, May 1996.
• 19: MicheUe Baldonado, Chen-Chuan K. Chang, Luis Gravano, and Andreas Paepcke. The Stanford Digital Library Metadata Architecture. Technical Report SIDL-WP-1996-0051, StanfordUniversity, October 1996.To appear in the International Journal of Digital Libraries; accessible at http://w~-diglib.stanford.edu/cgi-bin/- WP/get/SIDL-NP- 1996-005 I.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Query processing
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Information networks

General Terms:
Design, Documentation, Languages, Management, Performance, Standardization, Theory