Building an open source meta-search engine

ABSTRACT

In this short paper we introduce Helios, a flexible and efficient open source meta-search engine. Helios currently runs on the top of 18 search engines (in Web, Books, News, and Academic publication domains), but additional search engines can be easily plugged in. We also report some performance mesured during its development.

REFERENCES

• 1: Chidlovskii. System and method for improving answer relevance in meta-search engines. U.S. Pat. 6829599, 2004.
• 2: Ronald Fagin , Ravi Kumar , Mohammad Mahdian , D. Sivakumar , Erik Vee, Comparing and aggregating rankings with ties, Proceedings of the twenty-third ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 14-16, 2004, Paris, France [doi>10.1145/1055558.1055568]
• 3: Paolo Ferragina , Antonio Gulli, A personalized search engine based on web-snippet hierarchical clustering, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062760]
• 4: A. Gulli , A. Signorini, The indexable web is more than 11.5 billion pages, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062789]
• 5: Steve Lawrence , C. Lee Giles, Inquirus, the NECI meta search engine, Proceedings of the seventh international conference on World Wide Web 7, p.95-105, April 1998, Brisbane, Australia
• 6: Weiyi Meng , Clement Yu , King-Lup Liu, Building efficient and effective metasearch engines, ACM Computing Surveys (CSUR), v.34 n.1, p.48-89, March 2002 [doi>10.1145/505282.505284]
• 7: M. Elena Renda , Umberto Straccia, Web metasearch: rank vs. score based rank aggregation methods, Proceedings of the 2003 ACM symposium on Applied computing, March 09-12, 2003, Melbourne, Florida [doi>10.1145/952532.952698]
• 8: F. Gibb S. Wu, F. Crestani. New methods of results merging for distributed information retrieval. In Distributed Multimedia Information Retrieval, 2003.
• 9: W. Richard Stevens, UNIX network programming, Prentice-Hall, Inc., Upper Saddle River, NJ, 1990

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Design, Experimentation, Measurement

Keywords:
meta search engines, open source