Incorporating quality metrics in centralized/distributed information retrieval on the World Wide Web

ABSTRACT

Most information retrieval systems on the Internet rely primarily on similarity ranking algorithms based solely on term frequency statistics. Information quality is usually ignored. This leads to the problem that documents are retrieved without regard to their quality. We present an approach that combines similarity-based similarity ranking with quality ranking in centralized and distributed search environments. Six quality metrics, including the currency, availability, information-to-noise ratio, authority, popularity, and cohesiveness, were investigated. Search effectiveness was significantly improved when the currency, availability, information-to-noise ratio and page cohesiveness metrics were incorporated in centralized search. The improvement seen when the availability, information-to- noise ratio, popularity, and cohesiveness metrics were incorporated in site selection was also significant. Finally, incorporating the popularity metric in information fusion resulted in a significant improvement. In summary, the results show that incorporating quality metrics can generally improve search effectiveness in both centralized and distributed search environments.

REFERENCES

• 1: AltaVista. 1999. http://www.altavista.com.
• 2: S. Brin and L. Page. The Anatomy of a Large- Scale Hypertextual Web Search Engine. http://google, stanford.edu/long321.htm, 1999.
• 3: J.P. Callan, W.B. Croft, and S.M. Harding, "The INQUERY retrieval system." In Proceedings of the 3rd International Conference on Database and Expert System Applications, Valencia, Spain, September, 1995.
• 4: Ciolek. http://www.ciolek.com/WWWVLPages/ QltyDefinitions.html.
• 5: Clearinghouse. Argus Clearinghouse Ratings System. http://clearinghouse.net/ratings.html, 1999.
• 6: G. Crowder and C. Nicholas. "Using Statistical Properties of Text to Create Metadata." In First 1EEE Metadata Conference. April 1996.
• 7: G. Crowder and C. Nicholas.. "Resource Selection in CAFI: an Architecture for Network Information Retrieval." In ACM-SIGIR96 Workshop on Networked Information Retrieval. 22 August, 1996.
• 8: Direct Hit, http://www.directhit.com, 2000a.
• 9: Direct Hit, http://www.directhit.com/about/press/ articles/cnet_shoot.html, 2000b.
• 10: Y. Fan and S. Gauch. "Adaptive Agents for Information Gathering from Multiple, Distributed Information Sources." In 1999 AAAI Symposium on Intelligent Agents in Cyberspace, Stanford University, March, 1999.
• 11: S. Ganch. 1997b. "Cooperative Agents for Concep-tual Search and Browsing of World Wide Web Resources." CAREER/EPSCoR Award number 97-03307, http://www.ittc.ukans. edu/obiwan/, 1997b.
• 12: Susan Gauch , Jianying Wang , Satya Mahesh Rachakonda, A corpus analysis approach for automatic query expansion and its extension to multiple databases, ACM Transactions on Information Systems (TOIS), v.17 n.3, p.250-269, July 1999 [doi>10.1145/314516.314519]
• 13: L. Gravano, K. Change, H. Garcia-Molina, C. Lagoze, A. Paepcke. Stanford Protocal Proposal for Internet Retrieval and Search. http://wwwdb.stanford.edu/-gravano/standards, 1997.
• 14: IPL. http://www.ipl.org, 1999.
• 15: Owen de Kretser , Alistair Moffat , Tim Shimmin , Justin Zobel, Methodologies for Distributed Information Retrieval, Proceedings of the The 18th International Conference on Distributed Computing Systems, p.66, May 26-29, 1998
• 16: Y. Li, and L. Rafsky "Beyond Relevance Ranking: Hyperlink Vector Voting." In ACM- SIGIR97 Workshop on Networked Information Retrieval. Philadelphia, USA, 31 July 1997.
• 17: Lycos. http//point.lycos.com/categories/index. html, 1999b.
• 18: Lycos. http://www.lycos.com/help/top5-help2. html, 1999c.
• 19: Magellan. http://magellan.mckinley.com, 1999.
• 20: Magellan.http://www.lib.ua.edu/maghelp.htm, 1998.
• 21: Claudia Pearce , Charles Nicholas, TELLTALE: experiments in a dynamic hypertext environment for degraded and multilingual data, Journal of the American Society for Information Science, v.47 n.4, p.263-275, April 1996 [doi>10.1002/(SICI)1097-4571(199604)47:4<263::AID-ASI2>3.0.CO;2-V]
• 22: Scout. Internet Scout Project, http://scout.cs. wisc.edu/scout/index.html, 1999a.
• 23: Scout. Scout Report Selection Criteria, http://scout.cs.wisc.edu/scout/report/criteria. html, 1999b.
• 24: E. Selberg. "DISW '96 Query routing and Searching Breakout." In Report of the Distributed Indexing/ Searching Workshop, http://www.w3.org/Search/ 9605-Indexing- Workshop/ReportOutcomes/ S6Groupl.html, Cambridge, Massachusetts, May 1996.
• 25: G. Towell, E.M. Voorhees, N.K. Gupta and B. Johnson-Laird B. "Learning Collection Fusion Strategies for Information Retrieval." In Proceedings of the Twelth Annual Machine Learning Conference, Lake Tahoe, July 1995.
• 26: E. M. Voorhees, "Database Merging Strategies for Searching Public and Privated Collections." In ACM-SIGIR97 Workshop on Networked Inform-ation Retrieval, Philadelphia, USA, 32, July 1997.
• 27: ZDNet. http://www.zdnet.com/yil, 1999.
• 28: Xiaolan Zhu , Susan Gauch , Lutz Gerhard , Nicholas Kral , Alexander Pretschner, Ontology-based web site mapping for information exploration, Proceedings of the eighth international conference on Information and knowledge management, p.188-194, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319950.329374]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.3 Clustering
          Subjects: Similarity measures

General Terms:
Algorithms, Design, Performance, Reliability