Retrieving broken web links using an approach based on contextual information

ABSTRACT

In this short note we present a recommendation system for automatic retrieval of broken Web links using an approach based on contextual information. We extract information from the context of a link such as the anchor text, the content of the page containing the link, and a combination of the cache page in some search engine and web archive, if it exists. Then the selected information is processed and submitted to a search engine. We propose an algorithm based on information retrieval techniques to select the most relevant information and to rank the candidate pages provided for the search engine, in order to help the user to find the best replacement. To test the different methods, we have also defined a methodology which does not require the user judgements, what increases the objectivity of the results.

REFERENCES

• 1: Nadav Eiron , Kevin S. McCurley, Analysis of anchor text for web search, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860550]
• 2: Terry L. Harrison , Michael L. Nelson, Just-in-time recovery of missing web pages, Proceedings of the seventeenth conference on Hypertext and hypermedia, August 22-25, 2006, Odense, Denmark [doi>10.1145/1149941.1149971]
• 3: O. A. McBryan. GENVL and WWWW: Tools for Taming the Web. In O. Nierstarsz, editor, Proceedings of the first International World Wide Web Conference, page 15, CERN, Geneva, 1994.
• 4: Atsuyuki Morishima , Akiyoshi Nakamizo , Toshinari Iida , Shigeo Sugimoto , Hiroyuki Kitagawa, PageChaser: A Tool for the Automatic Correction of Broken Web Links, Proceedings of the 2008 IEEE 24th International Conference on Data Engineering, p.1486-1488, April 07-12, 2008 [doi>10.1109/ICDE.2008.4497598]
• 5: A. Nakamizo, T. Iida, A. Morishima, S. Sugimoto, , and H. Kitagawa. A tool to compute reliable web links and its applications. In SWOD '05: Proc. International Special Workshop on Databases for Next Generation Researchers, pages 146--149. IEEE Computer Society, 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Linguistic processing

General Terms:
Algorithms, Design, Experimentation, Measurement

Keywords:
broken links, information retrieval, link integrity, recommender system