A retrieval method for similar Q&A articles of web bulletin board with relevance index derived from commercial web search engine

ABSTRACT

This paper addresses a retrieval method for BBS(Bulletin Board System) articles with relevance index between the retrieval query and an article. Simply using the keyword-based retrieval has limitation on narrowing the articles, because most BBS articles include various keywords and such combination of some unrelated keywords to the retrieval query causes unexpected results. On the other hand, most BBSs have a characteristic structure, so-called "thread", which consists of one question article and a set of answer articles. Based on this structure, our method calculates the relevance index of each part of an article with association index among words derived from the Internet search engine results. We applied it to a practical word-of-mouth BBS and compared with the retrieval method of cosine similarity index in the word-vector space. The results show that our method had 30% better retrieval accuracy.

REFERENCES

• 1: D. Mochihashi: "Learning non-structural distance metric by minimum cluster distortions", in Proc. of EMNLP2004, pp. 341--348, 2004.
• 2: Dragomir R. Radev, A common theory of information fusion from multiple text sources step one: cross-document structure, Proceedings of the 1st SIGdial workshop on Discourse and dialogue, p.74-83, October 07-08, 2000, Hong Kong [doi>10.3115/1117736.1117745]
• 3: Y. Sakurai and S. Miyazaki and M. Akiyoshi: "A retrieval method of similar question articles from web bulletin board", in Proc. of the First International Conference on Software and Data Technologie, pp. 221--225, 2006.
• 4: Y. Masunaga: "A diachronic analysis of gender-rated web communities using a hits-based mining tool", in Proc. of AP-Web2006, 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms

Keywords:
BBS, relevance index, web search engine