Large-scale cluster-based retrieval experiments on Turkish texts

ABSTRACT

We present cluster-based retrieval (CBR) experiments on the largest available Turkish document collection. Our experiments evaluate retrieval effectiveness and efficiency on both an automatically generated clustering structure and a manual classification of documents. In particular, we compare CBR effectiveness with full-text search (FS) and evaluate several implementation alternatives for CBR. Our findings reveal that CBR yields comparable effectiveness figures with FS. Furthermore, by using a specifically tailored cluster-skipping inverted index we significantly improve in-memory query processing efficiency of CBR in comparison to other traditional CBR techniques and even FS.

REFERENCES

• 1: Altingovde, I. S., Can, F., Ulusoy, Ö. Algorithms for within-cluster searches using inverted files. In ISCIS'06, 707--716, 2006.
• 2: Cacheda, F., Baeza-Yates, R. An optimistic model for searching Web directories. In Proc. of ECIR'04, 364--377, 2004.
• 3: Fazli Can , Ismail Sengör Altingövde , Engin Demir, Efficiency and effectiveness of query processing in cluster-based retrieval, Information Systems, v.29 n.8, p.697-717, December 2004 [doi>10.1016/S0306-4379(03)00062-0]
• 4: Fazli Can , Seyit Kocberber , Erman Balcik , Cihan Kaynak , H. Cagdas Ocalan , Onur M. Vursavas, First large-scale information retrieval experiments on turkish texts, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148288]
• 5: Tombros, A. The Effectiveness of Query-Based Hierarchic Clustering of Documents for Information Retrieval. PhD. Thesis, Univ. of Glasgow, UK, 2002.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process; Query formulation

General Terms:
Experimentation, Performance

Keywords:
Turkish, cluster-based retrieval, cluster-skipping, inverted index