Human behaviour consistent relevance feedback model for image retrieval

ABSTRACT

Due to the well known semantic gap, content based image retrieval is a difficult problem. To bridge it, relevance feedback as an effective solution has been extensively studied in literatures. However, existing methods follow a single-line searching philosophy, which may lead to a local optimum in search space. To address the problem, we propose a human behavior consistent relevance feedback model for image retrieval in this paper. Simulating human behaviors, the proposed model enable the user to perform relevance feedback in three manners: Follow up, Go back, and Restart. Each manner is a way for the user to provide the system with his or her opinions about search results. The accumulated feedback information can be used to refine the user query and regulate the similarity metric. We adopt the graph ranking algorithm to model the retrieval process. Experiments conducted on standard Corel dataset and Pascal VOC 2006 dataset demonstrate the effectiveness of the proposed mechanism.

REFERENCES

• 1: M. Everingham, A. Zisserman, C. Williams, L. V. Gool. The PASCAL visual object classes challenge 2006. In 2nd PASCAL Challenge Workshop.
• 2: Jingrui He , Mingjing Li , Hong-Jiang Zhang , Hanghang Tong , Changshui Zhang, Manifold-ranking based image retrieval, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027531]
• 3: Yoshiharu Ishikawa , Ravishankar Subramanya , Christos Faloutsos, MindReader: Querying Databases Through Multiple Examples, Proceedings of the 24rd International Conference on Very Large Data Bases, p.218-227, August 24-27, 1998
• 4: J. Rocchio. Relevance feedback information retrieval. Gerard Salton (ed.): The Smart Retrieval System-Experiments in Automatic Document Processing, pp. 313--323. Prentice-Hall, Englewood Cliffs, NJ, 1971.
• 5: L. Zhang, F. Lin, and B. Zhang. Support vector machine learning for image retrieval. ICIP, pp. 721--724, 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Experimentation, Measurement

Keywords:
graph ranking, image retrieval, relevance feedback