A novel region-based image retrieval method using relevance feedback

ABSTRACT

Content-based image retrieval using region segmentation has been an active research area in the past few years. Constrasting to traditional approaches, which compute only global features of images, the region-based methods extract features of the segmented regions and perform similarity comparisons at the granularity of region. In this paper, we propose a novel region-based retrieval method, Self-Learned Region Importance (SLRI). In this method, image similarity measure is based on the region importance learned from users' feedback. The region importance that coincides that human perception con not only be used in a query session, but also be memorized and cumulated for future queries. Experimental results on a database of about 8,600 general-purposed images show the effectiveness of our method using relevance feedback.

REFERENCES

• 1: Chad Carson , Megan Thomas , Serge Belongie , Joseph M. Hellerstein , Jitendra Malik, Blobworld: A System for Region-Based Image Indexing and Retrieval, Proceedings of the Third International Conference on Visual Information and Information Systems, p.509-516, June 02-04, 1999
• 2: Deng, Y., Manjunath, B.S. and Shin, H., "Color Image Segmentation", in Proc. IEEE Computer Society Conf. on computer Vision and Pattern REcognition, CVPR '99, Fort Collins, CO, vol. 2, pp. 446-51, June 1999.
• 3: Jia Li , James Z. Wang , Gio Wiederhold, IRM: integrated region matching for image retrieval, Proceedings of the eighth ACM international conference on Multimedia, p.147-156, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.354452]
• 4: W. Y. Ma , B. S. Manjunath, NeTra: a toolbox for navigating large image databases, Proceedings of the 1997 International Conference on Image Processing (ICIP '97) 3-Volume Set-Volume 1, p.568, October 26-29, 1997
• 5: Niblack, W. et al. " The QBIC project; querying images by content using color, texture and shape", in Proc. SPIE, vol. 1908, pp. 173-187, San Jose, Feb. 1993.
• 6: John R. Smith , Shih-Fu Chang, VisualSEEk: a fully automated content-based image query system, Proceedings of the fourth ACM international conference on Multimedia, p.87-98, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244151]
• 7: Stricker, M. and Orengo, M., "Similarity of Color Images", in Storage and Retrival for Image and Video Databases, Proc. SPIE 2420, pp. 381-392, 1995.
• 8: James Z. Wang , Jia Li , Gio Wiederhold, SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.9, p.947-963, September 2001 [doi>10.1109/34.955109]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.6 Segmentation

General Terms:
Algorithms

Keywords:
feedback, region importance, region-based image retrieval