Manifold-ranking based image retrieval

ABSTRACT

In this paper, we propose a novel transductive learning framework named manifold-ranking based image retrieval (MRBIR). Given a query image, MRBIR first makes use of a manifold ranking algorithm to explore the relationship among all the data points in the feature space, and then measures relevance between the query and all the images in the database accordingly, which is different from traditional similarity metrics based on pair-wise distance. In relevance feedback, if only positive examples are available, they are added to the query set to improve the retrieval result; if examples of both labels can be obtained, MRBIR discriminately spreads the ranking scores of positive and negative examples, considering the asymmetry between these two types of images. Furthermore, three active learning methods are incorporated into MRBIR, which select images in each round of relevance feedback according to different principles, aiming to maximally improve the ranking result. Experimental results on a general-purpose image database show that MRBIR attains a significant improvement over existing systems from all aspects.

REFERENCES

• 1: Bengio, Y., Vincent, P., and Paiement, J. Learning Eigenfunctions of Similarity: Linking Spectral Clustering and Kernel PCA. Technical Report 1232, University of Montreal, 2003.
• 2: Chen, Y., Zhou, X., and Huang, T. One-class SVM for learning in image retrieval. Proc. IEEE Int. Conf. on Image Processing, vol. 1, pp. 34--37, 2001.
• 3: Jing Huang , S. Ravi Kumar , Mandar Mitra , Wei-Jing Zhu , Ramin Zabih, Image Indexing Using Color Correlograms, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.762, June 17-19, 1997
• 4: Feng Jing , Mingjing Li , Hong-Jiang Zhang , Bo Zhang, An effective region-based image retrieval framework, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641106]
• 5: Yoshiharu Ishikawa , Ravishankar Subramanya , Christos Faloutsos, MindReader: Querying Databases Through Multiple Examples, Proceedings of the 24rd International Conference on Very Large Data Bases, p.218-227, August 24-27, 1998
• 6: Kokare, M., Chatterji, B.N., and Biswas, P.K. Comparison of similarity metrics for texture image retrieval. IEEE Conf. on Convergent Technologies for Asia-Pacific Region, vol. 2, pp. 571--575, 2003.
• 7: Li, B., Chang, E., and Li, C.S. Learning image query concepts via intelligent sampling. Proc. IEEE Int. Conf. on Multimedia & Expo, pp. 961--964, 2001.
• 8: Li, B., Chang, E., and Wu, C.T. DPF-a perceptual distance function for image retrieval. Proc. IEEE Int. Conf. on Image Processing, vol. 2, pp. 597--600, 2002.
• 9: Fang Liu , Rosalind W. Picard, Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.18 n.7, p.722-733, July 1996 [doi>10.1109/34.506794]
• 10: B. S. Manjunath , W. Y. Ma, Texture Features for Browsing and Retrieval of Image Data, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.18 n.8, p.837-842, August 1996 [doi>10.1109/34.531803]
• 11: Katharina Morik , Peter Brockhausen , Thorsten Joachims, Combining Statistical Learning with a Knowledge-Based Approach - A Case Study in Intensive Care Monitoring, Proceedings of the Sixteenth International Conference on Machine Learning, p.268-277, June 27-30, 1999
• 12: Greg Pass , Ramin Zabih , Justin Miller, Comparing images using color coherence vectors, Proceedings of the fourth ACM international conference on Multimedia, p.65-73, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244148]
• 13: Kriengkrai Porkaew , Kaushik Chakrabarti, Query refinement for multimedia similarity retrieval in MARS, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.235-238, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319613]
• 14: Kriengkrai Porkaew , Sharad Mehrotra , Michael Ortega, Query Reformulation for Content Based Multimedia Retrieval in MARS, Proceedings of the IEEE International Conference on Multimedia Computing and Systems Volume II-Volume 2, p.747, June 07-11, 1999
• 15: Rocchio, J.J. Relevance feedback in information retrieval. The SMART Retrieval System, pp. 313--323, Prentice-Hall, Englewood Cliffs, NJ, 1971.
• 16: Yossi Rubner , Carlo Tomasi , Leonidas J. Guibas, A Metric for Distributions with Applications to Image Databases, Proceedings of the Sixth International Conference on Computer Vision, p.59, January 04-07, 1998
• 17: Rui, Y., et al. Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans. Circuits and Systems for Video Technology, 1998.
• 18: Rui, Y., Huang, T., and Mehrotra, S. Content-based image retrieval with relevance feedback in MARS. Proc. IEEE Int. Conf. on Image Processing, pp. 815--818, 1997.
• 19: Schmid, C. A structured probabilistic model for recognition. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. 2, pp. 490, 1999.
• 20: Cordelia Schmid , Roger Mohr, Local Grayvalue Invariants for Image Retrieval, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.5, p.530-535, May 1997 [doi>10.1109/34.589215]
• 21: Jianbo Shi , Jitendra Malik, Normalized Cuts and Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.888-905, August 2000 [doi>10.1109/34.868688]
• 22: Stricker, M., and Orengo, M. Similarity of color images. Storage and Retrieval for Image and Video Databases, Proc. SPIE 2420, pp 381--392, 1995.
• 23: Michael J. Swain , Dana H. Ballard, Color indexing, International Journal of Computer Vision, v.7 n.1, p.11-32, Nov. 1991 [doi>10.1007/BF00130487]
• 24: Tieu, K., and Viola, P. Boosting image retrieval. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 228--235, 2000.
• 25: Simon Tong , Edward Chang, Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500159]
• 26: Wang, J.Z., Wiederhold, G., Firschein, O., and Sha, X.W. Content-based image indexing and searching using Daubechies' wavelets. Int. Journal of Digital Libraries, vol. 1, no. 4, pp. 311--328, 1998.
• 27: Wu, Y., Tian, Q., and Huang, T. Discriminant-EM algorithm with application to image retrieval. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 155--162, 2000.
• 28: Zhang, L., Lin, F., and Zhang, B. Support vector machine learning for image retrieval. Proc. IEEE Int. Conf. on Image Processing, vol. 2, pp. 721--724, 2001.
• 29: Zhou, D., et al. Learning with local and global consistency. NIPS, 2003.
• 30: Zhou, D., et al. Ranking on data manifolds. NIPS, 2003.
• 31: Zhou, X.S., Rui, Y., and Huang, T. Water-Filling: a novel way for image structural feature extraction. Proc. IEEE Int. Conf. on Image Processing, vol. 2, pp. 570--574, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Image databases

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback; Search process

General Terms:
Algorithms, Experimentation

Keywords:
active learning, image retrieval, manifold ranking, relevance feedback