Similarity learning via dissimilarity space in CBIR

ABSTRACT

In this paper, we introduce a new approach to learn dissimilarity for interactive search in content based image retrieval. In literature, dissimilarity is often learned via the feature space by feature selection,feature weighting or a parameterized function of the features. Different from existing techniques, we use relevance feedback to adjust dissimilarity in a dissimilarity space. To create a dissimilarity space, we use Pekalska's method [15]. After the user gives feed-back, we apply active learning with one-class SVM on this space. Results on a Corel dataset of 10000 images and a TrecVid collection of 43907 keyframes show that our proposed approach can improve the retrieval performance over the feature space based approach.

REFERENCES

• 1: B. Bhanu , J. Peng , S. Qing, Learning Feature Relevance and Similarity Metrics in Image Databases, Proceedings of the IEEE Workshop on Content - Based Access of Image and Video Libraries, p.14, June 21-21, 1998
• 2: E. Bruno, N. Loccoz, and S. Maillet. Learning user queries in multimodal dissimilarity spaces. In Proceedings of the 3rd International Workshop on Adaptive Multimedia Retrieval, 2005.
• 3: A. Carkacioglu and F. Vural. Learning similarity space. In International Conference on Image Processing, 2002.
• 4: Y. Chen, X. Zhou, and T. Huang. One-class SVM for learning in image retrieval. In International Conference on Image Processing, volume 1, pages 34--37, 2001.
• 5: Robert P. W. Duin , Dick de Ridder , David M. J. Tax, Experiments with a featureless approach to pattern recognition, Pattern Recognition Letters, v.18 n.11-13, p.1159-1166, Nov., 1997 [doi>10.1016/S0167-8655(97)00138-4]
• 6: I. El-Naqa, Y. Yang, N. Galatsanos, R. Nishikawa, and M. Wernick. A similarity learning approach to content based image retrieval: application to digital mammography. IEEE Transactions on Medical Imaging, 23(10):1233--1244, 2004.
• 7: G. Guo, A. Jain, W. Ma, and H. Zhang. Learning similarity measure for natural image retrieval with relevance feedback. IEEE Transactions on Neural Networks, 13(4):811--820, 2002.
• 8: X. He, O. King, W. Ma, M. Li, and H. Zhang. Learning a semantic space from user's relevance feedback for image retrieval. IEEE transactions on Circuits and Systems for Video Technology, 13(1):39--48, 2003.
• 9: B. Li and E. Chang. Discovery of a perceptual distance function for measuring image similarity. ACM Multimedia Journal Special Issue on Content-Based Image Retrieval, 8(6): 512--522, 2003.
• 10: Larry M. Manevitz , Malik Yousef, One-class svms for document classification, The Journal of Machine Learning Research, 2, 3/1/2002
• 11: Baback Moghaddam , Qi Tian , Neal Lesh , Chia Shen , Thomas S. Huang, Visualization and User-Modeling for Browsing Personal Photo Libraries, International Journal of Computer Vision, v.56 n.1-2, p.109-130, January-February 2004 [doi>10.1023/B:VISI.0000004834.62090.74]
• 12: G. Nguyen and M. Worring. Similarity based visualization of image collections. In In proceedings of 7th International Workshop on Audio-Visual Content and Information Visualization in Digital Libraries, 2005.
• 13: Giang P. Nguyen , Marcel Worring, Scenario optimization for interactive category search, Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval, November 10-11, 2005, Hilton, Singapore [doi>10.1145/1101826.1101853]
• 14: Hieu T. Nguyen , Arnold Smeulders, Active learning using pre-clustering, Proceedings of the twenty-first international conference on Machine learning, p.79, July 04-08, 2004, Banff, Alberta, Canada [doi>10.1145/1015330.1015349]
• 15: Elzbieta Pekalska , Robert P. W. Duin, Dissimilarity representations allow for building good classifiers, Pattern Recognition Letters, v.23 n.8, p.943-956, June 2002 [doi>10.1016/S0167-8655(02)00024-7]
• 16: E. Pekalska, R. Duin, and P. Paclik. Prototype selection for dissimilarity-based classifiers. Pattern Recognition, 39(2):189--208, 2006.
• 17: Kerry Rodden , Wojciech Basalaj , David Sinclair , Kenneth Wood, Does organisation by similarity assist image browsing?, Proceedings of the SIGCHI conference on Human factors in computing systems, p.190-197, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365097]
• 18: Yossi Rubner , Carlo Tomasi , Leonidas J. Guibas, The Earth Mover's Distance as a Metric for Image Retrieval, International Journal of Computer Vision, v.40 n.2, p.99-121, Nov. 2000 [doi>10.1023/A:1026543900054]
• 19: Y. Rui, T. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: a power tool for interactive content based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 8(5):644--655, 1998.
• 20: Simone Santini , Amarnath Gupta , Ramesh Jain, Emergent Semantics through Interaction in Image Databases, IEEE Transactions on Knowledge and Data Engineering, v.13 n.3, p.337-351, May 2001 [doi>10.1109/69.929893]
• 21: Simone Santini , Ramesh Jain, Similarity Measures, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.21 n.9, p.871-883, September 1999 [doi>10.1109/34.790428]
• 22: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 23: C. Snoek, J. van Gemert, J. Geusebroek, B. Huurnink, D. Koelma, G. Nguyen, O. de Rooij, F. Seinstra, A. Smeulders, C. Veenman, and M. Worring. The mediamill trecvid 2005 semantic video search engine. In Proceedings of the 3th TRECVID Workshop, 2005.
• 24: Cees G. M. Snoek , Marcel Worring , Jan van Gemert , Jan-Mark Geusebroek , Dennis Koelma , Giang P. Nguyen , Ork de Rooij , Frank Seinstra, MediaMill: exploring news video archives based on learned semantics, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101188]
• 25: David McG. Squire, Learning a similarity-based distance measure for image database organization from human partitionings of an image set, Proceedings of the 4th IEEE Workshop on Applications of Computer Vision (WACV'98), p.88, October 19-21, 1998
• 26: Simon Tong , Edward Chang, Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500159]
• 27: Jan C. van Gemert , Jan-Mark Geusebroek , Cor J. Veenman , Cees G. M. Snoek , Arnold W. M. Smeulders, Robust Scene Categorization by Learning Image Statistics in Context, Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, p.105, June 17-22, 2006 [doi>10.1109/CVPRW.2006.177]
• 28: Hangjun Ye , Guangyou Xu, Similarity Measure Learning for Image Retrieval Using Feature Subspace Analysis, Proceedings of the 5th International Conference on Computational Intelligence and Multimedia Applications, p.131, September 27-30, 2003
• 29: X. Zhou and T. Huang. Relevance feedback in image retrieval: A comprehensive overview. Multimedia systems, 8:536--544, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

General Terms:
Algorithms, Experimentation

Keywords:
dissimilarity learning, interactive search, visualization