Quantization-based probabilistic feature modeling for kernel design in content-based image retrieval

ABSTRACT

In this paper, a quantization-based probabilistic feature modeling approach is proposed for relevance feedback in content-based image retrieval. We demonstrate its performance by using the resulting models within a support vector machine (SVM) based technique. Each feature component is quantized and mapped to probabilistic quantities representing the likelihood of the image being relevant (and irrelevant). These probabilistic quantities are then used to derive an information divergence-based kernel function for SVM classification which we introduced in earlier work. We show that the proposed method leads to the optimal maximum likelihood solution as the knowledge of the actual underlying probability model improves (i.e.,as the feature space is partitioned into arbitrarily small "regions "and accurate models are known for all regions). vWe investigate several practical quantization designs for feature modeling specifically in relevance feedback applications,where the scarcity of the data and high dimensionality prevent usage of vector quantization and parametric modeling approaches.Our proposed framework naturally takes into account the statistics of the data that is available during relevance feedback for the purpose of discriminating between relevant and irrelevant images.Experiments with the Corel dataset show that quantizers specifically designed for this application achieve gains over simple uniform quantizers (e.g.,5% to 10% in retrieval accuracy) when combined with our information divergence kernel. This kernel achieves gains (e.g.,17% in retrieval accuracy after first relevance feedback)as compared to the standard radial basis function (RBF) kernel used for SVM-based relevance feedback.

REFERENCES

• 1: Corel stock photo library. Corel Corp. Ontario, Canada.
• 2: J. A. Bilmes. A gentle tutorial on the em algorithm and its application to parameter estimation for gaussian mixture and hidden markov models. Technical Report, University of Berkeley, ICSI-TR-97-021, 1997.
• 3: Christopher J. C. Burges, A Tutorial on Support Vector Machines for Pattern Recognition, Data Mining and Knowledge Discovery, v.2 n.2, p.121-167, June 1998 [doi>10.1023/A:1009715923555]
• 4: Simon Tong , Edward Chang, Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500159]
• 5: J.-Y. Chen, C. A. Bouman, and J. Dalton. Similarity pyramids for browsing and organization of large image databases. Proc. of SPIE Conf. on Human Vision and Electronic Imaging III, 3299, Jan. 1998.
• 6: Y. Chen, X. Zhou, and T. S. Huang. One-class support vector machine for learning in image retrieval. IEEE International Conference on Image Processing, 2001.
• 7: Thomas M. Cover , Joy A. Thomas, Elements of information theory, Wiley-Interscience, New York, NY, 1991
• 8: R. O. Dudaand P. E. Hart. Pattern classification and scene analysis. Wiley-interscience Publication, 1973.
• 9: R. Gray , R. Olshen, Vector Quantization and Density Estimation, Proceedings of the Compression and Complexity of Sequences 1997, p.172, June 11-13, 1997
• 10: C. Hoi, C. Chan, K. Huang, M. R. Lyu, and I. King. Biased support vector machine for relevance feedback in image retrieval. International joint conference on Neural Networks, 2004.
• 11: P. Hong, Q. Tian, and T. S. Huang. Incorporate support vector machines to content-based image retrieval with relevance feedback. IEEE International Conference on Image Processing, 2000.
• 12: T. S. Huang and X. S. Zhou. Image retrieval with relevance feedback: From heuristic weight adjustment to optimal learning methods. IEEE International Conference on Image Processing, 2001.
• 13: Tommi Jaakkola , Mark Diekhans , David Haussler, Using the Fisher Kernel Method to Detect Remote Protein Homologies, Proceedings of the Seventh International Conference on Intelligent Systems for Molecular Biology, p.149-158, August 06-10, 1999
• 14: Tommi S. Jaakkola , David Haussler, Exploiting generative models in discriminative classifiers, Proceedings of the 1998 conference on Advances in neural information processing systems II, p.487-493, July 1999
• 15: Thorsten Joachims, Making large-scale support vector machine learning practical, Advances in kernel methods: support vector learning, MIT Press, Cambridge, MA, 1999
• 16: P. J. Moreno, P. Ho, and N. Vasconceles. A Kullback-Leibler divergence based kernel for SVM classification in multimedia applications. Information Processing Systems, 2003.
• 17: Jing Peng , Bir Bhanu , Shan Qing, Probabilistic feature relevance learining for content-based image retrieval, Computer Vision and Image Understanding, v.75 n.1-2, p.150-164, July/Aug. 1999 [doi>10.1006/cviu.1999.0770]
• 18: B. Picinbono and P. Duvaut. Optimum quantization for detection. IEEE Trans on Communications, 36: 1254--1258, 1988.
• 19: J. Rissanen, T. P. Speed, and B. Yu. Density estimation by stochastic complexity. IEEE Trans. on Information Theory, pages 315--323, March 1992.
• 20: Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: A power tool in interactive content-based image retrieval. IEEE trans on Circuits and Systems for Video Technology, 8:644--655, 1998.
• 21: N. Vasconcelos. Exploiting group structure to improve retrieval accuracy and speed in image databases. In International conference on Image Processing, 2002.
• 22: Q. Wang, S. R. Kullkarni, and S. Verdu. Divergence estimation of continuous distributions based on data-dependent partitions. IEEE Trans on Information Theory, 51, 2005.
• 23: Hua Xie , Antonio Ortega, An user preference information based kernel for SVM active learning in content-based image retrieval, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA [doi>10.1145/1026711.1026713]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

General Terms:
Algorithms, Human Factors

Keywords:
kernel, probabilistic modeling, quantization, relevance feedback, support vector machines