On the choice of similarity measures for image retrieval by example

ABSTRACT

In image retrieval systems, a variety of simple similarity measures are used. The choice for one similarity measure or another is generally driven by an experimental comparison on a labeled database. The drawback of such an approach is that, while a large number of possible similarity measures can be tested, we do not know how to extend from the obtained results. However, the choice of a good similarity measure leads to noticeable better results. It is known that this choice is related to the variability of the images within the same class. Therefore, we propose a model of image retrieval systems and deduce a scheme for deriving the best similarity measure in a set of similarity measures, assuming a parametric model of the variability of feature vectors within the same class. An experimental validation of the model and the derived similarity measures is performed on synthetic ground-truth databases. Finally, from our experiments, we give several rules to follow for the design of ground-truth databases allowing reliable conclusions on the search of better similarity measures.

REFERENCES

• 1: Selim Aksoy , Robert M. Haralick, Feature normalization and likelihood-based similarity measures for image retrieval, Pattern Recognition Letters, v.22 n.5, p.563-582, April 2001 [doi>10.1016/S0167-8655(00)00112-4]
• 2: O. Chapelle, P. Haffner, and V. Vapnik. Support vector machines for histogram-based image classification. IEEE Transactions on Neural Networks, 10(5), 1999.
• 3: A. Jain and A. Vailaya. Image retrieval using color and shape. Pattern Recognition, 29(8):1233--1244, 1996.
• 4: V. Koroliouk, N. Portenko, A. Skorokhod, and A. Tourbine. Aide-mémoire de théorie des probabilités et de statistique mathé:matique. Editions Mir, Moscou, 1983.
• 5: B. Moghaddam , A. Pentland, Probabilistic visual learning for object detection, Proceedings of the Fifth International Conference on Computer Vision, p.786, June 20-23, 1995
• 6: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 7: N. Vasconcelos , A. Lippman, A Bayesian Framework for Semantic Content Characterization, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.566, June 23-25, 1998
• 8: A Unifying View of Image Similarity, Proceedings of the International Conference on Pattern Recognition, p.1038, September 03-08, 2000
• 9: Constantin Vertan , Nozha Boujemaa, Upgrading Color Distributions for Image Retrieval: Can We Do Better?, Proceedings of the 4th International Conference on Advances in Visual Information Systems, p.178-188, November 02-04, 2000