Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

We propose a technique for automatic recognition of content in images. Our technique uses machine learning methods to build classifiers which are able to decide about the presence of semantic concepts in images. Our classifiers exploit a representation of images in terms of vectors of visual terms. A visual term represents a set of visually similar regions that can be found in images. Various types of visual terms are used at the same time to take into account various similarity criteria and region representations that are available to compare regions. Specifically, we compare regions using the 5 MPEG-7 visual descriptors. An image is indexed by first using a segmentation algorithm to extract its regions, and then the image is associated with the visual terms that are more similar to the extracted regions. The proposed technique offers very good performance as demonstrated by the experiments that we performed.

REFERENCES

• 1: G Amato, V. Magionami, P. Savino, Image Indexing and Retrieval Using Visual Terms and Text-Like Weighting, Proceedings of the DELOS Conference on Digital Libraries, Tirrenia (PI), Italy, 13--14 February 2006
• 2: J. Anlauf and M. Biehl. The adatron-an adaptive perceptron algorithm. Europhysics Letters, vol.10:pp. 687--692, 1989.
• 3: G. Caron, SVM in Java, http://www.site.uottawa.ca/~gcaron/svm.htm
• 4: Thomas M. Cover , Joy A. Thomas, Elements of information theory, Wiley-Interscience, New York, NY, 1991
• 5: Nello Cristianini , John Shawe-Taylor, An introduction to support Vector Machines: and other kernel-based learning methods, Cambridge University Press, New York, NY, 1999
• 6: Julien Fauqueur , Nozha Boujemaa, Mental image search by boolean composition of region categories, Multimedia Tools and Applications, v.31 n.1, p.95-117, October 2006 [doi>10.1007/s11042-006-0033-3]
• 7: Thilo-Thomas Frieß , Nello Cristianini , Colin Campbell, The Kernel-Adatron Algorithm: A Fast and Simple Learning Procedure for Support Vector Machines, Proceedings of the Fifteenth International Conference on Machine Learning, p.188-196, July 24-27, 1998
• 8: L. Kaufman and P. J. Rousseeuw. Finding Groups in Data: An Introduction to Cluster Analysis. John Wiley & Sons, New York, 1990.
• 9: B. Le Saux, G. Amato, Image Classifier for scene analysis, ICCVG 04, International Conference on Computer Vision and Graphics, Warsaw, Poland September 22--24, 2004
• 10: V. Mezaris, I. Kompatsiaris, and M. G. Strintzis. Still image segmentation tools for object-based multimedia applications. International Journal of Pattern Recognition and Artificial Intelligence, 18(4):701--725, June 2004.
• 11: B.S. Manjunath , Phillipe Salembier , Thomas Sikora, Introduction to MPEG-7: Multimedia Content Description Interface, John Wiley & Sons, Inc., New York, NY, 2002
• 12: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 13: Ian H. Witten , Alistair Moffat , Timothy C. Bell, Managing gigabytes (2nd ed.): compressing and indexing documents and images, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
      H.3.3 Information Search and Retrieval

General Terms:
Experimentation, Measurement, Performance

Keywords:
image content classification, machine learning