A data mining approach to modeling relationships among categories in image collection

ABSTRACT

This paper proposes a data mining approach to modeling relationships among categories in image collection. In our approach, with image feature grouping, a visual dictionary is created for color, texture, and shape feature attributes respectively. Labeling each training image with the keywords in the visual dictionary, a classification tree is built. Based on the statistical properties of the feature space we define a structure, called α-Semantics Graph, to discover the hidden semantic relationships among the semantic categories embodied in the image collection. With the α-Semantics Graph, each semantic category is modeled as a unique fuzzy set to explicitly address the semantic uncertainty and semantic overlap among the categories in the feature space. The model is utilized in the semantics-intensive image retrieval application. An algorithm using the classification accuracy measures is developed to combine the built classification tree with the fuzzy set modeling method to deliver semantically relevant image retrieval for a given query image. The experimental evaluations have demonstrated that the proposed approach models the semantic relationships effectively and the image retrieval prototype system utilizing the derived model is promising both in effectiveness and efficiency.

REFERENCES

• 1: Kenneth R. Castleman, Digital image processing, Prentice Hall Press, Upper Saddle River, NJ, 1996
• 2: Shih-Fu Chang , John R. Smith , Mandis Beigi , Ana Benitez, Visual information retrieval from large distributed online repositories, Communications of the ACM, v.40 n.12, p.63-71, Dec. 1997 [doi>10.1145/265563.265573]
• 3: Wendy Chang , Gholamhosein Sheikholeslami , Jia Wang , Aidong Zhang, Data Resource Selection in Distributed Visual Information Systems, IEEE Transactions on Knowledge and Data Engineering, v.10 n.6, p.926-946, November 1998 [doi>10.1109/69.738358]
• 4: S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of American Sociation of Information Science, 41:391--407, 1990.
• 5: Margaret H. Dunham, Data Mining: Introductory and Advanced Topics, Prentice Hall PTR, Upper Saddle River, NJ, 2002
• 6: Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995 [doi>10.1109/2.410146]
• 7: F. Hoppner, F. Klawonn, R. Kruse, and T. Runkler. Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition. John Wiley & Sons, New York, 1999.
• 8: Jing Huang , S. Ravi Kumar , Ramin Zabih, An automatic hierarchical image classification scheme, Proceedings of the sixth ACM international conference on Multimedia, p.219-228, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290774]
• 9: T. Kohonen, S. Kaski, K. Lagus, J. Salojarvi, J. Honkela, V. Paatero, and A. Saarela. Self organization of a massive document collection. IEEE Trans. on Neural Networks, 11(3):1025--1048, May 2000.
• 10: P. Lipson , E. Grimson , P. Sinha, Configuration based scene classification and image indexing, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1007, June 17-19, 1997
• 11: W. Y. Ma , B. S. Manjunath, A comparison of wavelet transform features for texture image annotation, Proceedings of the 1995 International Conference on Image Processing (Vol.2)-Volume 2, p.2256, October 23-26, 1995
• 12: B. S. Manjunath , W. Y. Ma, Texture Features for Browsing and Retrieval of Image Data, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.18 n.8, p.837-842, August 1996 [doi>10.1109/34.531803]
• 13: C. Shannon. Prediction and entropy of printed english. Bell Sys. Tech. Journal, 30:50--64, 1951.
• 14: G. Taubin and D. B. Cooper. Recognition and positioning of rigid objects using algerbraic moment invariants. In SPIE Geometric Methods in Computer Vision Proceedings, volume 1570, pages 175--186, 1991.
• 15: H. Yu and W. Wolf. Scenic classification methods for image and video databases. In SPIE International Conference on Digital Image Storage and Archiving Systems, volume 2606, pages 363--371, 1995.
• 16: R. Zhang and Z. Zhang. Hidden semantic concept discovery in region based image retrieval. In IEEE International Conference on Computer Vision and Pattern Recogntion (CVPR) 2004, Washington, DC, June 2004.
• 17: X. S. Zhou, Y. Rui, and T. S. Huang. Water filling: A novel way for image structural feature. In IEEE Conf. on Image Processing Proceedings, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Image databases

General Terms:
Algorithms, Design, Measurement

Keywords:
fuzzy model, image collection, relationships, semantic category