Iteratively clustering web images based on link and attribute reinforcements

ABSTRACT

Image clustering is an important research topic which contributes to a wide range of applications. Traditional image clustering approaches are based on image content features only, while content features alone can hardly describe the semantics of the images. In the context of Web, images are no longer assumed homogeneous and "flatdistributed but are richly structured. There are two kinds of reinforcements embedded in such data: 1) the reinforcement between attributes of different data types (intra-type links reinforcements); and 2) the reinforcement between object attributes and the inter-type links (inter-type links reinforcements). Unfortunately, most of the previous works addressing relational data failed to fully explore the reinforcements. In this paper, we propose a reinforcement clustering framework to tackle this problem. It reinforces images and texts' attributes via inter-type links and inversely uses these attributes to update these links. The iterative reinforcing nature of this framework promises the discovery of the semantic structure of images, which is the basis of image clustering. Experimental results show the effectiveness of our proposed framework.

REFERENCES

• 1: Barnard, K., Duygulu, P., and Forsyth, D. Clustering Art. Computer Vision and Pattern Recognition, 2001, II:434--439
• 2: Deng Cai , Xiaofei He , Zhiwei Li , Wei-Ying Ma , Ji-Rong Wen, Hierarchical clustering of WWW image search results using visual, textual and link information, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027747]
• 3: Cai, D., Yu, S., Wen, J.-R., and Ma, W.-Y. VIPS: a Vision-based Page Segmentation Algorithm", Microsoft Technical Report, MSR-TR-2003-79, 2003.
• 4: Cohn, D., and Hofmann, T. The Missing Link a Probabilistic Model of Document Content and Hypertext Connectivity. In Advances in Neural Information Processing Systems, Vol.10, 2001
• 5: Thomas M. Cover , Joy A. Thomas, Elements of information theory, Wiley-Interscience, New York, NY, 1991
• 6: Lise Getoor, Link mining: a new data mining challenge, ACM SIGKDD Explorations Newsletter, v.5 n.1, July 2003 [doi>10.1145/959242.959253]
• 7: Xiaofeng He , Chris H. Q. Ding , Hongyuan Zha , Horst D. Simon, Automatic Topic Identification Using Webpage Clustering, Proceedings of the 2001 IEEE International Conference on Data Mining, p.195-202, November 29-December 02, 2001
• 8: Jing Huang , S. Ravi Kumar , Mandar Mitra , Wei-Jing Zhu , Ramin Zabih, Image Indexing Using Color Correlograms, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.762, June 17-19, 1997
• 9: Glen Jeh , Jennifer Widom, SimRank: a measure of structural-context similarity, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775126]
• 10: Jingrui He , Mingjing Li , Hong-Jiang Zhang , Hanghang Tong , Changshui Zhang, Manifold-ranking based image retrieval, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027531]
• 11: Jeremy Kubica , Andrew Moore , Jeff Schneider , Yiming Yang, Stochastic link and group detection, Eighteenth national conference on Artificial intelligence, p.798-804, July 28-August 01, 2002, Edmonton, Alberta, Canada
• 12: Lu, Q., Getoor, L. Link-based Classification. In Proc. of Intl. Conf. on Machine Learning, 2003.
• 13: Dharmendra S. Modha , W. Scott Spangler, Clustering hypertext with applications to web searching, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.143-152, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336351]
• 14: Neville, J., Adler, M., and Jensen, D. Clustering Relational Data Using Attribute and Link Information. Proc. of the Text Mining and Link Analysis Workshop, Eighteenth International Joint Conference on Artificial Intelligence, 2003
• 15: Gerard Salton , Christopher Buckley, Term-weighting approaches in automatic text retrieval, Information Processing and Management: an International Journal, v.24 n.5, p.513-523, 1988 [doi>10.1016/0306-4573(88)90021-0]
• 16: Jianbo Shi , Jitendra Malik, Normalized Cuts and Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.888-905, August 2000 [doi>10.1109/34.868688]
• 17: Taskar, B., Wong, M.-F., Abbeel, P., and Koller, D. Link Prediction in Relational Data. In Advances in Neural Information Processing Systems, 2004.
• 18: Taskar, B., Segal, E., and Koller, D. Probabilistic Clustering in Relational Data. In Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01), 870--87, 2001
• 19: Jidong Wang , Huajun Zeng , Zheng Chen , Hongjun Lu , Li Tao , Wei-Ying Ma, ReCoM: reinforcement clustering of multi-type interrelated data objects, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860486]
• 20: Xin-Jing Wang , Wei-Ying Ma , Gui-Rong Xue , Xing Li, Multi-model similarity propagation and its application for web image retrieval, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027746]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models
          Subjects: Structural

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.3 Clustering
          Subjects: Algorithms

General Terms:
Algorithms, Performance

Keywords:
image clustering, iterative reinforcement, link mining