Addressing CBIR efficiency, effectiveness, and retrieval subjectivity simultaneously

ABSTRACT

This work is about Content Based Image Retrieval (CBIR), focusing on developing a Fast And Semantics-Tailored (FAST) image retrieval methodology. Specifically, the contributions of FAST methodology to the CBIR literature include: (1) development of a new indexing method based on fuzzy logic to incorporate color, texture, and shape information into a region based approach to improving the retrieval effectiveness and robustness (2) development of a new hierarchical indexing structure and the corresponding Hierarchical, Elimination-based A* Retrieval algorithm (HEAR) to significantly improve the retrieval efficiency without sacrificing the retrieval effectiveness; it is shown that HEAR is guaranteed to deliver a logarithm search in the average case (3) employment of user relevance feedbacks to tailor the semantic retrieval to each user's individualized query preference through the novel Indexing Tree Pruning (ITP) and Adaptive Region Weight Updating (ARWU) algorithms. Theoretical analysis and experimental evaluations show that FAST methodology holds a great promise in delivering fast and semantics-tailored image retrieval in CBIR.

REFERENCES

• 1: Chad Carson , Megan Thomas , Serge Belongie , Joseph M. Hellerstein , Jitendra Malik, Blobworld: A System for Region-Based Image Indexing and Retrieval, Proceedings of the Third International Conference on Visual Information and Information Systems, p.509-516, June 02-04, 1999
• 2: Vittorio Castelli , Alexander Thomasian , Chung-Sheng Li, CSVD: Clustering and Singular Value Decomposition for Approximate Similarity Search in High-Dimensional Spaces, IEEE Transactions on Knowledge and Data Engineering, v.15 n.3, p.671-685, March 2003 [doi>10.1109/TKDE.2003.1198398]
• 3: Olivier Chapelle, Patrick Haffner, and Vladimir N. Vapnik, "Support vector machines for histogram-based image classification", IEEE Trans. Neural Networks, Vol. 10, No. 5, Sep. 1999
• 4: Yixin Chen , James Z. Wang, A Region-Based Fuzzy Feature Matching Approach to Content-Based Image Retrieval, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.9, p.1252-1267, September 2002 [doi>10.1109/TPAMI.2002.1033216]
• 5: Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995 [doi>10.1109/2.410146]
• 6: Jing Huang , S. Ravi Kumar , Mandar Mitra , Wei-Jing Zhu , Ramin Zabih, Image Indexing Using Color Correlograms, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.762, June 17-19, 1997
• 7: Feng Jing , Mingjing Li , Hong-Jiang Zhang , Bo Zhang, An effective region-based image retrieval framework, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641106]
• 8: Michael J. Kearns , Yishay Mansour, A Fast, Bottom-Up Decision Tree Pruning Algorithm with Near-Optimal Generalization, Proceedings of the Fifteenth International Conference on Machine Learning, p.269-277, July 24-27, 1998
• 9: Guojun Lu, "Techniques and data structures for efficient multimedia retrieval based on similarity", IEEE Trans. on Multimedia, Vol. 4, No. 3, Sep. 2002, pp. 372--384
• 10: W. Y. Ma , B. S. Manjunath, NeTra: a toolbox for navigating large image databases, Proceedings of the 1997 International Conference on Image Processing (ICIP '97) 3-Volume Set-Volume 1, p.568, October 26-29, 1997
• 11: Virginia E. Ogle , Michael Stonebraker, Chabot: Retrieval from a Relational Database of Images, Computer, v.28 n.9, p.40-48, September 1995 [doi>10.1109/2.410150]
• 12: Kriengkrai Porkaew , Kaushik Chakrabarti, Query refinement for multimedia similarity retrieval in MARS, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.235-238, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319613]
• 13: Stuart J. Russell , Peter Norvig, Artificial intelligence: a modern approach, Prentice-Hall, Inc., Upper Saddle River, NJ, 1995
• 14: Simon Tong , Edward Chang, Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500159]
• 15: Vladimir N. Vapnik, The nature of statistical learning theory, Springer-Verlag New York, Inc., New York, NY, 1995
• 16: James Z. Wang , Jia Li , Gio Wiederhold, SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.9, p.947-963, September 2001 [doi>10.1109/34.955109]
• 17: Ruofei Zhang , Zhongfei (Mark) Zhang, A Clustering Based Approach to Efficient Image Retrieval, Proceedings of the 14th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'02), p.339, November 04-06, 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.3 Clustering
          Subjects: Similarity measures

General Terms:
Algorithms, Design, Experimentation, Management, Performance

Keywords:
Adaptive Region Weight Updating (ARWU), Content Based Image Retrieval (CBIR), Fast And Semantics-Tailored Retrieval (FAST), Hierarchical Elimination-based A* Retrieval (HEAR), Indexing Tree Pruning (ITP), fuzzy logic, region based features, relevance feedback