Canonical image selection from the web

ABSTRACT

The vast majority of the features used in today's commercially deployed image search systems employ techniques that are largely indistinguishable from text-document search - the images returned in response to a query are based on the text of the web pages from which they are linked. Unfortunately, depending on the query type, the quality of this approach can be inconsistent. Several recent studies have demonstrated the effectiveness of using image features to refine search results. However, it is not clear whether (or how much) image-based approach can generalize to larger samples of web queries. Also, the previously used global features often only capture a small part of the image information, which in many cases does not correspond to the distinctive characteristics of the category. This paper explores the use of local features in the concrete task of finding the single canonical images for a collection of commonly searched-for products. Through large-scale user testing, the canonical images found by using only local image features significantly outperformed the top results from Yahoo, Microsoft and Google, highlighting the importance of having these image features as an integral part of future image search engines.

REFERENCES

• 1: S. Belongie , J. Malik , J. Puzicha, Shape Matching and Object Recognition Using Shape Contexts, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.4, p.509-522, April 2002 [doi>10.1109/34.993558]
• 2: R. Fergus , L. Fei-Fei , P. Perona , A. Zisserman, Learning Object Categories from Google"s Image Search, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.1816-1823, October 17-20, 2005 [doi>10.1109/ICCV.2005.142]
• 3: R. Fergus, P. Perona, and A. Zisserman. A visual category filter for google images. In Proceedings of the 8th European Conference on Computer Vision, Prague, Czech Republic, pages 242--256, May 2004.
• 4: Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995 [doi>10.1109/2.410146]
• 5: C. Harris and M. Stephens. A Combined Corner and Edge Detector. In PRoc. 4th ALVEY Vision Conference, pages 147--151, 1988.
• 6: R. Jain. Infoscopes, multimedia information systems. Multimedia Systems and Techniques, 1996.
• 7: S. Lazebnik, C. Schmid, and J. Ponce. A sparse texture representation using affine-invariant regions. In Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2003., pages 319--324, 2003.
• 8: T. Liu, A. W. Moore, A. Gray, and K. Yang. An investigation of practical approximate nearest neighbor algorithms. In Proc. 17th Conference on Advances in Neural Information Processing Systems (NIPS), pages 825--832, Cambridge, MA, 2005. MIT Press.
• 9: David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
• 10: Krystian Mikolajczyk , Cordelia Schmid, A Performance Evaluation of Local Descriptors, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.27 n.10, p.1615-1630, October 2005 [doi>10.1109/TPAMI.2005.188]
• 11: G. Park, Y. Baek, and H. Lee. Majority based ranking approach in web image retrieval. pages 111--120, 2003.
• 12: Y. Rui, T. Huang, and S. Chang. Image retrieval: current techniques, promising directions and open issues. Journal of Visual Communication and Image Representation, 10(4):39--62, Apr. 1999.
• 13: Simone Santini , Ramesh Jain, Similarity Measures, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.21 n.9, p.871-883, September 1999 [doi>10.1109/34.790428]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

Keywords:
local features, web image retrieval