Scenario optimization for interactive category search

ABSTRACT

Most of the existing work in interactive content based retrieval concentrates on machine learning methods for effective use of relevance feedback. On the other end of the spectrum, the information visualization community focusses on effective methods for conveying information to the user. What lacks is research considering the information visualization and interactive content based retrieval as truly integrated parts of one search system. In such an integrated system there are many degrees of freedom like the number of images to display, the image size, different visualization modes, and possible feedback modes. To find optimal values for all of those using user studies is unfeasible. We therefore develop scenarios in which tasks and user actions are simulated. These are then optimized based on objective constraints and evaluation criteria. In such a manner the degrees of freedom are reduced and the remaining degrees can be evaluated in user studies. In this paper we present a system which integrates advanced similarity based visualization with active learning. We have performed extensive scenario based experimentation on an interactive category search task. The results show that indeed the use of advanced visualization and active learning pays off.

REFERENCES

• 1: C. Chang and C. Lin. Libsvm: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
• 2: Y. Chen, X.S.Zhou, and T. Huang. One-class svm for learning in image retrieval. ICIP, 1:34--37, 2001.
• 3: P. Gosselin and M. Cord. Retin al: an active learning strategy for image category retrieval. ICIP, 2004.
• 4: G. Guo, A. Jain, W. Ma, and H. Zhang. Learning similarity measure for natural image retrieval with relevance feedback. CVPR, 2001.
• 5: D. Heesch and S. Ruger. Three interfaces for content-based access to image collections. CIVR, pages 491--499, 2004.
• 6: Larry M. Manevitz , Malik Yousef, One-class svms for document classification, The Journal of Machine Learning Research, 2, 3/1/2002
• 7: G. Nguyen and M. Worring. Similarity based visualization of image collections. Proc. of 7th Intl. Workshop on Audio-Visual Content and Information Visualization in Digital Libraries, 2005.
• 8: H. Nguyen and A. Smeulders. Everything gets better all the time, apart from the amount of data. CIVR, 2004.
• 9: Kerry Rodden , Wojciech Basalaj , David Sinclair , Kenneth Wood, Evaluating a Visualization of Image Similarity as a Tool for Image Browsing, Proceedings of the 1999 IEEE Symposium on Information Visualization, p.36, October 24-29, 1999
• 10: Kerry Rodden , Wojciech Basalaj , David Sinclair , Kenneth Wood, Does organisation by similarity assist image browsing?, Proceedings of the SIGCHI conference on Human factors in computing systems, p.190-197, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365097]
• 11: Y. Rui, T. Huang, and S. Mehrotra. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. on Curcuits and Video Technology, 8(5):644--655, 1998.
• 12: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 13: Simon Tong , Edward Chang, Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500159]
• 14: X. Zhou and T. Huang. Relevance feedback in image retrieval: a compredensive overview. Multimedia Systems, 8(6):536--544, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Design, Performance, Theory

Keywords:
active learning, interactive search, relevance feedback, similarity based visualization