Does organisation by similarity assist image browsing?

ABSTRACT

In current systems for browsing image collections, users are presented with sets of thumbnail images arranged in some default order on the screen. We are investigating whether it benefits users to have sets of thumbnails arranged according to their mutual similarity, so images that are alike are placed together. There are, of course, many possible definitions of “similarity”: so far we have explored measurements based on low-level visual features, and on the textual captions assigned to the images. Here we describe two experiments, both involving designers as the participants, examining whether similarity-based arrangements of the candidate images are helpful for a picture selection task. Firstly, the two types of similarity-based arrangement were informally compared. Then, an arrangement based on visual similarity was more formally compared with a control of a random arrangement. We believe this work should be of interest to anyone designing a system that involves presenting sets of images to users.

REFERENCES

• 1: Armitage, L.H., and Enser, P.G.B. Analysis of user need in image archives. Journal of Information Science 23(4), 1997, 287-299.
• 2: Basalaj, W. Proximity visualisation of abstract data. PhD thesis, University of Cambridge Computer Laboratory, 2000.
• 3: Borg, I., and Groenen, P. Modern multidimensional scaling. New York: Springer-Verlag, 1997.
• 4: Borlund, P., and Ingwersen, P. The development of a method for the evaluation of interactive information retrieval systems. Journal of Documentation 53(3), 1997, 225-250.
• 5: Matthew Chalmers , Robert Ingram , Christoph Pfranger, Adding imageability features to information displays, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.33-39, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237096]
• 6: Chen, C, and Czerwinski, M. Spatial ability and visual navigation: an empirical study. The New Review of Hypermedia and Multimedia, 3, 67-89.
• 7: Tammara T. A. Combs , Benjamin B. Bederson, Does zooming improve image browsing?, Proceedings of the fourth ACM conference on Digital libraries, p.130-137, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313286]
• 8: Sharon R. Garber , Mitch B. Grunes, The art of search: a study of art directors, Proceedings of the SIGCHI conference on Human factors in computing systems, p.157-163, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142780]
• 9: Joemon M. Jose , Jonathan Furner , David J. Harper, Spatial querying for image retrieval: a user-oriented evaluation, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.232-240, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291000]
• 10: Leuski, A., and Allan, J. Improving interactive retrieval by combining ranked lists and clustering. Proc. RIAO 2000.
• 11: Marjo Markkula , Eero Sormunen, End-User Searching Challenges Indexing Practices inthe Digital Newspaper Photo Archive, Information Retrieval, v.1 n.4, p.259-285, January 2000 [doi>10.1023/A:1009995816485]
• 12: Raven, J.C. Raven's Advanced Progressive Matrices. Psychological Corporation, http://www.psychcorp.com.
• 13: Rodden, K. Evaluating user interfaces for image browsing and retrieval. PhD thesis, University of Cambridge Computer Laboratory, 2001.
• 14: Kerry Rodden , Wojciech Basalaj , David Sinclair , Kenneth Wood, Evaluating a Visualization of Image Similarity as a Tool for Image Browsing, Proceedings of the 1999 IEEE Symposium on Information Visualization, p.36, October 24-29, 1999
• 15: Kerry Rodden , Wojciech Basalaj , David Sinclair , Kenneth Wood, Evaluating a visualisation of image similarity (poster abstract), Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.275-276, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312693]
• 16: Rose, T., Elworthy, D., Kotcheff, A., Clare, A., and Tsonis, P. ANVIL: a system for the retrieval of captioned images using NLP techniques. Proc. CIR2000, BCS (http://www.ewic.org.uk), 2000.
• 17: Yossi Rubner , Carlo Tomasi , Leonidas J. Guibas, Adaptive Color-Image Embeddings for Database Navigation, Proceedings of the Third Asian Conference on Computer Vision-Volume I, p.104-111, January 08-10, 1998
• 18: Russell C. Swan , James Allan, Aspect windows, 3-D visualizations, and indirect comparisons of information retrieval systems, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.173-181, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290987]
• 19: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Image databases
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Design, Experimentation, Human Factors, Management, Measurement, Performance, Theory

Keywords:
evaluation, image retrieval, information visualisation