Visual structures for image browsing

ABSTRACT

Content-Based Image Retrieval (CBIR) presents several challenges and has been subject to extensive research from many domains, such as image processing or database systems. Database researchers are concerned with indexing and querying, whereas image processing experts worry about extracting appropriate image descriptors. Comparatively little work has been done on designing user interfaces for CBIR systems. This, in turn, has a profound effect on these systems since the concept of image similarity is strongly influenced by user perception. This paper describes an initial effort to fill this gap, combining recent research in CBIR and Information Visualization, studied from a Human-Computer Interface perspective. It presents two visualization techniques based on Spiral and Concentric Rings implemented in a CBIR system to explore query results. The approach is centered on keeping user focus on both the query image, and the most similar retrieved images. Experiments conducted so far suggest that the proposed visualization strategies improves system usability.

REFERENCES

• 1: Christopher Ahlberg , Ben Shneiderman, Visual information seeking: tight coupling of dynamic query filters with starfield displays, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.313-317, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191775]
• 2: Benjamin B. Bederson, PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502359]
• 3: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 4: John V. Carlis , Joseph A. Konstan, Interactive visualization of serial periodic data, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.29-38, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288399]
• 5: Ed H. Chi, A Taxonomy of Visualization Techniques Using the Data State Reference Model, Proceedings of the IEEE Symposium on Information Vizualization 2000, p.69, October 09-10, 2000
• 6: Paolo Ciaccia , Marco Patella , Pavel Zezula, M-tree: An Efficient Access Method for Similarity Search in Metric Spaces, Proceedings of the 23rd International Conference on Very Large Data Bases, p.426-435, August 25-29, 1997
• 7: Tammara T. A. Combs , Benjamin B. Bederson, Does zooming improve image browsing?, Proceedings of the fourth ACM conference on Digital libraries, p.130-137, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313286]
• 8: Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995 [doi>10.1109/2.410146]
• 9: Jock D. Mackinlay , George G. Robertson , Robert DeLine, Developing calendar visualizers for the information visualizer, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.109-118, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192470]
• 10: Daniel A. Keim, Information Visualization and Visual Data Mining, IEEE Transactions on Visualization and Computer Graphics, v.8 n.1, p.1-8, January 2002 [doi>10.1109/2945.981847]
• 11: Sean D. MacArthur , Carla E. Brodley , Avinash C. Kak , Lynn S. Broderick, Interactive content-based image retrieval using relevance feedback, Computer Vision and Image Understanding, v.88 n.2, p.55-75, November 2002 [doi>10.1006/cviu.2002.0977]
• 12: Virginia E. Ogle , Michael Stonebraker, Chabot: Retrieval from a Relational Database of Images, Computer, v.28 n.9, p.40-48, September 1995 [doi>10.1109/2.410150]
• 13: Kerry Rodden , Wojciech Basalaj , David Sinclair , Kenneth Wood, Does organisation by similarity assist image browsing?, Proceedings of the SIGCHI conference on Human factors in computing systems, p.190-197, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365097]
• 14: Simone Santini , Amarnath Gupta , Ramesh Jain, Emergent Semantics through Interaction in Image Databases, IEEE Transactions on Knowledge and Data Engineering, v.13 n.3, p.337-351, May 2001 [doi>10.1109/69.929893]
• 15: Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations, Proceedings of the 1996 IEEE Symposium on Visual Languages, p.336, September 03-06, 1996
• 16: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 17: Daniela Stan , Ishwar K. Sethi, eID: a system for exploration of image databases, Information Processing and Management: an International Journal, v.39 n.3, p.335-361, May 2003 [doi>10.1016/S0306-4573(02)00131-0]
• 18: Qi Tian , Baback Moghaddam , Thomas S. Huang, Display Optimization for Image Browsing, Proceedings of the Second International Workshop on Multimedia Databases and Image Communication, p.167-178, September 17-18, 2001
• 19: R. S. Torres. Integrating Image and Spatial Data for Biodiversity Information Management. PhD thesis, Institute of Computing, University of Campinas, 2004. Under development.
• 20: R. S. Torres, A. X. Falcão, and L. F. Costa. Shape Description by Image Foresting Transform. In 14th International Conference on Digital Signal Processing, Santorini, Greece, July 2002.
• 21: R. S. Torres, A. X. Falcão, and L. F. Costa. A Graph-based Approach for Multiscale Shape Analysis. Technical Report IC-0303, Institute of Computing, University of Campinas, January 2003.
• 22: R. S. Torres, E. M. Picado, A. X. Falcão, and L. F. Costa. Effective Image Retrieval by Shape Saliences. In Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI03), São Carlos, São Paulo, Brazil, 12-15 October 2003.
• 23: Shouhong Wang , Hai Wang, Knowledge discovery through self-organizing maps: data visualization and query processing, Knowledge and Information Systems, v.4 n.1, p.31-45, January 2002 [doi>10.1007/s10115-002-8192-7]
• 24: Marc Weber , Marc Alexa , Wolfgang Müller, Visualizing Time-Series on Spirals, Proceedings of the IEEE Symposium on Information Visualization 2001 (INFOVIS'01), p.7, October 22-23, 2001
• 25: Ka-Ping Yee , Danyel Fisher , Rachna Dhamija , Marti Hearst, Animated Exploration of Dynamic Graphs with Radial Layout, Proceedings of the IEEE Symposium on Information Visualization 2001 (INFOVIS'01), p.43, October 22-23, 2001

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Image databases
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback; Query formulation; Search process

General Terms:
Design, Experimentation, Human Factors, Management

Keywords:
content-based Image retrieval (CBIR), focus+context views, image browsing, information visualization, visual structures