Faceted metadata for image search and browsing

ABSTRACT

There are currently two dominant interface types for searching and browsing large image collections: keyword-based search, and searching by overall similarity to sample images. We present an alternative based on enabling users to navigate along conceptual dimensions that describe the images. The interface makes use of hierarchical faceted metadata and dynamically generated query previews. A usability study, in which 32 art history students explored a collection of 35,000 fine arts images, compares this approach to a standard image search interface. Despite the unfamiliarity and power of the interface (attributes that often lead to rejection of new search interfaces), the study results show that 90% of the participants preferred the metadata approach overall, 97% said that it helped them learn more about the collection, 75% found it more flexible, and 72% found it easier to use than a standard baseline system. These results indicate that a category-based approach is a successful way to provide access to image collections.

REFERENCES

• 1: L. H. Armitage and P. G. B. Enser. Analysis of user need in image archives. Journal of Information Science, 23(4):287--299, 1997.
• 2: M. L. Bernard. Examining the effects of hypertext shape on user performance. Usability News, 4(2), 2002.
• 3: P. Borland and P. Ingwersen. The development of a method for the evaluation of interactive information retrieval systems. Journal of Documentation, 53(3):225--250, 1997.
• 4: Chad Carson , Megan Thomas , Serge Belongie , Joseph M. Hellerstein , Jitendra Malik, Blobworld: A System for Region-Based Image Indexing and Retrieval, Proceedings of the Third International Conference on Visual Information and Information Systems, p.509-516, June 02-04, 1999
• 5: Ame Marie Elliott , Jean-Pierre Protzen, Computational support for sketching and image sorting during the early phase of architectural design, 2002
• 6: C. Fellbaum, editor. WordNet: An Electronic Lexical Database. MIT Press, 1998.
• 7: Sharon R. Garber , Mitch B. Grunes, The art of search: a study of art directors, Proceedings of the SIGCHI conference on Human factors in computing systems, p.157-163, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142780]
• 8: Marti Hearst , Ame Elliott , Jennifer English , Rashmi Sinha , Kirsten Swearingen , Ka-Ping Yee, Finding the flow in web site search, Communications of the ACM, v.45 n.9, September 2002 [doi>10.1145/567498.567525]
• 9: Joemon M. Jose , Jonathan Furner , David J. Harper, Spatial querying for image retrieval: a user-oriented evaluation, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.232-240, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291000]
• 10: Marjo Markkula , Eero Sormunen, End-User Searching Challenges Indexing Practices inthe Digital Newspaper Photo Archive, Information Retrieval, v.1 n.4, p.259-285, January 2000 [doi>10.1023/A:1009995816485]
• 11: Jack Muramatsu , Wanda Pratt, Transparent Queries: investigation users' mental models of search engines, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.217-224, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383991]
• 12: W. Niblack, R. Barber, W. Equitz, M. Flickner, E. Glasman, D. Petkovic, P. Yanker, and C. Faloutsos. The QBIC project: Querying images by content using color, texture, and shape. SPIE: Storage and Retrieval for Image and Video Databases, 1908, 1993.
• 13: Michael Ortega , Yong Rui , Kaushik Chakrabarti , Sharad Mehrotra , Thomas S. Huang, Supporting similarity queries in MARS, Proceedings of the fifth ACM international conference on Multimedia, p.403-413, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266394]
• 14: Catherine Plaisant , Ben Shneiderman , Khoa Doan , Tom Bruns, Interface and data architecture for query preview in networked information systems, ACM Transactions on Information Systems (TOIS), v.17 n.3, p.320-341, July 1999 [doi>10.1145/314516.314522]
• 15: Kerry Rodden , Wojciech Basalaj , David Sinclair , Kenneth Wood, Does organisation by similarity assist image browsing?, Proceedings of the SIGCHI conference on Human factors in computing systems, p.190-197, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365097]
• 16: Ben Shneiderman , Donald Byrd , W. Bruce Croft, Sorting out searching: a user-interface framework for text searches, Communications of the ACM, v.41 n.4, p.95-98, April 1998 [doi>10.1145/273035.273069]
• 17: Rohini K. Srihari , Zhongfei Zhang , Aibing Rao, Intelligent Indexing and Semantic Retrieval of Multimodal Documents, Information Retrieval, v.2 n.2-3, p.245-275, May 2000 [doi>10.1023/A:1009962928226]
• 18: R. C. Veltkamp and M. Tanase. Content-Based Image Retrieval Systems: A Survey. Technical Report UU-CS-2000-34, Dept. of Computing Science, Utrecht University, 2000.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Image databases
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process
      H.3.7 Digital Libraries
          Subjects: User issues

General Terms:
Design, Human Factors

Keywords:
faceted metadata, image search interfaces