Image based gisting in CLIR

ABSTRACT

In this paper, we describe research which could lead to a novel approach to gathering an overview of a document in a foreign language. The research explores how much of the meaning of a document could be represented using images by researching the ability of subjects to derive the search term that might have been used to return a set of images from an image library. The Google image search engine was used to retrieve the images for this experiment, which uses English throughout. The results were analysed with respect to a previous paper [1] exploring ability to recognise concrete objects in hierarchies. It was found that there is a tendency to use one particular level of categorization.

REFERENCES

• 1: Rosch, E. Mervis, C., Gray, W, Johnson, D and Boyes-Braem, P. (1976). "Basic Objects in Natural Categories." Cognitive Psychology, 8, 382--439.
• 2: Chandler, D. (2002). Semiotics: The Basics. London: Routledge.
• 3: Kobus Barnard , Matthew Johnson , David Forsyth, Word sense disambiguation with pictures, Proceedings of the HLT-NAACL 2003 workshop on Learning word meaning from non-linguistic data, p.1-5, May 31, 2003 [doi>10.3115/1119212.1119213]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models; Relevance feedback; Query formulation

General Terms:
Languages

Keywords:
basic level, cross language information retrieval, gisting, images