Probabilistic multimedia retrieval

ABSTRACT

We present a framework in which probabilistic models for textual and visual information retrieval can be integrated seamlessly. The framework facilitates searching for imagery using textual descriptions and visual examples simultaneously. The underlying Language Models for text and Gaussian Mixture Models for images have proven successful in various retrieval tasks.

REFERENCES

• 1: K. Barnard and D. Forsyth. Learning the semantics of words and pictures. In International Conference on Computer Vision, volume 2, pages 408--415, 2001.
• 2: A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society, series B, 39(1):1--38, 1977.
• 3: D. Hiemstra. Using language models for information retrieval. PhD thesis, Centre for Telematics and Information Technology, University of Twente, 2001.
• 4: John Lafferty , Chengxiang Zhai, Document language models, query models, and risk minimization for information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.111-119, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383970]
• 5: The Lowlands team. Lazy users and automatic video retrieval tools in (the) lowlands. In The 10th Text Retrieval Conference (TREC-2001), 2002.
• 6: Nuno Miguel Borges De Pinho Cruz De Vasconcelos , Andrew B. Lippman, Bayesian models for visual information retrieval, 2000
• 7: T. Westerveld. Image retrieval: Content versus context. In Proceedings of RIAO 2000, volume 1, pages 276--284, Paris, 2000.
• 8: T. Westerveld, A. P. de Vries, D. Hiemstra, F. M. G. de Jong, and A. van Ballegooij. Retrieval experiments with multimodal video. EURASIP Journal on Applied Signal Processing, special issue on Unstructured Information Management from Multimedia Data Sources, 2003, to appear.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Design

Keywords:
language models, mixture models, multimedia retrieval