The combination limit in multimedia retrieval

ABSTRACT

Combining search results from multimedia sources is crucial for dealing with heterogeneous multimedia data, particularly in multimedia retrieval where a final ranked list of items of interest is returned sorted by confidence or relevance. However, relatively little attention has been given to combination functions, especially their upper bound performance limits. This paper presents a theoretical framework for studying upper bounds for two types of combination functions. A general upper bound and two approximations are proposed for monotonic combination functions. We also studied the upper bounds for linear combination functions using a global optimization technique. Our experimental results show that the choice of combination functions has a considerable influence to retrieval performance.

REFERENCES

• 1: Cynthia Dwork , Ravi Kumar , Moni Naor , D. Sivakumar, Rank aggregation methods for the Web, Proceedings of the 10th international conference on World Wide Web, p.613-622, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372165]
• 2: Ronald Fagin , Amnon Lotem , Moni Naor, Optimal aggregation algorithms for middleware, Proceedings of the twentieth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, p.102-113, May 2001, Santa Barbara, California, United States [doi>10.1145/375551.375567]
• 3: D. Hush and B. Horne. Efficient algorithms for function approximation with piecewise linear sigmoidal networks. IEEE Trans. Neural Networks, 9(6), 1998.
• 4: Waltraud Huyer , Arnold Neumaier, Global Optimization by Multilevel Coordinate Search, Journal of Global Optimization, v.14 n.4, p.331-355, June 1999 [doi>10.1023/A:1008382309369]
• 5: M. Naphade and et~al. Probabilistic multimedia objects (multijects): A novel approach to video indexing and retrieval in multimedia systems. In Proc. of ICIP, 1998.
• 6: J. R. Smith and et~al. Interactive search fusion methods for video database retrieval. In IEEE Intl. Conf. on Image Processing, Barcelona, Spain, 2003.
• 7: TREC2002. TREC2002 video track, http://www-nlpir.nist.gov/projects/t2002v/t2002v.html.
• 8: R. Yan, A. Hauptmann, and R. Jin. Multimedia search with pseudo-relevance feedback. In International Conference on Image and Video Retrieval, Urbana, IL, USA, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Performance