Person-based search in videos

ABSTRACT

This technical demo is build around a system we developed to automatically match persons within a video sequence. The persons are clustered by face similarity and shot information. The demo is a video editing tool with a "person query" option to show only that part of the sequence that features one of the selected actors. The demo is targeted for narrative content: series and movies, and shows the ability of the underlying person matching algorithm to operate well in a general (unconstrained) case.

REFERENCES

• 1: Nesvadba, J., Ernst, F., Perhavc, J., Benois-Pineau, J., Primaux, L. Comparison of shot boundary detectors. IEEE International Conference on Multimedia and Expo, 2005.
• 2: Viola, P., Jones, M. Rapid object detection using a boosted cascade of simple features. Proceedings of Computer Vision and Pattern Recognition, 2001, 511--518.
• 3: B. Kroon , A. Hanjalic , S. Boughorbel, Comparison of face matching techniques under pose variation, Proceedings of the 6th ACM international conference on Image and video retrieval, p.272-279, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282323]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

General Terms:
Algorithms, Design, Experimentation

Keywords:
face clustering, face matching, person matching, person retrieval