Object detection and matching in a mixed network of fixed and mobile cameras

ABSTRACT

This work tackles the challenge of detecting and matching objects in scenes observed simultaneously by fixed and mobile cameras. No calibration between the cameras is needed, and no training data is used. A fully automated system is presented to detect if an object, observed by a fixed camera, is seen by a mobile camera and where it is localized in its image plane. Only the observations from the fixed camera are used.

An object descriptor based on grids of region descriptors is used in a cascade manner. Fixed and mobile cameras collaborate to confirm detection. Detected regions in the mobile camera are validated by analyzing the dual problem: analyzing their corresponding most similar regions in the fixed camera to check if they coincide with the object of interest.

Experiments show that objects are successfully detected even if the cameras have significant change in image quality, illumination, and viewpoint. Qualitative and quantitative results are presented in indoor and outdoor urban scenes.

REFERENCES

• 1: A. Alahi, M. Bierlaire, and M. Kunt. Object matching with mobile cameras collaborating with fixed cameras. In Submitted to the Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications at ECCV, 2008.
• 2: A. Alahi, D. Marimon, M. Bierlaire, and M. Kunt. A master-slave approach for object detection and matching with fixed and mobile cameras. In Accepted IEEE Int. Conf. on Image Processing (ICIP), San Diego, CA, USA, 2008.
• 3: M. Bertozzi, A. Broggi, R. Chapuis, F. Chausse, A. Fascioli, and A. Tibaldi. Shape-based pedestrian detection and localization. In Procs. IEEE Intl. Conf. on Intelligent Transportation Systems 2003, pages 328--333, Shangai, China, Oct. 2003.
• 4: A. Broggi, M. Bertozzi, A. Fascioli, and M. Sechi. Shape-based pedestrian detection. Proc. IEEE Intelligent Vehicles Symp, pages 215--200, 2000.
• 5: Yaron Caspi , Denis Simakov , Michal Irani, Feature-Based Sequence-to-Sequence Matching, International Journal of Computer Vision, v.68 n.1, p.53-64, June 2006 [doi>10.1007/s11263-005-4842-z]
• 6: Navneet Dalal , Bill Triggs, Histograms of Oriented Gradients for Human Detection, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.886-893, June 20-26, 2005 [doi>10.1109/CVPR.2005.177]
• 7: Francois Fleuret , Jerome Berclaz , Richard Lengagne , Pascal Fua, Multicamera People Tracking with a Probabilistic Occupancy Map, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.30 n.2, p.267-282, February 2008 [doi>10.1109/TPAMI.2007.1174]
• 8: W. Forstner and B. Moonen. A metric for covariance matrices. Qua vadis geodesia, pages 113--128, 1999.
• 9: Dariu Gavrila, Pedestrian Detection from a Moving Vehicle, Proceedings of the 6th European Conference on Computer Vision-Part II, p.37-49, June 26-July 01, 2000
• 10: D. Gavrila and V. Philomin. Real-time object detection for 'smart' vehicles. pages 87--93.
• 11: S. Khan and M. Shah. A multiview approach to tracking people in crowded scenes using a planar homography constraint. pages IV: 133--146, 2006.
• 12: B. Leibe, N. Cornelis, K. Cornelis, L. Van Gool, and E. Zurich. Dynamic 3D Scene Analysis from a Moving Vehicle. CVPR'07, 2007.
• 13: K. Mueller , A. Smolic , M. Droese , P. Voigt , T. Wienand, Multi-texture modeling of 3D traffic scenes, Proceedings of the 2003 International Conference on Multimedia and Expo, p.657-660, July 06-09, 2003
• 14: Michael Oren , Constantine Papageorgiou , Pawan Sinha , Edgar Osuna , Tomaso Poggio, Pedestrian Detection Using Wavelet Templates, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.193, June 17-19, 1997
• 15: C. Papageorgiou and T. Poggio. Trainable pedestrian detection. Image Processing, 1999. ICIP 99. Proceedings. 1999 International Conference on, 4, 1999.
• 16: Fatih Porikli , Oncel Tuzel , Peter Meer, Covariance Tracking using Model Update Based on Lie Algebra, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.728-735, June 17-22, 2006 [doi>10.1109/CVPR.2006.94]
• 17: A. Shashua, Y. Gdalyahu, and G. Hayun. Pedestrian detection for driving assistance systems: Single-frame classification and system level performance. pages 1--6, 2004.
• 18: F. Suard, A. Rakotomamonjy, A. Bensrhair, and A. Broggi. Pedestrian Detection using Infrared images and Histograms of Oriented Gradients. In Procs. IEEE Intelligent Vehicles Symposium 2006, pages 206--212, Tokyo, Japan, June 2006.
• 19: O. Tuzel, F. Porikli, and P. Meer. Region covariance: A fast descriptor for detection and classification. Proc. 9th European Conf. on Computer Vision, 2006.
• 20: O. Tuzel, F. Porikli, and P. Meer. Human Detection via Classification on Riemannian Manifolds. Proc. CVPR, pages 1--8, 2007.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

General Terms:
Algorithms, Performance

Keywords:
object detection, object matching, region descriptor