Pose robust human detection using multiple oriented 2d elliptical filters

ABSTRACT

This paper proposes a pose robust human detection method from a sequence of stereo images using the multiple oriented 2D elliptical filters (MO2DEFs), which can detect the humans regardless of the their scales and poses. Existing object oriented scale adaptive filter (OOSAF) has some disadvantages since they cannot detect the human with an arbitrary pose. To overcome this limitation, we introduce the pose robust MO2DEFs whose shapes are the oriented ellipses. We perform human detection by applying four 2D elliptical filters with specific orientations to the 2D spatial-depth histogram and by taking the thresholds over the filtered histograms. In addition, we determine the human pose by taking the orientation of the 2D elliptical filter whose convolution result is maximal among the MO2DEFs. We verify the human candidates by either detecting the face or matching head-shoulder shapes over the segmented human candidates of the selected rotation. The experimental results show that (1) the accuracy of pose angle estimation is about 88%, (2) the human detection using the proposed MO2DEFs outperforms that of using the existing OOSAF by 15~20%, especially in case of the posed human.

REFERENCES

• 1: Mohamed Hussein , Wael Abd-Almageed , Yang Ran , Larry Davis, Real-Time Human Detection, Tracking, and Verification in Uncontrolled Camera Motion Environments, Proceedings of the Fourth IEEE International Conference on Computer Vision Systems, p.41, January 04-07, 2006 [doi>10.1109/ICVS.2006.52]
• 2: S. Ghidary, Y. Nakata, T. Takamori, and M. Hattori. Localization and approaching to the human by mobile human robot. In Proc. of 9th IEEE International Workshop on Robot and Human Interactive Communication pages 63--68, 2000.
• 3: Jianpeng Zhou , Jack Hoang, Real Time Robust Human Detection and Tracking System, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, p.149, June 20-26, 2005 [doi>10.1109/CVPR.2005.517]
• 4: D. Beymer and K. Konolige. Real-time tracking of multiple people using continuous detection. In Proc. of International Conference on Computer Vision 1999.
• 5: R. Salinas, E. Aguirre, M. Silvente, and A. Gonzalez. People detection and tracking through stereo vision for human-robot interaction. In Proc. of 4th Mexican international conference on artificial intelligence pages 337--346, 2005.
• 6: L. Li, Y. Koh, S. Ge, and W. Huang. Stereo-based human detection for mobile service robots. In Proc. of 8th International Conference on Control, Automation, Robotics, and Vision pages 74--79, 2004.
• 7: L. Li, S. Ge, T. Sim, Y. Koh, and X. Hunag. Object-oriented scale-adaptive filtering for human detection from stereo images. In Proc. of the 2004 IEEE Conference on Cybernetics and Intelligent Systems pages 135--140, 2004.
• 8: H. Barrow. Parametric correspondence and chamfer matching: two new techniques for image matching. In Proc. of the International Joint Conference on Artificial Intelligence pages 659--663, 1977
• 9: B. Jun and D. Kim. Robust real-time face detection using face certainty map. In Proc. of The 2nd International Conference on Biometrics (ICB 2007) pages 29--38, 2007.
• 10: Y. Kameda and M. Minoh. A human motion estimation method using 3-successive video frames. In Proc. of the International Conference on Virtual Systems and Multimedia 1996.
• 11: C. Kim and J. Hwang. A fast and robust moving object segmentation in video sequences. In Proc. of International Conference on Image Processing pages 131--134, 1999.
• 12: T. F. Cootes , C. J. Taylor , D. H. Cooper , J. Graham, Active shape models—their training and application, Computer Vision and Image Understanding, v.61 n.1, p.38-59, Jan. 1995 [doi>10.1006/cviu.1995.1004]
• 13: Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000
• 14: P. Mahalanobis. On the generalized distance in statistics. In Proc. of the National Institute of Science of India pages 49--55, 1936.
• 15: Point Gray Research Inc. http://www. ptgrey. com/.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Stereo

General Terms:
Algorithms, Experimentation, Performance

Keywords:
face detection, human detection, human verification, multiple oriented 2d elliptical filter, pose angle estimation, shape