Performance analysis for gait in camera networks

ABSTRACT

This paper deploys gait analysis for subject identification in multi-camera surveillance scenarios. We present a new method for viewpoint independent markerless gait analysis that does not require camera calibration and works with a wide range of directions of walking. These properties make the proposed method particularly suitable for gait identification in real surveillance scenarios where people and their behaviour need to be tracked across a set of cameras. Tests on 300 synthetic and real video sequences, with subjects walking freely along different walking directions, have been performed. Since the choice of the cameras' characteristics is a key-point for the development of a smart surveillance system, the performance of the proposed approach is measured with respect to different video properties: spatial resolution, frame-rate, data compression and image quality. The obtained results show that markerless gait analysis can be achieved without any knowledge of camera's position and subject's pose. The extracted gait parameters allow recognition of people walking from different views with a mean recognition rate of 92.2% and confirm that gait can be effectively used for subjects' identification in a multi-camera surveillance scenario.

REFERENCES

• 1: www.cc.gatech.edu/cpl/projects/hid.
• 2: Casia gait database. online, 2006.
• 3: Chiraz Ben Abdelkader, Motion-Based Recognition of People in EigenGait Space, Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, p.267, May 20-21, 2002
• 4: B. Bhanu and J. Han. Human recognition on combining kinematic and stationary features. In Proc Int Conf AVBPA, pages 600--608, 2003.
• 5: James Black , Tim Ellis , Paul Rosin, Multi View Image Surveillance and Tracking, Proceedings of the Workshop on Motion and Video Computing, p.169, December 05-06, 2002
• 6: I. Bouchrika and M. S. Nixon. Model-Based Feature Extraction for Gait Analysis and Recognition, volume 4418 of LNCS. Springer, 2007.
• 7: Y. Cai, W. Chen, K. Huang, and T. Tan. Continuously tracking objects across multiple widely separated cameras. In ACCV (1), pages 843--852, 2007.
• 8: T. Chau. A review of analytical techniques for gait data. Part 1: fuzzy, statistical and fractal methods. Gait Posture, 13(1):49--66, 2001.
• 9: A. Chilgunde, P. Kumar, S. Ranganath, and H. WeiMin. Multi-camera target tracking in blind regions of cameras with non-overlapping fields of view.In British Machine Vision Conference, pages --, 2004.
• 10: Robert T. Collins , Ralph Gross , Jianbo Shi, Silhouette-Based Human Identification from Body Shape and Gait, Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, p.366, May 20-21, 2002
• 11: J. Cutting and L. Kozlowski. Recognizing friends by their walk: gait perception without familiarity cues. Bull. Psychonom. Soc., 9:353--356, 1977.
• 12: W. T. Dempster and G. R. L. Gaughran. Properties of body segments based on size and weight. Am J Anat, 120:33--54, 1965.
• 13: Robert B. Fisher, Self-Organization of Randomly Placed Sensors, Proceedings of the 7th European Conference on Computer Vision-Part IV, p.146-160, May 28-31, 2002
• 14: A. Gilbert and R. Bowden. Tracking objects across cameras by incrementally learning inter-camera colour calibration and patterns of activity. pages 125--136, 2006.
• 15: M. Goffredo, R. D. Seely, J. N. Carter, and M. S. Nixon. Markerless view independent gait analysis with self-camera calibration. Proc. IEEE Conf. on Automatic Face and Gesture Recognition, 2008.
• 16: M. Goffredo, N. Spencer, D. Pearce, J. N. Carter, and M. S. Nixon. Human Perambulation as a Self Calibrating Biometric., volume 4778 of LNCS. Springer, 2007.
• 17: R. Gross and J. Shi. The cmu motion of body (mobo) database. Technical Report CMU-RI-TR-01-18, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, 2001.
• 18: Robert M. Haralick , Linda G. Shapiro, Computer and Robot Vision, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 19: W. Hu, T. Tan, L. Wang, and S. Maybank. A survey on visual surveillance of object motion and behaviors. IEEE Trans Systems Man Cybernetics, 34(3):334--352, 2004.
• 20: P. Huang, C. Harris, and M. Nixon. Recognising humans by gait via parametric canonical space. J Artif Intell Eng, 13(4):359--366, 1999.
• 21: T. Huang and S. Russell. Object identification in a bayesian context. In IJCAI97, pages 1276--1282, 1997.
• 22: Adrian Ilie , Greg Welch, Ensuring Color Consistency across Multiple Cameras, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.1268-1275, October 17-20, 2005 [doi>10.1109/ICCV.2005.88]
• 23: Omar Javed , Zeeshan Rasheed , Khurram Shafique , Mubarak Shah, Tracking Across Multiple Cameras With Disjoint Views, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.952, October 13-16, 2003
• 24: Amit Kale , Amit K. Roy Chowdhury , Rama Chellappa, Towards a View Invariant Gait Recognition Algorithm, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, p.143, July 21-22, 2003
• 25: S. Kang, J. Min, and J.-K. Paik. Multiple-camera tracking system with seamless object handover. volume 4303, pages 27--34. SPIE, 2001.
• 26: V. Kettnaker and R. Zabih. Bayesian multi-camera surveillance. IEEE Conf. on Computer Vision and Pattern Recognition, 2:--259 Vol. 2, 1999.
• 27: S. Khan and M. Shah. Consistent labeling of tracked objects in multiple cameras with overlapping fields of view. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 25(10):1355--1360, Oct. 2003.
• 28: D. Makris, T. Ellis, and J. Black. Bridging the gaps between cameras. Proc. IEEE Computer Vision and Pattern Recognition, 2:II-205--II-210 Vol.2, June-2 July 2004.
• 29: L. Middleton, D. K. Wagg, A. I. Bazin, J. N. Carter, and M. S. Nixon. Developing a non-intrusive biometric environment. Proc IEEE Int Conf IROS, pages 723--728, 2006.
• 30: M. P. Murray, A. B. Drought, and R. C. Kory. Walking patterns of normal men. J Bone Joint Surgery, 46:335, 1964.
• 31: Chaowei Niu , Eric Grimson, Recovering Non-overlapping Network Topology Using Far-field Vehicle Tracking Data, Proceedings of the 18th International Conference on Pattern Recognition, p.944-949, August 20-24, 2006 [doi>10.1109/ICPR.2006.985]
• 32: M. Nixon and A. Aguado. Feature Extraction & Image Processing. Academic Press, 2nd edition, Dec. 2007.
• 33: M. S. Nixon and J. N. Carter. Automatic recognition by gait. Proc. of the IEEE, 94(11):2013--2024, 2006.
• 34: Carlos Orrite-Urunuela , Jesus Martinez del Rincon , J. Elias Herrero-Jaraba , Gregory Rogez, 2D Silhouette and 3D Skeletal Models for Human Detection and Tracking, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4, p.244-247, August 23-26, 2004 [doi>10.1109/ICPR.2004.4]
• 35: P. Jonathon Phillips , Sudeep Sarkar , Isidro Robledo , Patrick Grother , Kevin Bowyer, The Gait Identification Challenge Problem: Data Sets and Baseline Algorithm, Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1, p.10385, August 11-15, 2002
• 36: P. Jonathon Phillips , Hyeonjoon Moon , Syed A. Rizvi , Patrick J. Rauss, The FERET Evaluation Methodology for Face-Recognition Algorithms, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.10, p.1090-1104, October 2000 [doi>10.1109/34.879790]
• 37: A. Rahimi, B. Dunagan, and T. Darrell. Simultaneous calibration and tracking with a network of non-overlapping sensors. Proc. Computer Vision and Pattern Recognition, 1:I-187--I-194 Vol.1, June-2 July 2004.
• 38: J. Shutler, M. Grant, M. S. Nixon, and J. N. Carter. On a large sequence-based human gait database. In Proc Int Conf Recent Advances in Soft Computing, pages 66--72, 2002.
• 39: Scott Stillman , Irfan Essa, Towards reliable multimodal sensing in aware environments, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971499]
• 40: Kinh Tieu , Gerald Dalley , W. Eric L. Grimson, Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.1842-1849, October 17-20, 2005 [doi>10.1109/ICCV.2005.122]
• 41: G. Veres, L. Gordon, J. Carter, and M. Nixon. What image information is important in silhouette-based gait recognition? Proc IEEE Conf CVPR, 2:II-776--II-782 Vol.2, 2004.
• 42: L. Wang, T. Tan, W. Hu, and H. Ning. Automatic gait recognition based on statistical shape analysis. IEEE Trans IP, 12(9):1120--1131, 2003.
• 43: Liang Wang , Tieniu Tan , Huazhong Ning , Weiming Hu, Silhouette Analysis-Based Gait Recognition for Human Identification, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.25 n.12, p.1505-1518, December 2003 [doi>10.1109/TPAMI.2003.1251144]
• 44: Y. Yamada. Advanced method for improvement of obscure video image. Proc. IEEE 33rd Annual Carnahan Conference on Security Technology, pages 440--445, 1999.
• 45: Rong Zhang , Christian Vogler , Dimitris Metaxas, Human gait recognition at sagittal plane, Image and Vision Computing, v.25 n.3, p.321-330, March, 2007 [doi>10.1016/j.imavis.2005.10.007]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
      I.4.9 Applications

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.5 Security and Protection (D.4.6, K.4.2)

General Terms:
Algorithms, Experimentation, Performance

Keywords:
biometrics, gait analysis, multi-view, object handover, survelliance