Video measurement of resident-on-resident physical aggression in nursing homes

ABSTRACT

Automated detection of aggressive behaviors captured in continuously recorded nursing home video can increase the accuracy of those reported by subjects and caregivers. We implement a detection algorithm based on the extraction of features as local binary motion descriptors, and apply a novel clustering algorithm to merge similar LBMD's into a video codebook, and build recognizers to classify aggressive from non-aggressive behaviors. This facilitates clinical investigation into this difficult to measure low frequency but high impact behavior.

REFERENCES

• 1: Shivani Agarwal , Aatif Awan , Dan Roth, Learning to Detect Objects in Images via a Sparse, Part-Based Representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.11, p.1475-1490, November 2004 [doi>10.1109/TPAMI.2004.108]
• 2: Akita, K. 1984, Image sequence analysis of real world human motion, Pattern Recognition, 17(1):73--83, 1984
• 3: Basu, S., Bilenko, M., Banerjess, A. and Mooney, R. J. 2006, Probabilistic Semi-Supervised Clustering with Constraints, In Semi-Supervised Learning, MIT Press, 2006.
• 4: Aaron F. Bobick , James W. Davis, The Recognition of Human Movement Using Temporal Templates, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.3, p.257-267, March 2001 [doi>10.1109/34.910878]
• 5: Christoph Bregler, Learning and Recognizing Human Dynamics in Video Sequences, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.568, June 17-19, 1997
• 6: CareMedia http://www.informedia.cs.cmu.edu/caremedia.
• 7: Chen, M. Long Term Activity Analysis in Surveillance Video Archives, TR Language Technologies Institute, Carnegie Mellon University, March 2008
• 8: Dollár, P., Rabaud, V, Gottrell, G. and Belongie, S. 2005. Behavior Recognition via Sparse Spatio-Temporal Features, In VS-PETS 2005, page 65--72
• 9: Deutscher, J., Blake, A. and Reid, I. Articulated body motion capture by annealed particle filtering. In IEEE CVPR, volume 2, pages 126--133, 2000.
• 10: Farrell Miller M. Physically aggressive resident behavior during hygienic care. J Gerontol Nurs 1997; 23:24--39.
• 11: Fergus, R., Perona, P., and Zisserman, A. 2003, Object class recognition by unsupervised scale-invariant learning, In CVPR, 2003
• 12: Hoeffer B, Talerico KA, Rasin J, Mitchell M, Stewart BJ, McKenzie D, Barrick AL, Rader J, Sloane PD. Assisting cognitively impaired nursing home residents with bathing: effects of two bathing interventions on caregiving. Gerontologist 2006;46:524--532.
• 13: Hogg, D. 1983, Model-based vision: a program to see a walking person. Image and Vision Computing, 1(1):5--20
• 14: Hu, W., Tan, T., Wang, L., and Maybank, S. A Survey on Visual Surveillance of Object Motion and Behaviors, IEEE Trans. SMC 3(34), Aug. 2004
• 15: Johnson E. Violence in nursing homes a growing concern. Available at: http://www.myinky.com/ecp/news/article/0,1626,ECP_734_1581923,00.html, December 2, 2002.
• 16: Yan Ke , Rahul Sukthankar , Martial Hebert, Efficient Visual Event Detection Using Volumetric Features, Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, p.166-173, October 17-20, 2005 [doi>10.1109/ICCV.2005.85]
• 17: Lachs M, Bachman R, Williams CS, O'Leary JR. Resident-to-resident elder mistreatment and police contact in nursing homes: findings from a population-based cohort. J Am Geriatr Soc 2007;55:840--845.
• 18: Ivan Laptev , Tony Lindeberg, Space-time Interest Points, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.432, October 13-16, 2003
• 19: Mun Wai Lee , Isaac Cohen , Soon Ki Jung, Particle Filter with Analytical Inference for Human Body Tracking, Proceedings of the Workshop on Motion and Video Computing, p.159, December 05-06, 2002
• 20: David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
• 21: Niebles, J.C., Wang, H., Li,. F. Unsupervised learning of human action categories using spatio-temporal words. 1983
• 22: Polana, R., and Nelson, R. 1994, Low level recognition of human motion (or how to get your man without finding his body parts). In Proc. of IEEE Computer Society Workshop on Motion of Non-Rigid and Articulated Objects, p. 77--82, Austin TX, 1994
• 23: Christian Schuldt , Ivan Laptev , Barbara Caputo, Recognizing Human Actions: A Local SVM Approach, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3, p.32-36, August 23-26, 2004 [doi>10.1109/ICPR.2004.747]
• 24: Sherrell K, Anderson R, Buckwalter K. Invisible residents: the chronically mentally ill elderly in nursing homes. Arch Psychiatr Nurs 1998;12:131--139.
• 25: Shinoda-Tagawa T, Leonard R, Pontikas J, McDonough JE, Allen D, Dreyer PI. Resident-to-resident violent incidents in nursing homes. JAMA 2004;291:591--598.
• 26: Jun Yang , Yu-Gang Jiang , Alexander G. Hauptmann , Chong-Wah Ngo, Evaluating bag-of-visual-words representations in scene classification, Proceedings of the international workshop on Workshop on multimedia information retrieval, September 24-29, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290082.1290111]
• 27: Wang, X., Wu, C. Approach of automatic multithreshold image segmation, in the 3rd World Congress on Intelligent Control and Automation, June 2000.
• 28: Yamato, J., Ohya, J., and Ishii, K. 1992, Recognizing human action in time-sequential images using Hiden Markov Model, In CVPR, p. 379--385, Champaign, IL, June 1992

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Motion

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking; Time-varying imagery

  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES
      Subjects: Health
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Algorithms, Design, Human Factors

Keywords:
behavior analysis, caremedia, informedia, psycho-social behavior, video monitoring