Multi-sensor fusion for human daily activity recognition in robot-assisted living

ABSTRACT

In this paper, we propose a human activity recognition method by fusing the data from two wearable inertial sensors attached to one foot and the waist of a human subject, respectively. Our multi-sensor fusion based method combines neural networks and hidden Markov models (HMMs), and can reduce the computation load. We conducted experiments using a prototype wearable sensor system and the obtained results prove the effectiveness and the accuracy of our algorithm.

REFERENCES

• 1: C. Zhu, W. Sun, and W. Sheng, "Wearable sensors based human intention recognition in smart assisted living systems, in IEEE International Conference on Information and Automation, 954--959, 2008.
• 2: C. Zhu, Q. Cheng, and W. Sheng, "Human intention recognition in smart assisted living systems using a hierarchical hidden Markov model," IEEE International Conference on Automation Science and Engineering, 253--258, 2008.
• 3: Guang-Zhong Yang, Body Sensor Networks, Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 4: A. Ohta and N. Amano,"Vision-based human behavior recognition by a mobile robot,"SICE. Annual Conference, 3047--3051, 2007.
• 5: Thomas B. Moeslund , Adrian Hilton , Volker Krüger, A survey of advances in vision-based human motion capture and analysis, Computer Vision and Image Understanding, v.104 n.2, p.90-126, November 2006 [doi>10.1016/j.cviu.2006.08.002]
• 6: K. Aminian, Ph. Robert, E. E. Buchser, B. Rutschmann, D. Hayoz, and M. Depairon,"Physical activity monitoring based on accelerometry: validation and comparison with video observation,"Medical and Biological Engineering and Computing, 3:304.
• 7: T. Mitchell, Decision tree learning,"Machine Learning, 52--78, 1997.
• 8: Daniel Lowd , Pedro Domingos, Naive Bayes models for probability estimation, Proceedings of the 22nd international conference on Machine learning, p.529-536, August 07-11, 2005, Bonn, Germany [doi>10.1145/1102351.1102418]
• 9: Lawrence R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, Readings in speech recognition, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1990

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications

General Terms:
Algorithms, Design, Documentation, Experimentation, Verification

Keywords:
activity recognition, assisted living, sensor fusion, wearable sensor