Improving the recognition of interleaved activities

ABSTRACT

We introduce Interleaved Hidden Markov Models for recognizing multitasked activities. The model captures both inter-activity and intra-activity dynamics. Although the state space is intractably large, we describe an approximation that is both effective and efficient. This method significantly reduces the error rate when compared with previously proposed methods. The algorithm is suitable for mobile platforms where computational resources may be limited.

REFERENCES

• 1: Thi V. Duong , Hung H. Bui , Dinh Q. Phung , Svetha Venkatesh, Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.838-845, June 20-26, 2005 [doi>10.1109/CVPR.2005.61]
• 2: Zoubin Ghahramani , Geoffrey E. Hinton, Variational Learning for Switching State-Space Models, Neural Computation, v.12 n.4, p.831-864, April 2000 [doi>10.1162/089976600300015619]
• 3: E. Horvitz, J. Breese, D. Heckerman, D. Hovel, and K. Rommelse. The Lumiere project: Bayesian user modeling for inferring the goals and needs of software users. In Proc. of the 14th Conf. on Uncertainty in Artificial Intelligence, pages 256--265, 1998.
• 4: Kenneth P. Fishkin , Matthai Philipose , Adam Rea, Hands-On RFID: Wireless Wearables for Detecting Use of Objects, Proceedings of the Ninth IEEE International Symposium on Wearable Computers, p.38-43, October 18-21, 2005 [doi>10.1109/ISWC.2005.25]
• 5: H. Kautz and J. Allen. Generalized plan recognition. In Proc. 5th National Conf. on Artificial Intelligence (AAAI-86), pages 32--37, 1986.
• 6: B. Logan, J. Healey, M. Philipose, E. Tapia, and S. Intille. A long-term evaluation of sensing modalities for activity recognition. In UbiComp 2007: Ubiquitous Computing, pages 483--500, 2007.
• 7: Darnell Moore , Irfan Essa, Recognizing multitasked activities from video using stochastic context-free grammar, Eighteenth national conference on Artificial intelligence, p.770-776, July 28-August 01, 2002, Edmonton, Alberta, Canada
• 8: H. Ney, D. Mergel, A. Noll, and A. Paeseler. A data-driven organization of the dynamic programming beam search for continuous speech recognition. In IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP'87), pages 833--836, 1987.
• 9: Donald J. Patterson , Dieter Fox , Henry Kautz , Matthai Philipose, Fine-Grained Activity Recognition by Aggregating Abstract Object Usage, Proceedings of the Ninth IEEE International Symposium on Wearable Computers, p.44-51, October 18-21, 2005 [doi>10.1109/ISWC.2005.22]
• 10: Matthai Philipose , Kenneth P. Fishkin , Mike Perkowitz , Donald J. Patterson , Dieter Fox , Henry Kautz , Dirk Hahnel, Inferring Activities from Interactions with Objects, IEEE Pervasive Computing, v.3 n.4, p.50-57, October 2004 [doi>10.1109/MPRV.2004.7]
• 11: M. Pollack, L. Brown, D. Colbry, C. McCarthy, C. Orosz, B. Peintner, S. Ramakrishnan, and I. Tsamardinos. Autominder: An intelligent cognitive orthotic system for people with memory impairment. Robotics and Autonomous Systems, 44:273--282, 2003.
• 12: L. Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257--286, Feb 1989.
• 13: J. Wu, A. Osuntogun, T. Choudhury, M. Philipose, and J. Rehg. A scalable approach to activity recognition based on object use. In IEEE Int. Conf. on Computer Vision (ICCV 2007), pages 1--8, 2007.
• 14: T. Wu, C. Lian, and J. Hsu. Joint recognition of multiple concurrent activities using factorial conditional random fields. In Proc. 22nd Conf. on Artificial Intelligence (AAAI-2007), 2007.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models
          Subjects: Statistical

Additional Classification:
  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES

Keywords:
activity recognition, hidden Markov model, interleaved activities