Pervasive behavior tracking for cognitive assistance

ABSTRACT

The current and prospective situation of cognitively impaired people entails great human, social, and economical costs. Smart homes can help to maintain in place cognitively impaired people, to improve their autonomy, and accordingly to alleviate the burden put on informal and professional caregivers. The research performed at DOMUS lab aims at turning the whole home into a cognitive prosthetic, especially by providing cognitive assistance. In this process, behavior tracking is a fundamental piece. After sketching the infrastructure, two cognitive assistants are used to illustrate how activity recognition can help to address four kinds of cognitive deficits (initiation, attention, planning, and memory). An experimentation of one of these asistant involving people with intellectual deficiencies is finally shortly described.

REFERENCES

• 1: M. E. Pollack, Intelligent Technology for an Aging Population: The Use of AI to Assist Elders with Cognitive Impairment. AI Magazine, vol. 26, no 2, 2005, pp. 9--24.
• 2: Mark Weiser, Some computer science issues in ubiquitous computing, Communications of the ACM, v.36 n.7, p.75-84, July 1993 [doi>10.1145/159544.159617]
• 3: B. Ullmer , H. Ishii, Emerging frameworks for tangible user interfaces, IBM Systems Journal, v.39 n.3-4, p.915-931, July 2000
• 4: B. Bouchard, A. Bouzouane, and S. Giroux, "A Keyhole Plan Recognition Model for Alzheimer's Patients: First Results," Journal of Applied Artificial Intelligence (AAI), vol. 21, no 7, August. 2007, pp. 623--658.
• 5: A. Serna, V. Rialle and H. Pigot, "Computational Representation of Alzheimer's Disease Evolution Applied to a Cooking Activity," Proceedings of MIE 2006: 20th International Congress of the European Federation for Medical Informatics, pp. 587--592, August 2006
• 6: S. Giroux, H. Pigot, B. Paccoud, D. Pache, E. Stip, and J. Sablier, Enhancing a Mobile Cognitive Orthotic: A User-Centered Design Approach, International Journal of Assistive Robotics and Mechatronics, vol. 9, no 1, March 2008, pp. 36--47.
• 7: J.-F. Moreau, H. Pigot, S. Giroux, and J.-P. Savary, "Assistance to cognitively impaired people and distance monitoring by caregivers: A study on the use of electronic agendas", in International Conference on Aging, Disability and Indenpendence (ICADI), February 1--5, 2006, St-Petersburg, FL, USA, pp. 29--30.
• 8: D. Lussier-Desrochers, Y. Lachapelle, H. Pigot, and J. Bauchet "Apartments for people with intellectual disability: Promoting innovative community living services," in 2nd International Conference on Intellectual Disabilities/Mental Retardation, November 6--8, 2007, Bangkok, Thailand, p.38.
• 9: H. Pigot, D. Lussier-Desrochers, J. Bauchet, S. Giroux, and Y. Lachapelle, "A Smart Home to Assist Recipe Completion" in A. Mihailidis, J. Boger, H. Kautz and, L. Normie, eds. Technology and Aging, Selected Papers from the 2007 International Conference on Technology and Aging, vol. 21, Assistive Technology Research Series, January 2008, pp. 35--42.
• 10: H. Pigot, J.-P. Savary, J. L. Metzger, A. Rochon, and M. Beaulieu, "Advanced technology guidelines to fulfill the needs of the cognitively impaired population", in S. Giroux, and H. Pigot, eds, From Smart Homes to Smart Care, 3rd International Conference On Smart Homes and health Telematic (ICOST), 4-6July, 2005, Sherbrooke, Canada, Assistive Technology Research Series, IOS Press. pp. 25--32.
• 11: M. D. Lezak. Neuropsychological Assessment, 3rd edition. Oxford University Press, USA, 1995, 1056 p.
• 12: B. Reisberg, S. H. Ferris, M. J. Leon, and T. Crook. The global deterioration scale for assessment of primary degenerative dementia. American Journal of Psychiatry 1982, vol. 139, no 9, pp. 1136--1139.
• 13: Diane Cook , Sajal Das, Smart Environments: Technology, Protocols and Applications (Wiley Series on Parallel and Distributed Computing), Wiley-Interscience, 2004
• 14: Charles Gouin-Vallerand , Sylvain Giroux, Managing and Deployment of Applications with OSGi in the Context of Smart Home, Proceedings of the Third IEEE International Conference on Wireless and Mobile Computing, Networking and Communications, p.70, October 08-10, 2007
• 15: Youcef Rahal , Philippe Mabilleau , Helene Pigot, Bayesian Filtering and Anonymous Sensors for Localization in a Smart Home, Proceedings of the 21st International Conference on Advanced Information Networking and Applications Workshops, p.793-797, May 21-23, 2007 [doi>10.1109/AINAW.2007.108]
• 16: Baptiste Boussemart , Sylvain Giroux, Tangible User Interfaces for Cognitive Assistance, Proceedings of the 21st International Conference on Advanced Information Networking and Applications Workshops, p.852-857, May 21-23, 2007 [doi>10.1109/AINAW.2007.346]
• 17: S. Giroux, and S. Guertin, "A Pervasive Reminder System for Smart Homes", in D. Zhang, and M. Mokhtari, Toward Toward a Human-friendly Assistive Environment, 2nd International Conference on Smarth Homes and Health Telematics, ICOST 2004, Sept. 15--17, 2004, Singapore, pp. 98--105.
• 18: S. Giroux, H. Pigot, and A. Mayers, "Indoors Pervasive Computing and Outdoors Mobile Computing for Assisted Cognition and Telemonitoring", in 9th International Conference on Computers Helping People with Special Needs (ICCHAP 2004), July 7--9, 2004, Université Pierre et Marie Curie, Paris, France, Springer LNCS3138, ed. K. Miesenberger, J. Klaus, W. Zagler, and D. Burger, Computers Helping People with Special Needs, 2004, pp. 953--960.
• 19: Sandra Carberry, Techniques for Plan Recognition, User Modeling and User-Adapted Interaction, v.11 n.1-2, p.31-48, 2001 [doi>10.1023/A:1011118925938]
• 20: Matthai Philipose , Kenneth P. Fishkin , Mike Perkowitz , Donald J. Patterson , Dieter Fox , Henry Kautz , Dirk Hahnel, Inferring Activities from Interactions with Objects, IEEE Pervasive Computing, v.3 n.4, p.50-57, October 2004 [doi>10.1109/MPRV.2004.7]
• 21: D. J. Patterson, L. Liao, K. Gajos, M. Collier, N. Livic, K. Olson, S. Wang, D. Fox, and H. Kautz. "Opportunity knocks: a system to provide cognitive assistance with transportation services", in Proceedings of UBICOMP 2004: The Sixth International Conference on Ubiquitous Computing, LNCS 3205, 2004, pp. 433--450.
• 22: B. Bouchard, A. Bouzouane, and S. Giroux, "A Logical Approach to ADL Recognition for Alzheimer's patients", in C. Nugent and J. C. Augusto, Smart Homes and Beyond, Proceedings of ICOST 2006, IOS Press, 2006, pp. 122--129.
• 23: Patrice Roy , Bruno Bouchard , Abdenour Bouzouane , Sylvain Giroux, A Hybrid Plan Recognition Model for Alzheimer's Patients: Interleaved-Erroneous Dilemma, Proceedings of the 2007 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, p.131-137, November 02-05, 2007 [doi>10.1109/IAT.2007.11]
• 24: J. Bauchet, and A. Mayers, "A modelisation of ADLs in its environment for cognitive assistance," in 3rd International Conference on Smart Homes and Health Telematic (ICOST), 2005, pp. 221--228.
• 25: Gilbert Paquette , Francois Pachet , Sylvain Giroux , Jean Girard, E´piTalk: generating advisor agents for existing information systems, Journal of Artificial Intelligence in Education, v.7 n.3-4, p.349-379, 1996
• 26: A. Dion and H. Pigot, "Modeling cognitive errors in the realization of an activity of the everyday life" in Cognitio 2007, June 15--17, 2007, Montreal, Canada, www.er.uqam.ca/nobel/philuqam/ocs/viewposter.php?id=96.
• 27: Brygg Ullmer , Hiroshi Ishii , Robert J. K. Jacob, Token+constraint systems for tangible interaction with digital information, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.81-118, March 2005 [doi>10.1145/1057237.1057242]
• 28: Klaus-Jürgen Quast, Plan recognition for context sensitive help, Proceedings of the 1st international conference on Intelligent user interfaces, p.89-96, January 04-07, 1993, Orlando, Florida, United States [doi>10.1145/169891.169915]
• 29: Q. Tran K. Truong, and E. Mynatt, "Cook's Collage: Recovering from Interruptions", demo at 3rd Int'l Conf. Ubiquitous Computing (UbiComp 2001), 2001.
• 30: S. Giroux, D. Lussier-Desrochers, H. Pigot, J. Bauchet, and T. Leblanc, "A Virtual Community Kitchen for People with Intellectual Deficiencies", ICADI 2008, February 1--5 2008, St-Petersburg, FL, USA.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES
      Subjects: Health

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.11 Distributed Artificial Intelligence
            Subjects: Multiagent systems
  I.5 PATTERN RECOGNITION
      I.5.1 Models
          Subjects: Structural

General Terms:
Algorithms, Design, Experimentation, Human Factors

Keywords:
activity recognition, cognitive deficits, experimentation, pervasive computing, smart homes, tangible user interfaces