A context aware handheld wayfinding system for individuals with cognitive impairments

ABSTRACT

A challenge to individuals with cognitive impairments in wayfinding is how to remain oriented, recall routines, and travel in unfamiliar areas in a way relying on limited cognitive capacity. According to psychological model of spatial navigation and the requirements of rehabilitation professionals, a novel wayfinding system is presented with an aim to increase workplace and life independence for people suffering from diseases such as traumatic brain injury, cerebral palsy, mental retardation, schizophrenia, Down syndromes, and Alzheimer's disease. This paper describes an approach to providing distributed cognition support of travel guidance for persons with cognitive disabilities. The unique strength of the system is the ability to provide unique-to-the-user prompts that are triggered by context. As this population is very sensitive to issues of abstraction (e.g. icons) and presents the designer with the need to tailor prompts to a 'universe-of-one' the use of images specific to each user and context is implemented. The key to the approach is to spread the context awareness across the system, with the context being flagged by the QR-code tags and the appropriate response being evoked by displaying the appropriate path guidance images indexed by the intersection of specific end-user and context ID embedded in the tags. By separating the context trigger from the pictorial response, responses can be updated independently of the rest of the installed system, and a single QR-code tag can trigger multiple responses in the PDA depending on the end-user and their specific path. A prototype is built and tested in field experiments with real patients. The experimental results show the human-computer interface is friendly and the capabilities of wayfinding are reliable.

REFERENCES

• 1: Giroux S., Pigot H. "From Smart Homes to Smart Care, Assistive Technology Research Series. Proceeding of the 3rd International Conference on Smart homes and health Telematics," Proceedings of ICOST'05, Sherbrooke, Canada, 2005.
• 2: Bauchet J., Mayers A. "Modelisation of ADL in its Environment for Cognitive Assistance," Proc. of the 3rd International Conference on Smart homes and health Telematic, ICOST'05, Sherbrooke, Canada, pp. 3--10. 2005.
• 3: Braddock, D., Hemp, R. Rizzolo, & M. Parish, S. The state of the states in developmental disabilities: Study summary. In Disability at the Dawn of the 21st Century and the State of the States. Braddock, D. (ed.), American Association in Mental Retardation, Washington DC, p. 124. 2002.
• 4: The Aphasia Institute. What is Aphasia? {Online}. Available: September 2005 at http://www.aphasia.ca/about/whatis.html.
• 5: Wikipedia. QR Code. {Online}. Available: April 2008 at http://en.wikipedia.org/wiki/QR_Code
• 6: Rogers, E. M., Diffusion of innovations (4th ed.), New York: The Free Press, 1995.
• 7: Kintsch, A. & dePaula, R., "A Framework for the Adoption of Assistive Technology," Proceedings of SWAAAC 2002: Supporting Learning Through Assistive Technology, pp. E3 1--10, 2002.
• 8: Bond, G. R. and R. P. Liberman. Vocational rehabilitation. Handbook of psychiatric rehabilitation. New York, Macmillan. 1992.
• 9: Bond, G. R., R. E. Drake, et al. "Supported employment for people with severe mental illness: A review." Psychiatric Services. 1996.
• 10: Goodwin, S. Comparative mental health policy: From institutional to community care. Thousand Oaks: Sage. 1997.
• 11: Stefan Carmien , Melissa Dawe , Gerhard Fischer , Andrew Gorman , Anja Kintsch , James F. Sullivan, JR., Socio-technical environments supporting people with cognitive disabilities using public transportation, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.2, p.233-262, June 2005 [doi>10.1145/1067860.1067865]
• 12: L. Liao, D. Fox, and H. Kautz. "Learning and inferring transportation routines." In Proc of the 19th Natl Conf on AI, 2004.
• 13: Alan L. Liu , Harlan Hile , Henry Kautz , Gaetano Borriello , Pat A. Brown , Mark Harniss , Kurt Johnson, Indoor wayfinding:: developing a functional interface for individuals with cognitive impairments, Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, October 23-25, 2006, Portland, Oregon, USA [doi>10.1145/1168987.1169005]
• 14: Yao-Jen Chang , Shih-Kai Tsai , Yao-Sheng Chang , Tsen-Yung Wang, A novel wayfinding system based on geo-coded qr codes for individuals with cognitive impairments, Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility, October 15-17, 2007, Tempe, Arizona, USA [doi>10.1145/1296843.1296887]
• 15: Boger J., Poupart P., Hoey J., Boutilier C., Fernie G. and Mihailidis A."A Decision-Theoretic Approach to Task Assistance for Persons with Dementia." Proc. of the International Joint Conference on Artificial Intelligence (IJCAI'05), pp. 1293--1299, Edinburgh, Scotland, 2005.
• 16: Fatiha L., Lefebvre B."A cognitive system for a smart home dedicated to people in loss of autonomy," Proc. of the 3rd Int. Conference on Smart homes and health Telematic, ICOST'05, Sherbrooke, Canada, pp. 245--254. 2005.
• 17: Pigot H., Mayers A., Giroux S."The intelligent habitat and everyday life activity support," Proc. of the 5th International conference on Simulations in Biomedicine, April 2--4, Slovenia, pp. 507--516. 2003.
• 18: Sohlberg, McKay Moore, Fickas, Stephen, Hung, Pei-Fang and Fortier, Andrew. A comparison of four prompt modes for route finding for community travellers with severe cognitive impairments, Brain Injury, 21:5, pp. 531--538. 2007.
• 19: Gentry Tony, Wallace, Joseph, Kvarfordt, Connie and Lynch, Kathleen Bodisch. Personal digital assistants as cognitive aids for individuals with severe traumatic brain injury: A community-based trial, Brain Injury, 22:1, 19 -- 24. 2007.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Prototyping; Screen design (e.g., text, graphics, color); User-centered design

  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

General Terms:
Design, Human Factors

Keywords:
cognitive disability, qr code, ubiquitous computing, user interface