Lifelogging memory appliance for people with episodic memory impairment

ABSTRACT

Lifelogging technologies have the potential to provide memory cues for people who struggle with episodic memory impairment (EMI). These memory cues enable the recollection of significant experiences, which is important for people with EMI to regain a sense of normalcy in their lives. However, lifelogging technologies often collect an overwhelmingly large amount of data to review. The best memory cues need to be extracted and presented in a way that best supports episodic recollection. We describe the design of a new lifelogging system that captures photos, ambient audio, and location information and leverages both automated content/context analysis and the expertise of family caregivers to facilitate the extraction and annotation of a salient summary consisting of good cues from the lifelog. The system presents the selected cues for review in a way that maximizes the opportunities for the person with EMI to think deeply about these cues to trigger memory recollection on his own without burdening the caregiver. We compare our system with another review system that requires the caregiver to repeatedly guide the review process. Our self-guided system resulted in better memory retention and imposed a smaller burden on the caregiver whereas the caregiver-guided approach provided more opportunities for caregiver interaction.

REFERENCES

• 1: Almbert, B., Grafstrom, M. and Winblad, B. (1997). Caring for a demented elderly person - burden and burnout among caregiving relatives. Journal of Advanced Nursing, 25 (1). 109--116.
• 2: American_Health_Assistance_Foundation. http://www.ahaf.org/alzdis/about/adabout.htm.
• 3: Butcher, H. K., Holkup, P. A. and Buckwalter, K. C. (2001). The Experience of Caring for a Family Member with Alzheimer's Disease. West J Nurs Res, 23 (1). 33--55.
• 4: Clare, L. (2003). Managing threats to self: awareness in early stage Alzheimer's disease. Social Science & Medicine, 57 (6). 1017--1029.
• 5: Craik, F. I. M. and Tulving, E. (1975). Depth of processing and the retention of words in episodic memory. Journal of Experimental Psychology: General, 104 (3). 268--294.
• 6: Dixon, R. and Hultsch, D. (1983a). Metamemory and memory for text relationships in adulthood: A cross-validation study. Journal of Gerontology, 38. 689--694.
• 7: Doherty, A. R., Smeaton, A. F., Lee, K. and Ellis, D. (2007). Multimodal Segmentation of Lifelog Data. Proc. RIAO, Pittsburgh, PA, 2007.
• 8: Eric Freeman , David Gelernter, Lifestreams: a storage model for personal data, ACM SIGMOD Record, v.25 n.1, p.80-86, March 1996 [doi>10.1145/381854.381893]
• 9: Gardiner, J. M., Ramponi, C. and Richardson-Klavehn, A. (1998). Experiences of Remembering, Knowing, and Guessing. Consciousness and Cognition, 7 (1). 1--26.
• 10: Jim Gemmell , Lyndsay Williams , Ken Wood , Roger Lueder , Gordon Bell, Passive capture and ensuing issues for a personal lifetime store, Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences, October 15-15, 2004, New York, New York, USA [doi>10.1145/1026653.1026660]
• 11: Kirstie Hawkey , Kori M. Inkpen , Kenneth Rockwood , Michael McAllister , Jacob Slonim, Requirements gathering with alzheimer's patients and caregivers, Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility, October 09-12, 2005, Baltimore, MD, USA [doi>10.1145/1090785.1090812]
• 12: Hayes, G. R., Patel, S. N., Truong, K. N., Iachello, G., Kientz, J. A., Farmer, R. and Abowd, G. D. (2004). The Personal Audio Loop: Designing a Ubiquitous Audio-Based Memory Aid. Proc. Mobile HCI. 13--16.
• 13: Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N. and Wood, K. (2006). SenseCam: a Retrospective Memory Aid. Proc. UBICOMP 2006. 81--90.
• 14: Matthew L. Lee , Anind K. Dey, Providing good memory cues for people with episodic memory impairment, Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility, October 15-17, 2007, Tempe, Arizona, USA [doi>10.1145/1296843.1296867]
• 15: Abigail J. Sellen , Andrew Fogg , Mike Aitken , Steve Hodges , Carsten Rother , Ken Wood, Do life-logging technologies support memory for the past?: an experimental study using sensecam, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240636]
• 16: Silveri, M. C., Reali, G., Jenner, C. and Puopolo, M. (2007). Attention and Memory in the Preclinical Stage of Dementia. Journal of Geriatric Psychiatry and Neurology, 20 (2). 67--75.
• 17: Steeman, E., de, C., Dierckx, B., Godderis, J. and Grypdonck, M. (2006). Living with early-stage dementia: a review of qualitative studies. Journal of Advanced Nursing, 54. 722--738.
• 18: Datchakorn Tancharoen , Toshihiko Yamasaki , Kiyoharu Aizawa, Practical experience recording and indexing of Life Log video, Proceedings of the 2nd ACM workshop on Continuous archival and retrieval of personal experiences, November 11-11, 2005, Hilton, Singapore [doi>10.1145/1099083.1099092]
• 19: Sunil Vemuri , Chris Schmandt , Walter Bender, iRemember: a personal, long-term memory prosthesis, Proceedings of the 3rd ACM workshop on Continuous archival and retrival of personal experences, October 28-28, 2006, Santa Barbara, California, USA [doi>10.1145/1178657.1178670]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Keywords:
Alzheimer's disease, caregiver burden, information overload, lifelogging, memory impairment