Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition

ABSTRACT

The home deployment of sensor-based systems offers many opportunities, particularly in the area of using sensor-based systems to support aging in place by monitoring an elder's activities of daily living. But existing approaches to home activity recognition are typically expensive, difficult to install, or intrude into the living space. This paper considers the feasibility of a new approach that "reaches into the home" via the existing infrastructure. Specifically, we deploy a small number of low-cost sensors at critical locations in a home's water distribution infrastructure. Based on water usage patterns, we can then infer activities in the home. To examine the feasibility of this approach, we deployed real sensors into a real home for six weeks. Among other findings, we show that a model built on microphone-based sensors that are placed away from systematic noise sources can identify 100% of clothes washer usage, 95% of dishwasher usage, 94% of showers, 88% of toilet flushes, 73% of bathroom sink activity lasting ten seconds or longer, and 81% of kitchen sink activity lasting ten seconds or longer. While there are clear limits to what activities can be detected when analyzing water usage, our new approach represents a sweet spot in the tradeoff between what information is collected at what cost.

REFERENCES

• 1: Gregory D. Abowd , Elizabeth D. Mynatt, Charting past, present, and future research in ubiquitous computing, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.29-58, March 2000 [doi>10.1145/344949.344988]
• 2: Beckmann, C., Consolvo, S. and LaMarca, A. (2004) Some Assembly Required: Supporting End-User Sensor Installation in Domestic Ubiquitous Computing Environments. Proceedings of the International Conference on Ubiquitous Computing (UbiComp 2004), 107--124.
• 3: James Bo Begole , John C. Tang , Rosco Hill, Rhythm modeling, visualizations and applications, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.11-20, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964698]
• 4: James Bo Begole , John C. Tang , Randall B. Smith , Nicole Yankelovich, Work rhythms: analyzing visualizations of awareness histories of distributed groups, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587125]
• 5: Chen, J., Kam, A. H., Zhang, J., Liu, N. and Shue, L. (2005) Bathroom Activity Monitoring Based on Sound. Proceedings of the International Conference on Pervasive Computing (Pervasive 2005), 47--61.
• 6: Consolvo, S., Roessler, P. and Shelton, B. E. (2004) The CareNet Display: Lessons Learned from an In Home Evaluation of an Ambient Display. Proceedings of the International Conference on Ubiquitous Computing (UbiComp 2004), 1--17.
• 7: Crossbow Technology. http://www.xbow.com
• 8: David E. Culler , Jason Hill , Philip Buonadonna , Robert Szewczyk , Alec Woo, A Network-Centric Approach to Embedded Software for Tiny Devices, Proceedings of the First International Workshop on Embedded Software, p.114-130, October 08-10, 2001
• 9: Tad Hirsch , Jodi Forlizzi , Elaine Hyder , Jennifer Goetz , Chris Kurtz , Jacey Stroback, The ELDer project: social, emotional, and environmental factors in the design of eldercare technologies, Proceedings on the 2000 conference on Universal Usability, p.72-79, November 16-17, 2000, Arlington, Virginia, United States [doi>10.1145/355460.355476]
• 10: Munguia Tapia, E., Intille, S. S. and Larson, K. (2004) Activity Recognition in the Home Using Simple and Ubiquitous Sensors. Proceedings of the International Conference on Pervasive Computing (Pervasive 2004), 158--175.
• 11: Elizabeth D. Mynatt , Jim Rowan , Sarah Craighill , Annie Jacobs, Digital family portraits: supporting peace of mind for extended family members, Proceedings of the SIGCHI conference on Human factors in computing systems, p.333-340, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365126]
• 12: Matthai Philipose , Kenneth P. Fishkin , Mike Perkowitz , Donald J. Patterson , Dieter Fox , Henry Kautz , Dirk Hahnel, Inferring Activities from Interactions with Objects, IEEE Pervasive Computing, v.3 n.4, p.50-57, October 2004 [doi>10.1109/MPRV.2004.7]
• 13: John C. Platt, Fast training of support vector machines using sequential minimal optimization, Advances in kernel methods: support vector learning, MIT Press, Cambridge, MA, 1999
• 14: Jim Rowan , Elizabeth D. Mynatt, Digital Family Portrait Field Trial: Support for Aging in Place, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055044]
• 15: Wilson, D. H. and Atkeson, C. G. (2005) Simultaneous Tracking and Activity Recognition (STAR) Using Many Anonymous, Binary Sensors. Proceedings of the International Conference on Pervasive Computing (Pervasive 2005), 62--79.
• 16: Ian H. Witten , Eibe Frank, Data mining: practical machine learning tools and techniques with Java implementations, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

Keywords:
activity recognition, sensing in the home, sensor-based models