Recognizing daily activities with RFID-based sensors

ABSTRACT

We explore a dense sensing approach that uses RFID sensor network technology to recognize human activities. In our setting, everyday objects are instrumented with UHF RFID tags called WISPs that are equipped with accelerometers. RFID readers detect when the objects are used by examining this sensor data, and daily activities are then inferred from the traces of object use via a Hidden Markov Model. In a study of 10 participants performing 14 activities in a model apartment, our approach yielded recognition rates with precision and recall both in the 90% range. This compares well to recognition with a more intrusive short-range RFID bracelet that detects objects in the proximity of the user; this approach saw roughly 95% precision and 60% recall in the same study. We conclude that RFID sensor networks are a promising approach for indoor activity monitoring.

REFERENCES

• 1: R. Aipperspach, E. Cohen, and J.F. Canny. Modeling human behavior from simple sensors in the home. In Pervasive, pages 337--348, 2006.
• 2: J.E. Bardram and H.B. Christensen. Pervasive computing support for hospitals: An overview of the activity-based computing project. IEEE Pervasive Computing, 6(1):44--51, 2007.
• 3: J. Beaudin, S.S. Intille, E.M. Tapia, R. Rockinson, and M.E. Morris. Context-sensitive microlearning of foreign language vocabulary on a mobile device. In Ambient Intelligence, volume 4794 of Lecture Notes in Computer Science, pages 55--72. Springer, 2007.
• 4: J.A. Bilmes. The GMTK documentation. http://ssli.ee.washington.edu/~bilmes/gmtk.
• 5: A.F. Bobick, S.S. Intille, J.W. Davis, F. Baird, C.S. Pinhanez, L.W. Campbell, Y.A. Ivanov, A. Schütte, and A.D. Wilson. The kidsroom. Communications of the ACM, 43(3):60--61, 2000.
• 6: M. Buettner, B. Greenstein, A. Sample, J.R. Smith, and D. Wetherall. Revisiting smart dust with rfid sensor networks. In Proc. Hot Topics in Networks (HotNets), 2008.
• 7: M. Buettner and D. Wetherall. An empirical study of UHF RFID performance. In Proc. Mobicom, 2008.
• 8: H.J. Chae, D.J. Yeager, J.R. Smith, and K. Fu. Maximalist cryptography and computation on the wisp uhf rfid tag. In Proc. Conference on RFID Security, 2007.
• 9: A. Czeskis, K. Koscher, J.R. Smith, and T. Kohno. Rfids and secret handshakes: Defending against ghost-and-leech attacks and unauthorized reads with context-aware communications. In 15th ACM Conference on Computer and Communications Security, 2008.
• 10: EPCglobal. Low level reader protocol (llrp), version 1.0.1. 2007.
• 11: K.P. Fishkin, M. Philipose, and A.D. Rea. Hands-on rfid: Wireless wearables for detecting use of objects. In ISWC, pages 38--43, 2005.
• 12: K.Z. Haigh, L.M. Kiff, and G. Ho. The Independent LifeStyle AssistantTM (I.L.S.A.): Lessons Learned. Assistive Technology, 2006.
• 13: S. Hodges, A. Thorne, H. Mallinson, and C. Floerkemeier. Assessing and optimizing the range of uhf rfid to enable real-world pervasive computing applications. In Lecture Notes in Computer Science -- Pervasive Computing, volume 4480, pages 280--297, 2007.
• 14: J. Holleman, D. Yeager, R. Prasad, J. Smith, and B. Otis. Neuralwisp: An energy-harvesting wireless neural interface with 1-m range. In BioCAS 2008, pages 37--40, Nov. 2008.
• 15: J. Lundell, T. Hayes, S. Vurgun, U. Ozertem, J. Kimel, J. Kaye, F. Guilak, and M. Pavel. Continuous activity monitoring and intelligent contextual prompting to improve medication adherence. In EMBS, pages 6286--6289, Aug. 2007.
• 16: M. Philipose, K. Fishkin, M. Perkowitz, D. Patterson, D. Fox, H. Kautz, and D. Hahnel. Inferring activities from interactions with objects. Pervasive Computing, IEEE, 3(4):50--57, Oct.-Dec. 2004.
• 17: M. Philipose, J. Smith, B. Jiang, A. Mamishev, S. Roy, and K. Sundara-Rajan. Battery-free wireless identification and sensing. Pervasive Computing, IEEE, 4(1):37--45, Jan.-March 2005.
• 18: A.P. Sample, D.J. Yeager, P.S. Powledge, and J.R. Smith. Design of an rfid-based battery-free programmable sensing platform. In IEEE Transactions on Instrumentation and Measurement, 2008.
• 19: J.R. Smith, A.P. Sample, P. Powledge, A. Mamishev, and S. Roy. A wirelessly powered platform for sensing and computation. In Proc. Ubicomp, 2006.
• 20: M.B. Srivastava, R.R. Muntz, and M. Potkonjak. Smart kindergarten: sensor-based wireless networks for smart developmental problem-solving enviroments. In MOBICOM, pages 132--138, 2001.
• 21: E.M. Tapia, S.S. Intille, and K. Larson. Activity recognition in the home using simple and ubiquitous sensors. In Pervasive, pages 158--175, 2004.
• 22: ThingMagic. Mercury4 rfid reader. http://www.thingmagic.com/fixed-rfid-readers/mercury4/2-fixed-rfid-readers/22-mercury4.
• 23: ThingMagic. Mercury5e rfid reader. http://www.thingmagic.com/embedded-rfidreaders/mercury5e.
• 24: D. Tse and P. Viswanath. Fundamentals of Wireless Communication. Cambridge University Press, 2005.
• 25: J. Ward, P. Lukowicz, G. Tröster, and T. Starner. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans. Pattern Analysis and Machine Intelligence, 28(10):1553--1567, October 2006.
• 26: M. Weiser. The computer for the twenty-first century. Scientific American, 265(3):95--104, September 1991.
• 27: D.H. Wilson and C.G. Atkeson. Simultaneous tracking and activity recognition (STAR) using many anonymous, binary sensors. In Pervasive, pages 62--79, 2005.
• 28: D. Yeager, R. Prasad, D. Wetherall, P. Powledge, and J. Smith. Wirelessly-charged uhf tags for sensor data collection. In Proc. IEEE RFID, 2008.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Experimentation, Measurement, Performance

Keywords:
activity detection, rfid, sensor networks, wisp