Continuous camera-based monitoring for assistive environments

ABSTRACT

Camera-based monitoring is a valuable tool for assistive environments to meet the important needs of those who may have physical or cognitive impairment. It is, however, particularly difficult to continuously monitor a moving subject in a large facility where many cameras are deployed. In this paper, we propose Sensor-Integrated Camera Surveillance (SICS) to address this problem. SICS uses wearable wireless sensors to locate moving subjects and automatically selects the camera covering the subject, allowing human operators to focus only on one screen to monitor an individual.

To improve flexibility and reduce cost, SICS connects distributed cameras through a self-organizing wireless mesh network. To reduce bandwidth consumption, SICS leverages onboard image processing on the camera for selective transmission. To enable automated reasoning, SICS uses a knowledge base for efficient rule specification and execution. Through empirical evaluation, we found that the automatic camera handoff enabled by SICS was effective for continuous camera-based monitoring. We provide quantitative performance evaluation results in this paper and discuss potential extension to the SICS infrastructure.

REFERENCES

• 1: Mike Addlesee , Rupert Curwen , Steve Hodges , Joe Newman , Pete Steggles , Andy Ward , Andy Hopper, Implementing a Sentient Computing System, Computer, v.34 n.8, p.50-56, August 2001 [doi>10.1109/2.940013]
• 2: A profile of older Americans: 2003. Administration on Aging, U.S. Department of Health and Human Services, 2003.
• 3: Population pyramid summary for United States. U.S. Census Bureau, 2007.
• 4: Ian F. Akyildiz , Xudong Wang , Weilin Wang, Wireless mesh networks: a survey, Computer Networks and ISDN Systems, v.47 n.4, p.445-487, 15 March 2005 [doi>10.1016/j.comnet.2004.12.001]
• 5: Paramvir Bahl and Venkata N. Padmanabhan. RADAR: An in-building RF-based user location and tracking system. In Proceedings of the 19th Annual Joint Conference of the IEEE Computer and Communications Societies, Tel Aviv, Israel, March 2000.
• 6: Networking/IP to drive video surveillance market growth. iSuppli Market Analysis Report, March 2007.
• 7: J. Chen, K. Kwong, D. Chang, J. Luk, and R. Bajcsy. Wearable sensors for reliable fall detection. In Proceedings of the 27th Annual International Conference of the Engineering in Medicine and Biology Society, pages 3551--3554, 2005.
• 8: Wu-chi Feng , Brian Code , Ed Kaiser , Mike Shea , Wu-chang Feng , Louis Bavoil, Panoptes: scalable low-power video sensor networking technologies, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957132]
• 9: T. Clausen , P. Jacquet, Optimized Link State Routing Protocol (OLSR), RFC Editor, 2003
• 10: Ekahau realtime location system. Ekahau, Inc.
• 11: Joseph C. Giarratano , Gary Riley, Expert Systems: Principles and Programming, PWS Publishing Co., Boston, MA, 1994
• 12: Martin Gill, Ross Little, Angela Spriggs, Jenna Allen, Javier Argomaniz, and Sam Waples. Assessing the impact of CCTV: The Hawkeye case study. Home Office Online Report, December 2005.
• 13: Piyush Gupta and P. R. Kumar. The capacity of wireless networks. IEEE Transactions on Information Theory, 46(2):388--404, March 2000.
• 14: Andreas Haeberlen , Eliot Flannery , Andrew M. Ladd , Algis Rudys , Dan S. Wallach , Lydia E. Kavraki, Practical robust localization over large-scale 802.11 wireless networks, Proceedings of the 10th annual international conference on Mobile computing and networking, September 26-October 01, 2004, Philadelphia, PA, USA [doi>10.1145/1023720.1023728]
• 15: A. Hampapur, L. Brown, J. Connell, S. Pankanti, A. Senior, and Y. Tian. Smart surveillance: Applications, technologies and implications. In Proceedings of the Joint Conference of the 4th International Conference on Information, Communications and Signal Processing, and the 4th Pacific Rim Conference on Multimedia, pages 1133--1138, Singapore, December 2003.
• 16: A. Keshavarz, A. Maleki-Tabar, and H. Aghajan. Distributed vision-based reasoning for smart home care. In Proceedings of the ACM SenSys Workshop on Distributed Smart Cameras, 2006.
• 17: Purushottam Kulkarni , Deepak Ganesan , Prashant Shenoy , Qifeng Lu, SensEye: a multi-tier camera sensor network, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101191]
• 18: Pradeep Kyasanur , Nitin H. Vaidya, Capacity of multi-channel wireless networks: impact of number of channels and interfaces, Proceedings of the 11th annual international conference on Mobile computing and networking, August 28-September 02, 2005, Cologne, Germany [doi>10.1145/1080829.1080835]
• 19: Francesco Licandro , Giovanni Schembra, Wireless mesh networks to support video surveillance: architecture, protocol, and implementation issues, EURASIP Journal on Wireless Communications and Networking, v.2007 n.1, p.34-34, January 2007 [doi>10.1155/2007/31976]
• 20: Konrad Lorincz , Matt Welsh, MoteTrack: a robust, decentralized approach to RF-based location tracking, Personal and Ubiquitous Computing, v.11 n.6, p.489-503, August 2007 [doi>10.1007/s00779-006-0095-2]
• 21: Dimitrios Lymberopoulos , Andreas Savvides, XYZ: a motion-enabled, power aware sensor node platform for distributed sensor network applications, Proceedings of the 4th international symposium on Information processing in sensor networks, April 24-27, 2005, Los Angeles, California
• 22: David Malan, Thaddeus Fulford-Jones, Matt Welsh, and Steve Moulton. CodeBlue: An ad hoc sensor network infrastructure for emergency medical care. In Proceedings of the Workshop on Wearable and Implantable Body Sensor Networks, April 2004.
• 23: Soumendra Nanda , David Kotz, Mesh-Mon: A multi-radio mesh monitoring and management system, Computer Communications, v.31 n.8, p.1588-1601, May, 2008 [doi>10.1016/j.comcom.2008.01.046]
• 24: RFID-assisted localization and communication for first responders. NIST.
• 25: C. Perkins , E. Belding-Royer , S. Das, Ad hoc On-Demand Distance Vector (AODV) Routing, RFC Editor, 2003
• 26: M. E. Pollack. Intelligent technology for an aging population: The use of AI to assist elders with cognitive impairment. AI Magazine, 26(2):9--24, 2005.
• 27: Lili Qiu , Paramvir Bahl , Ananth Rao , Lidong Zhou, Troubleshooting wireless mesh networks, ACM SIGCOMM Computer Communication Review, v.36 n.5, October 2006 [doi>10.1145/1163593.1163597]
• 28: Mohammad Rahimi , Rick Baer , Obimdinachi I. Iroezi , Juan C. Garcia , Jay Warrior , Deborah Estrin , Mani Srivastava, Cyclops: in situ image sensing and interpretation in wireless sensor networks, Proceedings of the 3rd international conference on Embedded networked sensor systems, November 02-04, 2005, San Diego, California, USA [doi>10.1145/1098918.1098939]
• 29: K. N. Ramachandran, E. M. Belding-Royer, and K. C. Almeroth. DAMON: A distributed architecture for monitoring multi-hop mobile networks. In Proceedings of the 1st IEEE International Conference on Sensor and Ad Hoc Communications and Networks, pages 601--609, Santa Clara, CA, October 2004.
• 30: A. Raniwala and Chiueh Tzi-cker. Architecture and algorithms for an IEEE 802.11-based multi-channel wireless mesh network. In Proceedings of the 24th Annual Joint Conference of the IEEE Computer and Communications Societies, pages 2223--2234, Miami, FL, March 2005.
• 31: Yong Sheng, Guanling Chen, Keren Tan, Udayan Deshpande, Bennet Vance, Hongda Yin, Chris McDonald, Tristan Henderson, David Kotz, Andrew Campbell, and Joshua Wright. MAP: A scalable monitoring system for dependable 802.11 wireless networks. IEEE Wireless Communications, April 2008. Accepted.
• 32: VISion: Enterprise locating solution. Versus Technology, Inc.
• 33: Adam Williams , Deepak Ganesan , Allen Hanson, Aging in place: fall detection and localization in a distributed smart camera network, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291435]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications