Dynamic privacy assessment in a smart house environment using multimodal sensing

ABSTRACT

Surveillance applications in private environments such as smart houses require a privacy management policy if such systems are to be accepted by the occupants of the environment. This is due to the invasive nature of surveillance, and the private nature of the home. In this article, we propose a framework for dynamically altering the privacy policy applied to the monitoring of a smart house based on the situation within the environment. Initially the situation, or context, within the environment is determined; we identify several factors for determining environmental context, and propose methods to quantify the context using audio and binary sensor data. The context is then mapped to an appropriate privacy policy, which is implemented by applying data hiding techniques to control access to data gathered from various information sources. The significance of this work lies in the examination of privacy issues related to assisted-living smart house environments. A single privacy policy in such applications would be either too restrictive for an observer, for example, a carer, or too invasive for the occupants. We address this by proposing a dynamic method, with the aim of decreasing the invasiveness of the technology, while retaining the purpose of the system.

REFERENCES

• 1: Altman, I. 1975. The Environment and Social Behavior: Privacy, Personal Space, Territory and Crowding. Brooks/Cole Publishing Co., Inc., Monterey, CA.
• 2: Victoria Bellotti , Abigail Sellen, Design for privacy in ubiquitous computing environments, Proceedings of the third conference on European Conference on Computer-Supported Cooperative Work, p.77-92, September 13-17, 1993, Milan, Italy
• 3: Boyer, J. P., Tan, K., and Gunter, C. A. 2006. Privacy sensitive location information systems in smart buildings. In Proceedings of the 3rd International Conference for Security in Pervasive Computing. Springer Berlin, York, England.
• 4: Chen, J., Kam, A. H., Zhang, J., Liu, N., and Shue, L. 2005. Bathroom activity monitoring based on sound. In Pervasive Comput. Springer Berlin, Munich, Germany, 47--61.
• 5: Das, S. and Cook, D. J. 2004. Health monitoring in an agent-based smart home. In Proceedings of the International Conference on Smart Homes and Health Telematics (ICOST). IOS Press, Singapore.
• 6: Ingrid Daubechies, Ten lectures on wavelets, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1992
• 7: John R. Deller, Jr. , John G. Proakis , John H. Hansen, Discrete Time Processing of Speech Signals, Prentice Hall PTR, Upper Saddle River, NJ, 1993
• 8: Frederic Dufaux , Touradj Ebrahimi, Scrambling for Video Surveillance with Privacy, Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, p.160, June 17-22, 2006 [doi>10.1109/CVPRW.2006.184]
• 9: Daniel P.W. Ellis , Keansub Lee, Minimal-impact audio-based personal archives, Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences, October 15-15, 2004, New York, New York, USA [doi>10.1145/1026653.1026659]
• 10: Douglas A. Fidaleo , Hoang-Anh Nguyen , Mohan Trivedi, The networked sensor tapestry (NeST): a privacy enhanced software architecture for interactive analysis of data in video-sensor networks, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026809]
• 11: Sumi Helal , Bryon Winkler , Choonhwa Lee , Youssef Kaddoura , Lisa Ran , Carlos Giraldo , Sree Kuchibhotla , William Mann, Enabling Location-Aware Pervasive Computing Applications for the Edlerly, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, p.531, March 23-26, 2003
• 12: Dan Hong , Mingxuan Yuan , Vincent Y. Shen, Dynamic privacy management: a plug-in service for the middleware in pervasive computing, Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, September 19-22, 2005, Salzburg, Austria [doi>10.1145/1085777.1085779]
• 13: Jason I. Hong , James A. Landay, An architecture for privacy-sensitive ubiquitous computing, Proceedings of the 2nd international conference on Mobile systems, applications, and services, June 06-09, 2004, Boston, MA, USA [doi>10.1145/990064.990087]
• 14: Scott Lederer , I. Hong , K. Dey , A. Landay, Personal privacy through understanding and action: five pitfalls for designers, Personal and Ubiquitous Computing, v.8 n.6, p.440-454, November 2004 [doi>10.1007/s00779-004-0304-9]
• 15: Martinez-Ponte, I., Desurmont, X., Meessen, J., and Delaigle, J.-F. 2005. Robust human face hiding ensuring privacy. In Proceedings of the Workshop on the Integration of Knowledge, Semantics and Digital Media Technology (WIAMIS'05). SPIE, Montreux, Switzerland.
• 16: Moncrieff, S., Venkatesh, S., and West, G. 2007a. Dynamic privacy in a smart house environment. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE Computer Society, 2034--2037.
• 17: Simon Moncrieff , Svetha Venkatesh , Geoff West, Online audio background determination for complex audio environments, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.3 n.2, p.8-es, May 2007 [doi>10.1145/1230812.1230814]
• 18: Simon Moncrieff , Svetha Venkatesh , Geoff West, Privacy and the access of information in a smart house environment, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291389]
• 19: Simon Moncrieff , Svetha Venkatesh , Geoff West , Stewart Greenhill, Multi-modal emotive computing in a smart house environment, Pervasive and Mobile Computing, v.3 n.2, p.74-94, March, 2007 [doi>10.1016/j.pmcj.2006.07.003]
• 20: Neustaedter, C. and Greenberg, S. 2003. The design of a context-aware home media space for balancing privacy and awareness. In Proceedings of the 5th International Conference on Ubiquitous Computing. Springer Berlin, Seattle,WA, 297--314.
• 21: Nixon, P. A., Wagealla, W., English, C., and Terzis, S. 2004. Smart Environments: Technology, Protocols, and Applications. Wiley, Arlington, TX, Chapter Security, Privacy and Trust Issues in Smart Environments, 249--270.
• 22: Leysia Palen , Paul Dourish, Unpacking "privacy" for a networked world, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642635]
• 23: Rabiner, L. and Juang, B. 1978. Digital Processing of Speech Signals. Signal Processing Series. Prentice Hall Press, New Jersey.
• 24: Andrew Senior , Sharath Pankanti , Arun Hampapur , Lisa Brown , Ying-Li Tian , Ahmet Ekin , Jonathan Connell , Chiao Fe Shu , Max Lu, Enabling Video Privacy through Computer Vision, IEEE Security and Privacy, v.3 n.3, p.50-57, May 2005 [doi>10.1109/MSP.2005.65]
• 25: Stauffer, C. and Grimson, W. 1999. Adaptive background mixture models for real-time tracking. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999. Vol. 2. IEEE Computer Society, Fort Collins, CO USA, 246--252.
• 26: Geoff West , Stewart Greenhill , Svetha Venkatesh, A Probabilistic Approach to the Anxious Home for Activity Monitoring, Proceedings of the 29th Annual International Computer Software and Applications Conference (COMPSAC'05) Volume 1, p.335-340, July 26-28, 2005
• 27: Jehan Wickramasuriya , Mahesh Datt , Sharad Mehrotra , Nalini Venkatasubramanian, Privacy protecting data collection in media spaces, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027537]
• 28: Daniel H. Wilson , Chris Atkeson, Assistive intelligent environments for automatic health monitoring, Carnegie Mellon University, Pittsburgh, PA, 2005
• 29: Ian H. Witten , Eibe Frank, Data mining: practical machine learning tools and techniques with Java implementations, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000
• 30: Tong Zhang , C.-C. J. Kuo, Hierarchical classification of audio data for archiving and retrieving, Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference, p.3001-3004, March 15-19, 1999 [doi>10.1109/ICASSP.1999.757472]

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.0 GENERAL

General Terms:
Design, Human Factors

Keywords:
Assisted living, audio, context aware, privacy, surveillance and monitoring