Privacy protecting data collection in media spaces

ABSTRACT

Around the world as both crime and technology become more prevalent, officials find themselves relying more and more on video surveillance as a cure-all in the name of public safety. Used properly, video cameras help expose wrongdoing but typically come at the cost of privacy to those not involved in any maleficent activity. What if we could design intelligent systems that are more selective in what video they capture, and focus on anomalous events while protecting the privacy of authorized personnel? This paper proposes a novel way of combining sensor technology with traditional video surveillance in building a privacy protecting framework that exploits the strengths of these modalities and complements their individual limitations. Our fully functional system utilizes off the shelf sensor hardware (i.e. RFID, motion detection) for localization, and combines this with a XML-based policy framework for access control to determine violations within the space. This information is fused with video surveillance streams in order to make decisions about how to display the individuals being surveilled. To achieve this, we have implemented several video masking techniques that correspond to varying user privacy levels. These results were achievable in real-time at acceptable frame rates, while meeting our requirements for privacy preservation.

REFERENCES

• 1: Elisa Bertino , Silvana Castano , Elena Ferrari , Marco Mesiti, Controlled access and dissemination of XML documents, Proceedings of the 2nd international workshop on Web information and data management, p.22-27, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319759.319770]
• 2: Michael Boyle , Christopher Edwards , Saul Greenberg, The effects of filtered video on awareness and privacy, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.1-10, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358935]
• 3: James L. Crowley , Joëlle Coutaz , François Bérard, Perceptual user interfaces: things that see, Communications of the ACM, v.43 n.3, p.54-ff., March 2000 [doi>10.1145/330534.330540]
• 4: Ernesto Damiani , Sabrina De Capitani di Vimercati , Stefano Paraboschi , Pierangela Samarati, A fine-grained access control system for XML documents, ACM Transactions on Information and System Security (TISSEC), v.5 n.2, p.169-202, May 2002 [doi>10.1145/505586.505590]
• 5: Paul Dourish , Victoria Bellotti, Awareness and coordination in shared workspaces, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.107-114, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143468]
• 6: Godik, S., and (Eds), T. M. eXtensible Access Control Markup Language (XACML) 1.0 Specification Set. OASIS Standard, 2003.
• 7: Harville, M., Gordon, G., and Woodfill, J. Foreground Segmentation using Adaptive Mixture Models in Color and Depth. In Proc. of the IEEE Workshop on Detection and Recognition of Events in Video (2001).
• 8: Berthold K. Horn, Robot Vision, McGraw-Hill Higher Education, 1986
• 9: Juels, A. Minimalistic Cryptography for Low-Cost RFID Tags. In Submission (2003).
• 10: Ari Juels , Ronald L. Rivest , Michael Szydlo, The blocker tag: selective blocking of RFID tags for consumer privacy, Proceedings of the 10th ACM conference on Computer and communications security, October 27-30, 2003, Washington D.C., USA [doi>10.1145/948109.948126]
• 11: Lipton, A., Fujiyoshi, H., and Patil, R. Moving Target Classification and Tracking From Real-time Video. In IEEE Image Understanding Workshop (1998), pp. 129--136.
• 12: M. Chiesa, R. Genz, F. H. e. a. RFID: A Week Long Survey on the Technology and its Potential. Tech. rep., Harnessing Technology Project, Interaction Design Institute Ivrea, 2002.
• 13: Marchesotti, L., Marcenaro, L., and Regazzoni, L. A Video Surveillance Architecture for Alarm Generation and Video Sequences Retrieval. In ICIP2002 (2002).
• 14: Privacy International. Privacy International: Video Surveillance. http://www.privacyinternational.org/issues/cctv/index.html.
• 15: S.E. Sarma. Toward the Five-Cent Tag. Technical Report, MIT-AUTOID-WH-006, MIT AutoID Center, 2001.
• 16: Chris Stauffer , W. Eric L. Grimson, Learning Patterns of Activity Using Real-Time Tracking, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.747-757, August 2000 [doi>10.1109/34.868677]
• 17: Bruce Culbertson, A Histogram-Based Color Consistency Test for Voxel Coloring, Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 4, p.40118, August 11-15, 2002
• 18: Jun Wang , Mohan S Kankanhalli , Weiqi Yan , Ramesh Jain, Experiential Sampling for video surveillance, First ACM SIGMM international workshop on Video surveillance, November 02-08, 2003, Berkeley, California [doi>10.1145/982452.982462]
• 19: Qiang Alex Zhao , John T. Stasko, Evaluating image filtering based techniques in media space applications, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.11-18, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289450]
• 20: W. Zhao , R. Chellappa , P. J. Phillips , A. Rosenfeld, Face recognition: A literature survey, ACM Computing Surveys (CSUR), v.35 n.4, p.399-458, December 2003 [doi>10.1145/954339.954342]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Object recognition

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking; Sensor fusion

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.5 Security and Protection (D.4.6, K.4.2)

General Terms:
Design, Security

Keywords:
access control, privacy, video surveillance