Facemail: showing faces of recipients to prevent misdirected email

ABSTRACT

Users occasionally send email to the wrong recipients -- clicking Reply To All instead of Reply, mistyping an email address, or guessing an email address and getting it wrong - and suffer violations of security or privacy as a result. Facemail is an extension to a webmail system that aims to alleviate this problem by automatically displaying pictures of the selected recipients in a peripheral display, while the user is composing an email message. We describe techniques for obtaining faces from email addresses, and discovering mailing list memberships from existing web data sources, and a user interface design that keeps important faces recognizable while scaling up to hundreds or thousands of recipients. Preliminary experiments suggest that faces significantly improve users' ability to detect misdirected emails with only a brief glance.

REFERENCES

• 1: Michael Bolin , Matthew Webber , Philip Rha , Tom Wilson , Robert C. Miller, Automation and customization of rendered web pages, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095062]
• 2: Brostoff, S. and Sasse, M. A. Are Passfaces more usable than passwords? A field trial investigation. In Proc. HCI 2000, 405--424.
• 3: Culotta, A., Bekkerman, R., and McCallum, A. Extracting social networks and contact information from email and the web. In Proc. CEAS 2004.
• 4: Simson L. Garfinkel , David Margrave , Jeffrey I. Schiller , Erik Nordlander , Robert C. Miller, How to make secure email easier to use, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055069]
• 5: Simson L. Garfinkel , Robert C. Miller, Johnny 2: a user test of key continuity management with S/MIME and Outlook Express, Proceedings of the 2005 symposium on Usable privacy and security, p.13-24, July 06-08, 2005, Pittsburgh, Pennsylvania [doi>10.1145/1073001.1073003]
• 6: Shirley Gaw , Edward W. Felten , Patricia Fernandez-Kelly, Secrecy, flagging, and paranoia: adoption criteria in encrypted email, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124862]
• 7: Feng Liu , Michael Gleicher, Automatic image retargeting with fisheye-view warping, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095061]
• 8: Liu, H., Lieberman, H., and Selker, T. Automatic Affective Feedback in an Email Browser. MIT Media Laboratory Software Agents Group Technical Report, November 2002.
• 9: Sandberg, J. Never a safe feature, 'reply to all' falls into the wrong hands. Wall Street Journal, Oct. 25, 2005.
• 10: Bongwon Suh , Haibin Ling , Benjamin B. Bederson , David W. Jacobs, Automatic thumbnail cropping and its effectiveness, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.95-104, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964707]
• 11: Tarasewich, P. and Campbell, C. What are you looking at? In Proc. SOUPS 2005.
• 12: Steve Whittaker , Quentin Jones , Bonnie Nardi , Mike Creech , Loren Terveen , Ellen Isaacs , John Hainsworth, ContactMap: Organizing communication in a social desktop, ACM Transactions on Computer-Human Interaction (TOCHI), v.11 n.4, p.445-471, December 2004 [doi>10.1145/1035575.1035580]
• 13: Alma Whitten , J. D. Tygar, Why Johnny can't encrypt: a usability evaluation of PGP 5.0, Proceedings of the 8th conference on USENIX Security Symposium, p.14-14, August 23-26, 1999, Washington, D.C.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Algorithms, Experimentation, Human Factors, Security

Keywords:
email, errors, privacy, reply to all, security