slab: smart labeling of family photos through an interactive interface

ABSTRACT

A novel technique for semi-automatic photo annotation is proposed and evaluated. The technique, sLab, uses face processing algorithms and a simplified user interface for labeling family photos. A user study compared our system with two others. One was Adobe Photoshop Element. The other was an in-house implementation of a face clustering interface recently proposed in the research community. Nine participants performed an annotation task with each system on faces extracted from a set of 150 images from their own family photo albums. As the faces were all well known to participants, accuracy was near perfect with all three systems. On annotation time, sLab was 25% faster than Photoshop Element and 16% faster than the face clustering interface.

REFERENCES

• 1: Allan Kuchinsky , Celine Pering , Michael L. Creech , Dennis Freeze , Bill Serra , Jacek Gwizdka, FotoFile: a consumer multimedia organization and retrieval system, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.496-503, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303143]
• 2: Lim, J.-H., Tian, et al. 2003. Home photo content modeling for personalized event-based retrieval. IEEE Multimedia, 10(4), pp. 28--37.
• 3: Mills, T. J., et al. 2000. ShoeBox: A Digital Photo Management System. Technical report, 2000.10, AT&T Laboratories, Cambridge.
• 4: Kerry Rodden , Kenneth R. Wood, How do people manage their digital photographs?, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642682]
• 5: Jingyu Cui , Fang Wen , Rong Xiao , Yuandong Tian , Xiaoou Tang, EasyAlbum: an interactive photo annotation system based on face clustering and re-ranking, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240684]
• 6: Suh, B., et al. 2004. Semi-automatic Image Annotation Using Event and Torso Identification. Technical report, Computer Science Department, University of Maryland, MD.
• 7: Viola, P., et al. 2001. Rapid object detection using a boosted cascade of simple features. Proceedings of the IEEE CVPR, 511--518.
• 8: Chen, L., et al. 2003. Face annotation for family photo album management. International Journal of Image and Graphics, 3(1), 1--14.
• 9: Andreas Girgensohn , John Adcock , Lynn Wilcox, Leveraging face recognition technology to find and organize photos, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA [doi>10.1145/1026711.1026728]
• 10: Fazl-Ersi, E., et al. 2007. Robust face recognition through local graph matching, Journal of Multimedia, 2(5), 31--37.

INDEX TERMS

Primary Classification:
  D. Software
  D.0 GENERAL

General Terms:
Algorithms, Design, Experimentation, Performance

Keywords:
face detection and recognition, face ranking and clustering, photo annotation