Close & closer: social cluster and closeness from photo collections

ABSTRACT

We investigate the discovery of social clusters from consumer photo collections. People's participation in various social activities is the base on which social clusters are formed. The photos that record those social activities can reflect the social structure of people to a certain degree, depending on the extent of coverage of the photos on the social activities. In this paper, we propose a scheme to construct a weighted undirected graph from photo collections by examining the co-appearance of individuals in photos, wherein the weights of edges are measures of the social closeness of the involved individuals (vertices in the graph). We further apply a graph clustering algorithm that maximizes the modularity of the graph partition to detect the embedded social clusters. The experiment results demonstrate that this scheme can reveal the social cluster with high precision rate. In addition, we also introduce a few photo management capabilities enabled by the social graph and discovered social clusters.

REFERENCES

• 1: Golder, Scott. Measuring social networks with digital photograph collections. Proceedings of the nineteenth ACM conference on Hypertext and hypermedia, June 2008.
• 2: Gu, Liexian; Zhang, Tong; Ding, Xiaoqing. Clustering consumer photos based on face recognition. Proc. of IEEE International Conference on Multimedia and Expo, pp.1998 -- 2001, Beijing, July 2007
• 3: Newman, M. E. J. 2006. Finding community structure in networks using the eigenvectors of matrices. Phys. Rev. E 74, 036104.
• 4: Rowe, Ryan; Creamer , German; Hershkop, Shlomo; Stolfo, Salvatore J. Automated social hierarchy detection through email network analysis. Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on Web mining and social network analysis, August 2007
• 5: Stone, Z.; Zickler, T.; Darrell, T.. Autotagging Facebook: Social network context improves photo annotation," Computer Vision and Pattern Recognition Workshops, June 2008.
• 6: Wu, Peng; Ding, Weimin; Mao, Zhidong; Tretter, Dan. Close & Closer: Discover Social Relationship from Photo Collections. ICME Workshop on Media Information Analysis for Personal and Social Applications, 2009.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

General Terms:
Algorithms, Experimentation, Management

Keywords:
graph clustering, photo collection, social relationship