Smart batch tagging of photo albums

ABSTRACT

As one of the emerging Web 2.0 activities, tagging becomes a popular approach to manage personal media data, such as photo albums. However, exhaustively tagging all photos in an album is a labor-intensive and time-consuming task, and simply entering tags for the whole album will significantly degrade the tagging accuracy. In this paper, we propose a smart batch tagging scheme that aims at facilitating users in album tagging. For a given album, it selects a set of representative exemplars for manual tagging, where the number of exemplars is dependent on the content of the photos.Then the tags of the rest photos are automatically inferred.In this way, the number of tagged photos is significantly reduced and we will show that high tagging accuracy can still be maintained. Therefore, a good trade-off between manual efforts and tagging performance can be achieved. Experimental results have demonstrated the effectiveness and usefulness of the proposed approach.

REFERENCES

• 1: Flickr. http://www.flickr.com.
• 2: J. Li and J. Z. Wang. Real-Time Computerized Annotation of Pictures. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol, 30, no. 6, 2008.
• 3: J. Jeon, V. Lavrenko and R. Manmatha. Automatic Image Annotation and Retrieval using Cross--media Relevance Models. In Proceedings of SIGIR, 2003.
• 4: J. M. Jia, N. H. Yu and X. S. Hua. Annotating Personal Albums via Web Mining. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.
• 5: R. Yan, A. Natsev and M. Campbell. A Learning-based Hybrid Tagging and Browsing Approach for Efficient Manual Image Annotation. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008.
• 6: M. Ames and M. Naaman. Why We Tag: Motivations for Annotation in Mobile and Online Media. In Proceedings of the SIGCHI Conference on Human Factors in Computing System, 2007.
• 7: L. S. Kennedy, S. F. Chang and I. V. Kozintsev. To Search or To Label? Precdicting the Performance of Search-Based Automatic Image Classifiers. In Proceedings of the 8th ACM International Workshop on Multimedia information retrieval, 2006.
• 8: D. Liu, X. S. Hua, L. J. Yang, M. Wang and H. J. Zhang. Tag Ranking. In Proceedings of ACM International World Wide Web Conference, 2009.
• 9: B. Sigurbjornsson and R. V. Zwol. Flickr Tag Recommendation based on Collective Knowledge. In Proceedings of ACM International World Wide Web Conference, 2008.
• 10: H. M. Chen, M. H. Chang, P. C. Chang, M. C. Tien, W. H. Hsu and J. L. Wu. SheepDog-Group and Tag Recommendation for Flickr Photos by Automatic Search-based Learning. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.
• 11: B. J. Frey and D. Dueck. Clustering by Passing Messages between Data Points. In Science, vol. 315, 2007.
• 12: Y. Jia, J. D. Wang, C. S. Zhang and X. S. Hua. Finding Image Exemplars using Fast Sparse Affinity Propagation. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.
• 13: W. T. Chu and C. H. Lin. Automatic Selection of Representative Photo and Smart Thumbnailing Using Near-duplicate Detection. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.
• 14: L. L. Cao, J. B. Luo and T. S. Huang. Annotating Photo Collections by Label Propagation according to Multiple Similarity Cues. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.
• 15: X. J. Zhu, Z. Ghahramani and J. Lafferty. Semi-supervised Learning using Gaussian Fields and Harmonic Functions. In Proceedings of the International Conference on Machine Learning, 2003.
• 16: J. B. Shi and J. Malik. Normalized Cuts and Image Segmentation. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, no.8, 2000.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

General Terms:
Algorithms, Experimentation, Management

Keywords:
AP, batch tagging, flickr, propagation