Tag ranking

ABSTRACT

Social media sharing web sites like Flickr allow users to annotate images with free tags, which significantly facilitate Web image search and organization. However, the tags associated with an image generally are in a random order without any importance or relevance information, which limits the effectiveness of these tags in search and other applications. In this paper, we propose a tag ranking scheme, aiming to automatically rank the tags associated with a given image according to their relevance to the image content. We first estimate initial relevance scores for the tags based on probability density estimation, and then perform a random walk over a tag similarity graph to refine the relevance scores. Experimental results on a 50, 000 Flickr photo collection

show that the proposed tag ranking method is both effective and efficient. We also apply tag ranking into three applications: (1) tag-based image search, (2) tag recommendation, and (3) group recommendation, which demonstrates that the proposed tag ranking approach really boosts the performances of social-tagging related applications.

REFERENCES

• 1: Flickr. http://www.flickr.com.
• 2: Morgan Ames , Mor Naaman, Why we tag: motivations for annotation in mobile and online media, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240772]
• 3: Lyndon S. Kennedy , Shih-Fu Chang , Igor V. Kozintsev, To search or to label?: predicting the performance of search-based automatic image classifiers, Proceedings of the 8th ACM international workshop on Multimedia information retrieval, October 26-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178677.1178712]
• 4: Michael S. Lew , Nicu Sebe , Chabane Djeraba , Ramesh Jain, Content-based multimedia information retrieval: State of the art and challenges, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.2 n.1, p.1-19, February 2006 [doi>10.1145/1126004.1126005]
• 5: A. W. M. Smeulders, M. Worring, S. Santini,A. Gupta and R. Jain. Content based Image Retrieval
• 6: At the End of the Early Years. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000.
• 7: Jia Li , James Z. Wang, Real-Time Computerized Annotation of Pictures, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.30 n.6, p.985-1002, June 2008 [doi>10.1109/TPAMI.2007.70847]
• 8: Florent Monay , Daniel Gatica-Perez, On image auto-annotation with latent space models, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957070]
• 9: G. Sychay, E. Y. Chang and K. Goh. Effective Image Annotation via Active Learning. In IEEE International Conference on Multimedia and Expo, 2002.
• 10: Rui Shi , Chin-Hui Lee , Tat-Seng Chua, Enhancing image annotation by integrating concept ontology and text-based bayesian learning model, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291307]
• 11: Börkur Sigurbjörnsson , Roelof van Zwol, Flickr tag recommendation based on collective knowledge, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China [doi>10.1145/1367497.1367542]
• 12: Xirong Li , Cees G.M. Snoek , Marcel Worring, Learning tag relevance by neighbor voting for social image retrieval, Proceeding of the 1st ACM international conference on Multimedia information retrieval, October 30-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1460096.1460126]
• 13: R. Yan, A. Natsev and M. Campbell. A Learning-based Hybrid Tagging and Browsing Approach for Efficient Manual Image Annotation. In Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, 2008.
• 14: Lei Wu , Linjun Yang , Nenghai Yu , Xian-Sheng Hua, Learning to tag, Proceedings of the 18th international conference on World wide web, April 20-24, 2009, Madrid, Spain [doi>10.1145/1526709.1526758]
• 15: Hong-Ming Chen , Ming-Hsiu Chang , Ping-Chieh Chang , Ming-Chun Tien , Winston H. Hsu , Ja-Ling Wu, SheepDog: group and tag recommendation for flickr photos by automatic search-based learning, Proceeding of the 16th ACM international conference on Multimedia, October 26-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1459359.1459473]
• 16: E. Parzen. On the Estimation of a Probability Density Function and the Mode. In Annals of Mathematical Statistics, 1962.
• 17: Bing Liu, Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data (Data-Centric Systems and Applications), Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 18: Rudi L. Cilibrasi , Paul M. B. Vitanyi, The Google Similarity Distance, IEEE Transactions on Knowledge and Data Engineering, v.19 n.3, p.370-383, March 2007 [doi>10.1109/TKDE.2007.48]
• 19: Winston H. Hsu , Lyndon S. Kennedy , Shih-Fu Chang, Video search reranking through random walk over document-level context graph, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291446]
• 20: Yushi Jing , Shumeet Baluja, VisualRank: Applying PageRank to Large-Scale Image Search, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.30 n.11, p.1877-1890, November 2008 [doi>10.1109/TPAMI.2008.121]
• 21: J. Y. Pan, H. J. Yang, C. Faloutsos and P. Duygulu. Gcap: Graph-based Automatic Image Captioning. In International Workshop on Multimedia and Document Engineering, 2004.
• 22: Kalervo Järvelin , Jaana Kekäläinen, Cumulated gain-based evaluation of IR techniques, ACM Transactions on Information Systems (TOIS), v.20 n.4, p.422-446, October 2002 [doi>10.1145/582415.582418]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

General Terms:
Algorithms, Experimentation, Performance

Keywords:
flickr, random walk, recommendation, search, tag ranking