The impact of ambiguity and redundancy on tag recommendation in folksonomies

ABSTRACT

Collaborative tagging applications have become a popular tool allowing Internet users to manage online resources with tags. Most collaborative tagging applications permit unsupervised tagging resulting in tag ambiguity in which a single tag has many different meanings and tag redundancy in which several tags have the same meaning. Common metrics for evaluating tag recommenders may overestimate the utility of ambiguous tags or ignore the appropriateness of redundant tags. Ambiguity and redundancy may even burden the user with additional effort by requiring them to clarify an annotation or forcing them to distinguish between highly related items. In this paper we demonstrate that ambiguity and redundancy impede the evaluation and performance of tag recommenders. Five tag recommendation strategies based on popularity, collaborative filtering and link analysis are explored. We use a cluster-based approach to define ambiguity and redundancy and provide extensive evaluation on three real world datasets.

REFERENCES

• 1: A. Almeida, B. Sotomayor, J. Abaitua, and D. López-de Ipi\ na. folk2onto: Bridging the gap between social tags and ontologies.
• 2: V. Batagelj and M. Zaver\vsnik. Generalized cores. Arxiv preprint cs/0202039, 2002.
• 3: S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. Computer networks and ISDN systems, 30(1--7):107--117, 1998.
• 4: M. Brun, C. Sima, J. Hua, J. Lowey, B. Carroll, E. Suh, and E. Dougherty. Model-based evaluation of clustering validation measures. Pattern Recognition, 40(3):807--824, 2007.
• 5: E. Durkheim, F. Alcan, and M. Morente. De la division du travail social. Presses universitaires de France Paris, 1960.
• 6: J. Gemmell, A. Shepitsen, B. Mobasher, and R. Burke. Personalization in Folksonomies Based on Tag Clustering. Intelligent Techniques for Web Personalization & Recommender Systems, 2008.
• 7: J. Gemmell, A. Shepitsen, B. Mobasher, and R. Burke. Personalizing navigation in folksonomies using hierarchical tag clustering. In Proceedings of the 10th international conference on Data Warehousing and Knowledge Discovery. Springer, 2008.
• 8: S. Golder and B. Huberman. The Structure of Collaborative Tagging Systems. Arxiv preprint cs.DL/0508082, 2005.
• 9: A. Hotho, R. Jaschke, C. Schmitz, and G. Stumme. BibSonomy: A Social Bookmark and Publication Sharing System. Proceedings of the Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, Aalborg, Denmark, July, 2006.
• 10: A. Hotho, R. Jaschke, C. Schmitz, and G. Stumme. Information retrieval in folksonomies: Search and ranking. Lecture Notes in Computer Science, 4011:411, 2006.
• 11: R. Jaschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Tag recommendations in folksonomies. Lecture Notes In Computer Science, 4702:506, 2007.
• 12: S. T. Jeff Z. Pan and E. Thomas. Reducing ambiguity in tagging systems with folksonomy search expansion. In 6th European Semantic Web Conference 2009, 2009.
• 13: M. E. I. Kipp and G. D. Campbell. Patterns and inconsistencies in collaborative tagging systems : An examination of tagging practices. Proceedings of the American Society for Information Science and Technology, November 2006.
• 14: S.-S. Lee and H.-S. Yong. Component based approach to handle synonym and polysemy in folksonomy. In CIT '07: Proceedings of the 7th IEEE International Conference on Computer and Information Technology, pages 200--205, Washington, DC, USA, 2007. IEEE Computer Society.
• 15: M. Lipczak. Tag Recommendation for Folksonomies Oriented towards Individual Users. ECML PKDD Discovery Challenge, page 84, 2008.
• 16: S. Lloyd. Least squares quantization in PCM. IEEE Transactions on Information Theory, 28(2):129--137, 1982.
• 17: L. Marinho and L. Schmidt-Thieme. Collaborative Tag Recommendations. In Proceedings of 31st Annual Conference of the Gesellschaft fr Klassifikation (GfKl), Freiburg. Springer. Springer, 2007.
• 18: A. Mathes. Folksonomies-Cooperative Classification and Communication Through Shared Metadata. Computer Mediated Communication, LIS590CMC (Doctoral Seminar), Graduate School of Library and Information Science, University of Illinois Urbana--Champaign, December, 2004.
• 19: P. Mika. Ontologies are us: A unified model of social networks and semantics. Web Semantics: Science, Services and Agents on the World Wide Web, 5(1):5--15, 2007.
• 20: C. Van Rijsbergen. Information Retrieval. Butterworth-Heinemann Newton, MA, USA, 1979.
• 21: T. Vander Wal. Folksonomy definition and wikipedia. November 2005.
• 22: J. Vig, S. Sen, and J. Riedl. Tagsplanations: explaining recommendations using tags. In IUI '09: Proceedings of the 13th international conference on Intelligent user interfaces, pages 47--56, New York, NY, USA, 2009. ACM.
• 23: X. Wu, L. Zhang, and Y. Yu. Exploring social annotations for the semantic web. In WWW '06: Proceedings of the 15th international conference on World Wide Web, pages 417--426, New York, NY, USA, 2006. ACM.
• 24: C. Yeung, N. Gibbins, and N. Shadbolt. Tag meaning disambiguation through analysis of tripartite structure of folksonomies. In Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology--Workshops, pages 3--6. IEEE Computer Society Washington, DC, USA, 2007.
• 25: L. Zhang, X. Wu, and Y. Yu. Emergent semantics from folksonomies: A quantitative study. Journal on Data Semantics, pages 168--186, 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Experimentation, Performance

Keywords:
ambiguity, folksonomies, recommender system, redundancy