Understanding the efficiency of social tagging systems using information theory

ABSTRACT

Given the rise in popularity of social tagging systems, it seems only natural to ask how efficient is the organically evolved tagging vocabulary in describing underlying document objects? Does this distributed process really provide a way to circumnavigate the traditional "vocabulary problem" with ontology? We analyze a social tagging site, namely del.icio.us, with information theory in order to evaluate the efficiency of this social tagging site for encoding navigation paths to information sources. We show that information theory provides a natural and interesting way to understand this efficiency - or the descriptive, encoding power of tags. Our results indicate the efficiency of tags appears to be waning. We discuss the implications of our findings and provide insight into how our methods can be used to design more usable social tagging software.

REFERENCES

• 1: Vincent Bouthors , Olivier Dedieu, Pharos, a Collaborative Infrastructure for Web Knowledge Sharing, Proceedings of the Third European Conference on Research and Advanced Technology for Digital Libraries, p.215-233, September 22-24, 1999
• 2: E. Chi and T. Mytkowicz. Understanding navigability of social tagging systems, 2007.
• 3: George W. Furnas , Caterina Fake , Luis von Ahn , Joshua Schachter , Scott Golder , Kevin Fox , Marc Davis , Cameron Marlow , Mor Naaman, Why do tagging systems work?, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125462]
• 4: G. W. Furnas , T. K. Landauer , L. M. Gomez , S. T. Dumais, The vocabulary problem in human-system communication, Communications of the ACM, v.30 n.11, p.964-971, Nov. 1987 [doi>10.1145/32206.32212]
• 5: N. Glance, D. Arregui, and M. Dardenne. Knowledge pump: Supporting the flow and use of knowledge. Information Technology for Knowledge Management, 1998.
• 6: Scott A. Golder , Bernardo A. Huberman, Usage patterns of collaborative tagging systems, Journal of Information Science, v.32 n.2, p.198-208, April 2006 [doi>10.1177/0165551506062337]
• 7: Harry Halpin , Valentin Robu , Hana Shepherd, The complex dynamics of collaborative tagging, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242602]
• 8: G. MacGregor and E. McCulloch. Collaborative tagging as a knowledge organization and resource discovery tool. Library View, 2006.
• 9: David R. Millen , Jonathan Feinberg , Bernard Kerr, Dogear: Social bookmarking in the enterprise, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124792]
• 10: Shilad Sen , Shyong K. Lam , Al Mamunur Rashid , Dan Cosley , Dan Frankowski , Jeremy Osterhouse , F. Maxwell Harper , John Riedl, tagging, communities, vocabulary, evolution, Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, November 04-08, 2006, Banff, Alberta, Canada [doi>10.1145/1180875.1180904]
• 11: C. Shirky. Ontology is overrated: Categories, links and tags, September 2006.
• 12: T. Vanderwal. Off the top: Folksonomy entries, 2005.
• 13: Luis von Ahn , Laura Dabbish, Labeling images with a computer game, Proceedings of the SIGCHI conference on Human factors in computing systems, p.319-326, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985733]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.3 Organizational Impacts

General Terms:
Design, Experimentation, Human Factors

Keywords:
efficiency, entropy, evaluation, information access, information theory, methodology, navigation, ontology, social tagging