With a little help from my friends: examining the impact of social annotations in sensemaking tasks

ABSTRACT

In prior work we reported on the design of a social annotation system, SparTag.us, for use in sensemaking activities such as work-group reading and report writing. Previous studies of note-taking systems have demonstrated behavioral differences in social annotation practices, but are not clear in the actual performance gains provided by social features. This paper presents a laboratory study aimed at evaluating the learning effect of social features in SparTag.us. We found significant learning gains, and consider implications for design and for understanding the underlying mechanisms in play when people use social annotation systems.

REFERENCES

• 1: Anderson, R.C. and Pearson P.D. A schema-theoretic view of basic processes in reading comprehension. In P.D. Pearson (ed.), Handbook of Reading Research, 255--291. New York: Longman, 1984.
• 2: Lichan Hong , Ed H. Chi , Raluca Budiu , Peter Pirolli , Les Nelson, SparTag.us: a low cost tagging system for foraging of web content, Proceedings of the working conference on Advanced visual interfaces, May 28-30, 2008, Napoli, Italy [doi>10.1145/1385569.1385582]
• 3: Vaiva Kalnikaité , Steve Whittaker, Social summarization: does social feedback improve access to speech data?, Proceedings of the ACM 2008 conference on Computer supported cooperative work, November 08-12, 2008, San Diego, CA, USA [doi>10.1145/1460563.1460567]
• 4: Aniket Kittur , Ed H. Chi , Bongwon Suh, Crowdsourcing user studies with Mechanical Turk, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357127]
• 5: Catherine C. Marshall, Annotation: from paper books to the digital library, Proceedings of the second ACM international conference on Digital libraries, p.131-140, July 23-26, 1997, Philadelphia, Pennsylvania, United States [doi>10.1145/263690.263806]
• 6: Silvers, V.L. and Kreiner, D.S., The effects of pre-existing inappropriate highlighting on reading comprehension. Reading Research and Instruction, 36, 3, 217--223, 1997.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Performance

Keywords:
social annotation systems, social sensemaking, user studies