ClaimSpotter: an environment to support sensemaking with knowledge triples

ABSTRACT

Annotating a document with an interpretation of its contents raises a number of challenges that we are hoping to address via the creation of a supporting environment. We present these challenges and motivate an approach based on the notion of suggestions to support document annotation, hoping these suggestions would act as leads to follow for annotators, therefore reducing some of the difficulties inherent to the task. The environment resulting from this approach, ClaimSpotter, is presented. Aspects of its evaluation are also given, using the findings of a study involving a group of participants faced with a document annotation task.

REFERENCES

• 1: Ann Peterson Bishop, Digital libraries and knowledge disaggregation: the use of journal article components, Proceedings of the third ACM conference on Digital libraries, p.29-39, June 23-26, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276675.276679]
• 2: Jim Blythe , Yolanda Gil, Incremental formalization of document annotations through ontology-based paraphrasing, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988734]
• 3: Shannon Bradshaw , Kristian Hammond, Automatically indexing documents: content vs. reference, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502746]
• 4: S. Buckingham~Shum, E. Motta, and J. Domingue. ScholOnto : an Ontology-Based Digital Library Server for Research Documents and Discourse. International Journal on Digital Libraries, 3:237--248, September 2000.
• 5: Simon Buckingham Shum , Victoria Uren , Gangmin Li , John Domingue , Enrico Motta, Visualizing internetworked argumentation, Visualizing argumentation: software tools for collaborative and educational sense-making, Springer-Verlag, London, 2003
• 6: S. Buckingham Shum, V. Uren, G. Li, B. Sereno, and C. Mancini. Computational Modelling of Naturalistic Argumentation in Research Literatures: Representation and Interaction Design Issues. To appear in the International Journal of Intelligent Systems (IJIS) special issue on Computational Models of Natural Argument.
• 7: John Domingue , Martin Dzbor, Magpie: supporting browsing and navigation on the semantic web, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964479]
• 8: Yolanda Gil , Varun Ratnakar, Trusting Information Sources One Citizen at a Time, Proceedings of the First International Semantic Web Conference on The Semantic Web, p.162-176, June 09-12, 2002
• 9: Jamey Graham, The reader's helper: a personalized document reading environment, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.481-488, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303139]
• 10: Siegfried Handschuh , Steffen Staab, Authoring and annotation of web pages in CREAM, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511506]
• 11: Robert E. Horn, Infrastructure for navigating interdisciplinary debates: critical decisions for representing argumentation, Visualizing argumentation: software tools for collaborative and educational sense-making, Springer-Verlag, London, 2003
• 12: K. Hyland. Persuasion and Context: the Pragmatics of Academic Metadiscourse. Journal of Pragmatics, 30:437--455, 1998.
• 13: Paul A. Kirschner , Simon J. Buckingham Shum , Chad S. Carr, Visualizing argumentation: software tools for collaborative and educational sense-making, Springer-Verlag, London, 2003
• 14: David B. Leake , Ana Maguitman , Thomas Reichherzer , Alberto J. Cañas , Marco Carvalho , Marco Arguedas , Sofia Brenes , Tom Eskridge, Aiding knowledge capture by searching for extensions of knowledge models, Proceedings of the 2nd international conference on Knowledge capture, October 23-25, 2003, Sanibel Island, FL, USA [doi>10.1145/945645.945655]
• 15: Hidetsugu Nanba , Manabu Okumura, Towards Multi-paper Summarization Using Reference Information, Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, p.926-931, July 31-August 06, 1999
• 16: J. D. Novak. The Theory Underlying Concept Maps and How to Construct Them. Retrieved from http://cmap.coginst.uwf.edu/info/ on November 20, 2004.
• 17: Ilia A. Ovsiannikov , Michael A. Arbib , Thomas H. McNeill, Annotation technology, International Journal of Human-Computer Studies, v.50 n.4, p.329-362, April 1999 [doi>10.1006/ijhc.1999.0247]
• 18: Frank M. Shipman, III , Raymond McCall, Supporting knowledge-base evolution with incremental formalization, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.285-291, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191768]
• 19: H. Small. Co-citation in the Scientific Literature: a New Measure of the Relationship Between Two Documents. Journal of the American Society for Information Science, 24(4):265--269, 1973.
• 20: Tamara Sumner , Simon Buckingham Shum, From documents to discourse: shifting conceptions of scholarly publishing, Proceedings of the SIGCHI conference on Human factors in computing systems, p.95-102, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274659]
• 21: J. M. Swales. Genre Analysis: English in Academic and Research Settings. Cambridge University Press, 1990.
• 22: Simone Teufel , Marc Moens, Summarizing scientific articles: experiments with relevance and rhetorical status, Computational Linguistics, v.28 n.4, p.409-445, December 2002 [doi>10.1162/089120102762671936]
• 23: M. Weinstock. Citation Indexes. In Encyclopedia of Library and Information Science, volume 5, pages 16--40. 1971.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Experimentation, Human Factors

Keywords:
annotation, interface, sensemaking, user studies