Managing difference of opinion in semantic structures

ABSTRACT

Evaluation of automatic indexing is a common practice. Whenever new algorithms are created to generate semantic structures, it is necessary for their designers to demonstrate how better they are in the particular context for which they have been developed. However, the evaluation depends on the availability of a result of reference. Should such a reference be missing, evaluation is replaced by confrontation. There the structures themselves have to be compared instead of shared metrics, sometimes without even the option to choose the best one. Our work takes place in this context. We present a method for human-driven confrontation of specialized semantic structures. Our aim is to improve the user's ability to use another person's work to enhance his.

REFERENCES

• 1: Aussenac-Gilles, N. Ontology or meta-model for retrieving scientific reasoning in documents: The Arkeotek project. In Workshop on exploring the limits of global models for integration and use of historical and scientific information (2006).
• 2: Bénel, A. Porphyry au pays des paestans: usages d'un outil d'analyse qualitative de documents par des étudiantes de maîtrise en iconographie grecque. In Actes du colloque international "Corpus en Lettres et Sciences sociales : des documents numériques à l'interprétation", Albi, juillet 2006. Texto!, june 2006, vol. XI, n°2. p.182--189
• 3: Aurélien Bénel , Sylvie Calabretto , Andréa Iacovella , Jean-Marie Pinon, Porphyry 2001: Semantics for Scholarly Publications Retrieval, Proceedings of the 13th International Symposium on Foundations of Intelligent Systems, p.351-361, June 27-29, 2002
• 4: Aurélien Bénel , Elöd Egyed-Zsigmond , Yannick Prié , Sylvie Calabretto , Alain Mille , Andréa Iacovella , Jean-Marie Pinon, Truth in the Digital Library: From Ontological to Hermeneutical Systems, Proceedings of the 5th European Conference on Research and Advanced Technology for Digital Libraries, p.366-377, September 04-09, 2001
• 5: Berners-Lee, T., Hendler, J. and Lassila, O. The Semantic Web. Scientific American, 2001.
• 6: Cross-Language Evaluation Forum (CLEF), http://www.clef-campaign.org
• 7: Ehrig, M. and Staab, S. QOM -- Quick Ontology Mapping. The semantic web, Lecture notes in computer Sciences (2004), Springer Verlag, pp. 683--697.
• 8: El Asri, B., Nassar, M., Coulette, B., Kriouile, A. Assemblage de composants multivues par contrats. In actes du XVIIIème congrès INFORSID (2005), pp 29--44.
• 9: Thomas R. Gruber, A translation approach to portable ontology specifications, Knowledge Acquisition, v.5 n.2, p.199-220, June 1993 [doi>10.1006/knac.1993.1008]
• 10: INitiative for the Evaluation of XML Retrieval (INEX project), http://inex.is.informatik.uni-duisburg.de.
• 11: Lahna, B., Khayati, O. Towards a viewpoint-based design approach. In Proceedings of CSITeA'04.
• 12: NII Test Collection for IR Systems (NTCIR), http://research.nii.ac.jp/ntcir.
• 13: Myriam Ribière , Rose Dieng-Kuntz, A Viewpoint Model for Cooperative Building of an Ontology, Proceedings of the 10th International Conference on Conceptual Structures: Integration and Interfaces, p.220-234, July 15-19, 2002
• 14: The Porphyry Project, http://www.porphyry.org.
• 15: Sampson, J., Lanzenberger, M. Visual Ontology Alignment for Semantic Web Applications. Advances in Conceptual Modeling -- Theory and Practice, Lecture Notes in Computer Science (2006), Springer-Verlag, 4231, pp. 405--414.
• 16: Text Retrieval Conference (TREC), http://trec.nist.gov.
• 17: Zghal, S., Kamoun, K., Ben Yahia, S., Mephu Nguifo, E. and Slimani, Y. EDOLA : Une nouvelle méthode d'alignement d'ontologies OWL-Lite. In Proceedings of the Conférence en Recherche d'Information et Applications (CORIA'07), pp. 351--366
• 18: Zhang, K., Hu, Y., Wang, Y. Multiple Viewpoints Based Ontology Integration. In Proceedings of Grid and Cooperative Computing: Second International Workshop, GCC 2003, Shanghai, China. Lecture Notes in Computer Science, Volume 3033 / 2004, Springer Verlag, pp. 690 -- 693

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

General Terms:
Human Factors, Theory, Verification

Keywords:
confrontation, human-driven evaluation, viewpoints