Semantic enhancement for legal information retrieval: Iuriservice performance

ABSTRACT

The Iuriservice application offers a semantically enabled FAQ search system and case law browser for the Spanish judges in their first appointment. The system is now at the first stage of implementation in the Spanish Judicial School. Users may input questions to the system in natural language to obtain access to a database of experience-based answers to practical day-to-day questions. In order to offer the question-answer pair from the application database that best matches the input question, the search system is enhanced using ontologies and semantic distance calculation. This paper will focus on the description of these technologies, bringing user needs and ontologies to the spotlight, and will show current effectiveness and efficiency results regarding the performance of the FAQ search engine. These results illustrate the enhancement that may be provided by semantic technologies for information retrieval in comparison with other techniques.

REFERENCES

• 1: Bran Selic , Richard Benjamins , Pompeu Casanovas , Aldo Gangemi, Law and the Semantic Web: Legal Ontologies, Methodologies, Legal Information Retrieval, and Applications (Lecture Notes in Computer Science / Lecture Notes in Artificial Intelligence), Springer-Verlag New York, Inc., Secaucus, NJ, 2005
• 2: Blázquez, M,, Peñna-Ortiz, R., Contreras, J., Benjamins, V. R., Casanovas, P., Vallbé, J. J., and Casellas. N. D10.3.1 Legal Case Study: Prototype. Technical Report SEKT, EU-IST Project IST-2003-506826, iSOCO-IDT (UAB), Madrid-Barcelona, 2005.
• 3: Alexander Boer , Tom van Engers , Radboud Winkels, Using ontologies for comparing and harmonizing legislation, Proceedings of the 9th international conference on Artificial intelligence and law, June 24-28, 2003, Scotland, United Kingdom [doi>10.1145/1047788.1047798]
• 4: Böosser, T. and Melchior, E.-M. D8.1.2 User Validation Strategy-approach and methods. Technical Report SEKT, EU-IST Project IST-2003-506826, kea-pro GmbH, Spiringen (Switzerland), 2005.
• 5: Bösser, T. and Melchior, E.-M. D8.2.2 Users needs and opportunities for business process improvement with knowledge technology. Technical Report SEKT, EU-IST Project IST-2003-506826, kea-pro GmbH, Spiringen (Switzerland), 2006.
• 6: Breuker, J., Boer, A., Hoekstra, R., and van den Berg, K. Developing Content for LKIF: Ontologies and Frameworks for Legal Reasoning. In van Engers, T. M. (ed.). Legal Knowledge and Information Systems. URIX 2006: The 19th Annual Conference. Vol. 152. IOS Press, Amsterdam, The Netherlands, 2006.
• 7: Breuker, J., and Winkels, R. Use and reuse of legal ontologies in knowledge engineering and information management. In ICAIL 2003 Workshop on Legal Ontologies and Web Based Legal Information Management. (June 24--28, 2003) Edinburgh, Scotland, UK, 2003.
• 8: Casanovas P., Poblet, M, Casellas, N., Vallbé, J.-J., Ramos, F., Benjamins, V. R., Blázquez, M., Rodrigo, L., Contreras, J., and Gorroñogoitia Cruz, J. D10.2.1 Legal Case Study: Legal Scenario. Technical Report SEKT, EU-IST Project IST-2003-506826, IDT (UAB)-iSOCO, Barcelona Madrid, 2004. http://www.sekt-project.org/rd/deliverables/wp10/sekt-d-10-2-1-LegalScenario.pdf
• 9: Casanovas, P., Casellas, N., Tempich, C., Vrandecic, and D., Benjamins, V. R. OPJK modeling methodology. In Lehman, J., Biasiotti, M. A., Francesconi, E., and Sagri, M. T. (eds.). AAIL Proceedings. LOAIT - Legal Ontologies and Artificial Intelligence Techniques (Bologna, Italy, June 2005). Wolf Legal Publishers, Nijmegen, The Netherlands, 2005, 121--133. http://www.aifb.uni-karlsruhe.de/WBS/dvr/publications/loait.pdf
• 10: Casanovas, P., Poblet, M., Casellas, N., Contreras, J., Benjamins, V. R., and Blázquez, M. Supporting newly-appointed judges: a legal knowledge management case study. Journal of Knowledge Management 9 5 (2005), 7--27.
• 11: Pompeu Casanovas , Nuria Casellas , Joan-Josep Vallbé , Marta Poblet , Francesc Ramos , Jesús Gorroñogoitia , Jesús Contreras , Mercedes Blázquez , Richard Benjamins, Iuriservice II: ontology development and architectural design, Proceedings of the 10th international conference on Artificial intelligence and law, June 06-11, 2005, Bologna, Italy [doi>10.1145/1165485.1165514]
• 12: Casanovas, P., Casellas, N., Vallbé, J.-J., Poblet, M., Benjamins, V. R., Blázquez, M., Peña-Ortiz, R., and Contreras, J. Semantic Web: A Legal Case Study. In Davies, J., Studer, R., Warren, P. Semantic Web Technologies: Trends and Research in Ontology-based Systems. John Wiley & Sons, Chichester, UK, 2006, 259--280.
• 13: Casanovas, P., Casellas, N., Vallbé, J.-J., Poblet, M., Blázquez, M., Contreras, J., Benjamins, V. R., and Lpez-Cobo, J.-M. D10.4.1 After Analysis: First steps of the Iuriservice implementation at the Spanish Judicial School. Technical Report SEKT, EU-IST Project IST-2003-506826. IDT (UAB)-iSOCO, Barcelona-Madrid, 2007.
• 14: Casellas, N., Blázquez, M., Kiryakov, A., Casanovas, P., Poblet, M., and Benjamins, V. R. OPJK into PROTON: legal domain integration into an upper-level ontology. In Meersman, R., Zahir, T., and Herrero, P. (eds.). On the Move to Meaningful Internet Systems 2005 (OTM 2005). WORM: 3rd International Workshop on Regulatory Ontologies (Larnaca, Cyprus, 31 Oct - 4 Nov 2005). Lecture Notes in Computer Science 3762), Springer, Berlin-Heidelberg, 846--855.
• 15: Casellas, N., Jakulin, A., Vallbé, J.-J., and Casanovas, P. Acquiring an ontology from the text. In Ali, M., Dapoigny, R. (eds.). Advances in Applied Artificial Intelligence, 19th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems (IEA/AIE 2006) (Annecy, France, June 27--30, 2006), Lecture Notes in Computer Science 4031, Springer, Berlin, 2006, 1000--1013.
• 16: John Davies , Rudi Studer , Paul Warren, Semantic Web Technologies: Trends and Research in Ontology-based Systems, John Wiley & Sons, 2006
• 17: Duke, A., Glover T., and Stintic, S. D5.2.2 Search and Browse Facility - Final Version. Technical Report SEKT, EU-IST Project IST-2003-506826, BT, London, 2005.
• 18: Fortuna, B., Grobelnik, M., and Mladenic, D. Semiautomatic construction of topic ontology. In Proceedings of the ECML/PKDD KDO'05 Workshop (Porto, Portugal, October 7th 2005), 2005.
• 19: Fortuna, B., Grobelnik, M., and Mladenic, D. Semi-automatic Data-driven Ontology Construction System. In Proceedings of the 9th International multi-conference Information Society (IS-2006), Ljubljana, Slovenia, 2006.
• 20: Fortuna, B. Grobelnik, M., and Mladenic, D. D1.12.1 Optimized Ontology Generation from Scratch. Technical Report SEKT, EU-IST Project IST-2003-506826. Josef Stefan Institute, Ljubljana, Slovenja, 2006.
• 21: Gangemi, A., and Breuker, J. Harmonising Legal Ontologies. Ontoweb. Technical Report IST Project 2000-2924, 2002.
• 22: Gangemi, A., Sagri, M., and Tiscornia, D. Metadata for content description in legal information. In ICAIL 2003 Workshop on Legal Ontologies and Web Based Legal Information Management. (June 24--28, 2003) Edinburgh, Scotland, UK, 2003.
• 23: Huang, Z., and Stuckenschmidt, H.; (2005): D 3.5.1. Reasoning with multiversion ontologies. EU-IST Project IST-2003-506826 SEKT Project Report, Vrije Universiteit of Amsterdam, Amsterdam, 2005.
• 24: Huang, Z., Schlobach, S., van Harmelen, F., Casellas, N., and Casanovas, P. D3.5.2. Reasoning with Multi-version Ontologies: Evaluation, EU-IST Project IST-2003-506826 SEKT Project Report Report, Vrije Universiteit of Amsterdam, Amsterdam, The Netherlands, 2006
• 25: Robert W. Van Kralingen, Frame-Based Conceptual Models of Statute Law, Kluwer Law Intl, 1995
• 26: Guiraude Lame , Sylvie Desprès, Updating ontologies in the legal domain, Proceedings of the 10th international conference on Artificial intelligence and law, June 06-11, 2005, Bologna, Italy [doi>10.1145/1165485.1165509]
• 27: Lehman, J., Biasiotti, M. A., Francesconi, E., and Sagri, M. T. (eds.). AAIL Proceedings. LOAIT - Legal Ontologies and Artificial Intelligence Techniques (Bologna, Italy, June 2005). Wolf Legal Publishers, Nijmegen, The Netherlands, 2005.
• 28: Llorente, S., Delgado, J., Rodríguez, E., Barrio, R., Longo, I., and Bixio, F. Generation of standarised rights expressions from contacts: an ontology approach? In On the Move to Meaningful Internet Systems 2005 (OTM 2005). WORM: 3rd International Workshop on Regulatory Ontologies (Larnaca, Cyprus, 31 Oct - 4 Nov 2005), 836--845.
• 29: Pinto, H., Tempich, C., S., and Sure, Y. DILIGENT: Towards a fine-grained methodology for DIstributed, Loosely-controlled and evolvInG Engingeering of oNTologies. In: Proceedings of the 16th European Conference on Artificial Intelligence (ECAI 2004) (August 22nd - 27th, 2004), Valencia, Spain, 2004.
• 30: Rodrigo, L., Blázquez, M., Casanovas, P., and Poblet, M. Legal Case Study: D10.1.1. Before Analysis. Technical Report SEKT, EU-IST Project IST-2003-506826, iSOCO-IDT (UAB), Madrid-Barcelona, 2004.
• 31: Rubino, R., Rotolo, A., and Sartor, G. An OWL Ontology of Fundamental Legal Concepts. In van Engers, T. M. (ed.). Legal Knowledge and Information Systems. URIX 2006: The 19th Annual Conference. Vol. 152. IOS Press, Amsterdam, The Netherlands, 2006.
• 32: Schlobach, S., Huang, Z., and Cornet, R. D3.6.2 Inconsistent Ontology Diagnosis: Evaluation. Technical Report SEKT, EU-IST Project IST-2003-506826, Vrije Universiteit of Amsterdam, Amsterdam, The Netherlands, 2006.
• 33: Terziev, I., Kiryakov, A., and Manov, D. D 1.8.1. Base upper-level ontology (BULO) Guidance. Technical Report SEKT, EU-IST Project IST-2003-506826, SIRMA, Sofia, Bulgary, 2004. http://proton.semanticweb.org/D1_8_1.pdf
• 34: André Valente , Joost Breuker , Bob Brouwer, Legal modeling and automated reasoning with ON—LINE, International Journal of Human-Computer Studies, v.51 n.6, p.1079-1125, Dec. 1999 [doi>10.1006/ijhc.1999.0298]
• 35: Visser, P. R. S., and Bench Capon, T. J. M. A comparison of four ontologies for the design of legal knowledge systems. Artificial Intelligence and Law 6 (1998), 27--57.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.2 Types of Systems
          Subjects: Decision support (e.g., MIS)

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.1 Applications and Expert Systems
          Subjects: Law

General Terms:
Design, Measurement, Performance

Keywords:
legal ontologies, ontologies, search enhancement, semantic distance, semantic search, semantics, topic ontologies