Rich metadata and context capturing through CIDOC/CRM and MPEG-7 interoperability

ABSTRACT

It is now accepted that powerful retrieval of multimedia data can be achieved with the integration of semantic and contextual metadata that relate to multimedia objects. In the case of objects related to culture and history there is a wealth of related information stored in Digital Libraries. CIDOC/CRM is a new, rapidly adopted standard in the field of cultural heritage that provides a very powerful model for encoding cultural heritage knowledge. In this paper we propose that knowledge is extracted and encoded in MPEG-7 multimedia object descriptions in an automatic manner so that the multimedia objects are augmented with very rich metadata descriptions coming from Digital Libraries. We analyze the mapping problem between CIDOC/CRM and MPEG-7 and we present the algorithms and a software system that supports this mapping.

REFERENCES

• 1: J. Li, and J. Wang: "Studying digital imagery of ancient paintings by mixtures of stochastic models, IEEE transactions on image processing, 13,3, pp 340--353, 2004.
• 2: L. Ballan , M. Bertini , A. Del Bimbo , W. Nunziati, Soccer players identification based on visual local features, Proceedings of the 6th ACM international conference on Image and video retrieval, p.258-265, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282321]
• 3: Cees G. M. Snoek , Marcel Worring , Jan C. van Gemert , Jan-Mark Geusebroek , Arnold W. M. Smeulders, The challenge problem for automated detection of 101 semantic concepts in multimedia, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180727]
• 4: Chrisa Tsinaraki, Stavros Christodoulakis: "An MPEG-7 Query Language and a User Preference Model that allow Semantic Retrieval and Filtering of Multimedia Content", ACM-Springer Multimedia Systems Journal, in Special Issue on Semantic Multimedia Adaptation and Personalization, 2007.
• 5: J. Hunter, "Adding Multimedia to the Semantic Web - Building an MPEG-7 Ontology". In the proc. of the International Semantic Web Working Symposium (SWWS), 2001
• 6: CIDOC CRM Mappings, Specializations and Data Examples: http://cidoc.ics.forth.gr/crm_mappings.html
• 7: Harry Agius , Marios C. Angelides, Enriching MPEG-7 User Models with Content Metadata, Proceedings of the First International Workshop on Semantic Media Adaptation and Personalization, p.151-156, December 04-05, 2006 [doi>10.1109/SMAP.2006.16]
• 8: Tsinaraki C., Polydoros P., Christodoulakis S., "Interoperability support for Ontology-based Video Retrieval Applications", In the Proceedings of Conference on Image and Video Retrieval (CIVR) 2004, Dublin/Ireland, July 2004
• 9: Apache Foundation, XMLBeans XML binding framework. http://xmlbeans.apache.org/ , 2003.
• 10: Ntousias A. Gioldasis N. Tsinaraki C. Christodoulakis S: "Rich Metadata and Context Capturing through CIDOC/CRM and MPEG-7 Interoperability {EXTENDED}", http://www.music.tuc.gr/http://localhost:8084/music/GetFile?FILE_TYPE=DNLD.FILE&FILE_ID=1
• 11: HP Labs, Jena - A Semantic Web Framework for Java http://jena.sourceforge.net/, 2007.
• 12: Hunter J. (2002), Combining the CIDOC CRM and MPEG-7 to Describe Multimedia in Museums, In the Proc. of the Museums and the Web international conference, Boston, April 2002.
• 13: ISO /IEC International Standard 15938-2 Information technology - Multimedia content description interface - Part 2 Description Definition Language, 2001.
• 14: ISO 21127:2006 Information and documentation - A reference ontology for the interchange of cultural heritage information (CIDOC/CRM).
• 15: Salembier P (2001) MPEG-7 Multimedia Description Schemes. IEEE TA on Circuits and Systems for Video Technology, 11, 6, 2001, 748--759.
• 16: Tsinaraki C, Fatourou E, Christodoulakis S (2003) An Ontology-Driven Framework for the Management of Semantic Metadata describing Audiovisual Information. In Proc. of the Conference of Advanced Information Systems Engineering (CaiSE), Velden, Austria, 2003, pp 340--356.
• 17: Chrisa Tsinaraki , Panagiotis Polydoros , Stavros Christodoulakis, Interoperability Support between MPEG-7/21 and OWL in DS-MIRF, IEEE Transactions on Knowledge and Data Engineering, v.19 n.2, p.219-232, February 2007 [doi>10.1109/TKDE.2007.33]
• 18: World Wide Web Consortium (W3C): XML Path Language (XPath) Version 1.0: http://www.w3.org/TR/xpath

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.12 Interoperability
            Subjects: Data mapping

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.13 Reusable Software
            Subjects: Domain engineering

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries

General Terms:
Algorithms, Management, Verification

Keywords:
CIDOC/CRM, MPEG-7, context capture, mapping algorithm, metadata