Spatio-temporal query for multimedia databases

ABSTRACT

Complex media events are often characterized by spatio-temporal relations between its constituent media objects. A multimedia query language should support specification of such relations for semantic retrieval. We propose a method for formally defining 3D spatio-temporal relations between elementary media objects in this paper. To support soft decision making for multimedia data interpretation and to provide graded ranking, we define these relations using a set of fuzzy membership functions. It is possible to define fuzzy 3D extensions of Allen's relations as well as arbitrary new relations using our method. This method can be incorporated with upcoming multimedia query languages, such as MP7QF.

REFERENCES

• 1: James F. Allen, Maintaining knowledge about temporal intervals, Communications of the ACM, v.26 n.11, p.832-843, Nov. 1983 [doi>10.1145/182.358434]
• 2: Farhad Arbab, Set Models and Boolean Operations for Solids and Assemblies, IEEE Computer Graphics and Applications, v.10 n.6, p.76-86, November 1990 [doi>10.1109/38.62698]
• 3: Doller M., Renner K., Kosch H., Wolf I., Gruhne M., "Introduction of an MPEG-7 Query Language", 2nd International Conference on Digital Information Management, ICDIM, Pages 92--97, 2007.
• 4: Ghosh H., Chaudhury S, Kashyap K. and Maiti B., "Ontology Specification and Integration for Multimedia Applications. In Ontologies: A Handbook of Principles, Concepts and Applications in Information Systems", Springer, 2007.
• 5: Gaurav Harit , Santanu Chaudhury , Hiranmay Ghosh, Using Multimedia Ontology for Generating Conceptual Annotations and Hyperlinks in Video Collections, Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, p.211-217, December 18-22, 2006 [doi>10.1109/WI.2006.183]
• 6: Kandasamy W B V., "Smarandache Fuzzy Algebra", American Research Press, Rehoboth, 2003.
• 7: Karthik T, Chaudhury S and Ghosh H., "Specifying Spatio-Temporal Relations in Multimedia Ontologies". International Conference of Pattern Recognition and Machine Intelligence (PReMI), Kolkata, Dec 2005.
• 8: Peiya Liu , Amit Chankraborty , Liang H. Hsu, A predicate logic approach for MPEG-7 XML document queries, Markup Languages, v.3 n.3, p.365-381, Summer 2001 [doi>10.1162/109966201753750360]
• 9: Dimitris Papadias , Nikos Mamoulis , Vasilis Delis, Approximate spatio-temporal retrieval, ACM Transactions on Information Systems (TOIS), v.19 n.1, p.53-96, Jan. 2001 [doi>10.1145/366836.366874]
• 10: Salembier P., Smith J R, "MPEG-7 Multimedia Description Schemes", IEEE Transactions on Circuits and Systems for Video Technology, vol 11, no. 6, June 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

General Terms:
Human Factors, Theory

Keywords:
fuzzy logic, multimedia database, multimedia query language, spatio-temporal relation