An empirical study of inter-concept similarities in multimedia ontologies

ABSTRACT

Generic concept detection has been a widely studied topic in recent research on multimedia analysis and retrieval, but the issue of how to exploit the structure of a multimedia ontology as well as different inter-concept relations, has not received similar attention. In this paper, we present results from our empirical analysis of different types of similarity among semantic concepts in two multimedia ontologies, LSCOM-Lite and CDVP-206. The results show promise that the proposed methods may be helpful in providing insight into the existing inter-concept relations within an ontology and selecting the most facilitating set of concepts and hierarchical relations. Such an analysis as this can be utilized in various tasks such as building more reliable concept detectors and designing large-scale ontologies.

REFERENCES

• 1: M. G. Christel and A. G. Hauptmann. The use and utility of high-level semantic features in video retrieval. In Proceedings of 4th International Conference on Image and Video Retrieval (CIVR 2005), pages 134--144, Singapore, July 2005.
• 2: S. Ebadollahi, L. Xie, S.-F. Chang, and J. R. Smith. Visual event detection using multi-dimensional concept dynamics. In Proceedings of the IEEE International Conference on Multimedia & Expo (ICME 2006), Toronto, Canada, July 2006.
• 3: G. Gaughan. Novelty Detection in Video Retrieval: Finding New News in TV News Stories. PhD thesis, Dublin City University, 2006.
• 4: Thomas Hofmann, Unsupervised learning by probabilistic latent semantic analysis, Machine Learning, v.42 n.1/2, p.177-196, Jan. 2001 [doi>10.1023/A:1007617005950]
• 5: G. Iyengar , H. J. Nock, Discriminative model fusion for semantic concept detection and annotation in video, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957065]
• 6: W. Jiang, S.-F. Chang, and A. C. Loui. Active context-based concept fusion with partial user labels. In Proceedings of IEEE International Conference on Image Processing (ICIP 06), Atlanta, GA, USA, 2006.
• 7: John R. Kender , Milind R. Naphade, Visual Concepts for News Story Tracking: Analyzing and Exploiting the NIST TRECVID Video Annotation Experiment, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.1174-1181, June 20-26, 2005 [doi>10.1109/CVPR.2005.371]
• 8: T. Kohonen , M. R. Schroeder , T. S. Huang, Self-Organizing Maps, Springer-Verlag New York, Inc., Secaucus, NJ, 2001
• 9: M. Koskela, A. F. Smeaton, and J. Laaksonen. Measuring concept similarities in multimedia ontologies: Analysis and evaluations. IEEE Transactions on Multimedia, 2007. To appear.
• 10: Beitao Li , Kingshy Goh, Confidence-based dynamic ensemble for image annotation and semantics discovery, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957051]
• 11: Milind Naphade , John R. Smith , Jelena Tesic , Shih-Fu Chang , Winston Hsu , Lyndon Kennedy , Alexander Hauptmann , Jon Curtis, Large-Scale Concept Ontology for Multimedia, IEEE MultiMedia, v.13 n.3, p.86-91, July 2006 [doi>10.1109/MMUL.2006.63]
• 12: M. R. Naphade, L. Kennedy, J. R. Kender, S.-F. Chang, J. R. Smith, P. Over, and A. Hauptmann. A light scale concept ontology for multimedia understanding for TRECVID 2005. TR, IBM, 2005.
• 13: M. R. Naphade, I. Kozintsev, and T. Huang. A factor graph framework for semantic video indexing. IEEE Transactions on Circuits and Systems for Video Technology, 12(1):40--52, January 2002.
• 14: S. Paek and S.-F. Chang. Experiments in constructing belief networks for image classification systems. In Proceedings of International Conf. on Image Processing, Vancouver, Canada, September 2000.
• 15: M. Sjöberg, H. Muurinen, J. Laaksonen, and M. Koskela. PicSOM experiments in TRECVID 2006. In Proceedings of the TRECVID 2006 Workshop, Gaithersburg, MD, USA, November 2006.
• 16: A. F. Smeaton. Large scale evaluations of multimedia information retrieval: The TRECVid experience. In Proc. 4th International Conference on Image and Video Retrieval, pages 11--17, Singapore, July 2005.
• 17: J. R. Smith , M. Naphade , A. Natsev, Multimedia semantic indexing using model vectors, Proceedings of the 2003 International Conference on Multimedia and Expo, p.445-448, July 06-09, 2003
• 18: Cees G. M. Snoek , Marcel Worring , Jan-Mark Geusebroek , Dennis C. Koelma , Frank J. Seinstra , Arnold W. M. Smeulders, The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.28 n.10, p.1678-1689, October 2006 [doi>10.1109/TPAMI.2006.212]
• 19: Cees G. M. Snoek , Marcel Worring , Jan C. van Gemert , Jan-Mark Geusebroek , Arnold W. M. Smeulders, The challenge problem for automated detection of 101 semantic concepts in multimedia, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180727]
• 20: Y. Wu, B. L. Tseng, and J. R. Smith. Ontology-based multi-classification learning for video concept detection. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2004), pages 1003--1006, Taipei, Taiwan, June 2004.
• 21: L. Xie and S.-F. Chang. Pattern mining in visual concept streams. In Proceedings of the IEEE International Conference on Multimedia & Expo (ICME 2006), Toronto, Canada, July 2006.
• 22: R. Yan, M.-Y. Chen, and A. Hauptmann. Mining relationship between video concepts using probabilistic graphical models. In Proc. Int'l Conf. on Multimedia & Expo, Toronto, Canada, July 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Multimedia databases

General Terms:
Algorithms, Experimentation, Human Factors

Keywords:
multimedia ontologies, semantic concept detection