Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

In this work, we offer an approach to combine standard multimedia analysis techniques with knowledge drawn from conceptual metadata provided by domain experts of a specialized scholarly domain, to learn a domain-specific multimedia ontology from a set of annotated examples. A standard Bayesian network learning algorithm that learns structure and parameters of a Bayesian network is extended to include media observables in the learning. An expert group provides domain knowledge to construct a basic ontology of the domain as well as to annotate a set of training videos. These annotations help derive the associations between high-level semantic concepts of the domain and low-level MPEG-7 based features representing audio-visual content of the videos. We construct a more robust and refined version of this ontology by learning from this set of conceptually annotated videos. To encode this knowledge, we use MOWL, a multimedia extension of Web Ontology Language (OWL) which is capable of describing domain concepts in terms of their media properties and of capturing the inherent uncertainties involved. We use the ontology specified knowledge for recognizing concepts relevant to a video to annotate fresh addition to the video database with relevant concepts in the ontology. These conceptual annotations are used to create hyperlinks in the video collection, to provide an effective video browsing interface to the user.

REFERENCES

• 1: Invis multimedia webpage. http://www.invisplaza.com/search/index.php?mode=browse&format_=2.
• 2: Zhongli Ding , Yun Peng, A Probabilistic Extension to Ontology Language OWL, Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 4, p.40111.1, January 05-08, 2004
• 3: N. Friedman and M. Goldszmidt. Learning bayesian networks with local structure. In Proceedings of the Twelth Conference on Uncertainty in Artificial Intelligence pages 252--262, August 1996.
• 4: N. Friedman and Yakhin. On the sample complexity of learning bayesian networks. In Proceedings of the Twelth Conference on Uncertainty in Artificial Intelligence pages 274--282, August 1996.
• 5: H. Ghosh, S. Chaudhury, K. Kashyap, and B. Maiti. Ontology Specification and Integration for Multimedia Applications chapter 9. Springer, 2006.
• 6: Gaurav Harit , Santanu Chaudhury , Hiranmay Ghosh, Using Multimedia Ontology for Generating Conceptual Annotations and Hyperlinks in Video Collections, Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, p.211-217, December 18-22, 2006 [doi>10.1109/WI.2006.183]
• 7: G. Iyengar , P. Duygulu , S. Feng , P. Ircing , S. P. Khudanpur , D. Klakow , M. R. Krause , R. Manmatha , H. J. Nock , D. Petkova , B. Pytlik , P. Virga, Joint visual-text modeling for automatic retrieval of multimedia documents, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101154]
• 8: T. Karthik, S. Chaudhury, and H. Ghosh. Specifying spatio-temporal relations in multimedia ontologies. In Proceedings of International Conference of Pattern Recognition and Machine Intelligence (PReMI'05) 2005.
• 9: Atsuhiro Kojima , Takeshi Tamura , Kunio Fukunaga, Natural Language Description of Human Activities from Video Images Based on Concept Hierarchy of Actions, International Journal of Computer Vision, v.50 n.2, p.171-184, November 2002 [doi>10.1023/A:1020346032608]
• 10: M. Naphade, T. Kristjansson, B. Frey, and T. Huang. Probabilistic multimedia objects (multijects):a novel approach to video indexing and retrieval in multimedia systems. In International Conference on Image Analysis and Processing pages 536--540, October 1998.
• 11: Roberto Navigli , Paola Velardi , Aldo Gangemi, Ontology Learning and Its Application to Automated Terminology Translation, IEEE Intelligent Systems, v.18 n.1, p.22-31, January 2003 [doi>10.1109/MIS.2003.1179190]
• 12: P. Quelhas and J.-M. Odobez. Natural scene image modeling using color and texture visterms. In Proceedings International Conference on Image and Video Retrieval (CIVR)July 2006.
• 13: Jiang Su , Harry Zhang, Full Bayesian network classifiers, Proceedings of the 23rd international conference on Machine learning, p.897-904, June 25-29, 2006, Pittsburgh, Pennsylvania [doi>10.1145/1143844.1143957]
• 14: Christopher Town, Ontology-Driven Bayesian Networks for Dynamic Scene Understanding, Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 7, p.116, June 27-July 02, 2004
• 15: Lina Zhou, Ontology learning: state of the art and open issues, Information Technology and Management, v.8 n.3, p.241-252, September 2007 [doi>10.1007/s10799-007-0019-5]
• 16: L. Zhou , Q. Booker , D. Zhang, Toward Rapid Ontology Development for Underdeveloped Domains, Proceedings of the 35th Annual Hawaii International Conference on System Sciences (HICSS'02)-Volume 4, p.106, January 07-10, 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.m MISCELLANEOUS

General Terms:
Design, Experimentation

Keywords:
multimedia web ontology language, ontology learning, video annotation, video retrieval