Towards an ecosystem for semantics

ABSTRACT

Multimedia does not exhibit a unique semantics but multiple semantics that are influenced by many factors. Current approaches and systems lack from considering this problemin its entirety. What is needed is a holistic approach that describes and embraces the complex and challenging problem of multimedia semantics. Consequently, we are developing with the Semantics Ecosystem (SES) an approach that aimsat providing a "framework" for solving this problem. The SES defines five types of semantics and their relationships to each other and to the real world. In the paper, we present the SES and show its application to the domain of authoring multimedia albums. We show the benefits of having such a theoretical framework to handle the semantics of multimedia albums. The SES allows us to better understand, describe, and communicate the many different factors that are influencing multimedia semantics.

REFERENCES

• 1: B. Adams, C. Dorai, and S. Venkatesh. Towards automatic extraction of expressive elements from motion pictures: Tempo. In IEEE International Conference on Multimedia and Expo (II), pages 641--644, 2000.
• 2: Brett Adams , Svetha Venkatesh , Ramesh Jain, IMCE: Integrated media creation environment, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.1 n.3, p.211-247, August 2005 [doi>10.1145/1083314.1083315]
• 3: Susanne Boll , Philipp Sandhaus , Ansgar Scherp , Utz Westermann, Semantics, content, and structure of many for the creation of personal photo albums, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291385]
• 4: G. Brososky. Signs, symbols and icons (Encyclopedia of educational technology), 2006. Retrieved April 5, 2007, from http://coe.sdsu.edu/eet/Articles/ssilayout/start.htm.
• 5: Peter Brusilovsky , Mark T. Maybury, From adaptive hypermedia to the adaptive web, Communications of the ACM, v.45 n.5, May 2002 [doi>10.1145/506218.506239]
• 6: P. R. Cohen and C. R. Beal. Natural semantics for a mobile robot. Technical Report 00-59, Department of Computer Science, University of Massachusettes, Amherst, MA, 2000.
• 7: A. K. Dey and G. D. Abowd. Towards a Better Understanding of Context and Context--Awareness. Technical Report GIT-GVU-99-22, Graphics, Visualization and Usability Center and College of Computing, Georgia Institute of Technology, Atlanta, GA, USA, June 1999.
• 8: Josef Fink , Alfred Kobsa , Jörg Schreck, Personalized Hypermedia Information Provision Through Adaptive and Adaptable System Features: User Modelling, Privacy and Security Issues, Proceedings of the Fourth International Conference on Intelligence and Services in Networks: Technology for Cooperative Competition, p.459-467, May 27-29, 1997
• 9: W. I. Grosky , D. V. Sreenath , F. Fotouhi, Emergent semantics and the multimedia semantic web, ACM SIGMOD Record, v.31 n.4, December 2002 [doi>10.1145/637411.637420]
• 10: W. I. Grosky, D. V. Sreenath, and F. Fotouhi. Deriving emergent semantics. In Association for Information Systems, SIG on Semantic Web and IS, Retrieved January 9, 2007, from http://www.sigsemis.org/articles/grosky/document view/, Nov. 2004.
• 11: Alfred Kobsa , Jürgen Koenemann , Wolfgang Pohl, Personalised hypermedia presentation techniques for improving online customer relationships, The Knowledge Engineering Review, v.16 n.2, p.111-155, March 2001 [doi>10.1017/S0269888901000108]
• 12: C. A. Lindley , J. R. Davis , F. Nack , L. W. Rutledge, The application of rhetorical structure theory to interactive news program generation from digital archives, CWI (Centre for Mathematics and Computer Science), Amsterdam, The Netherlands, 2001
• 13: K. Popper. Three worlds {the tanner lecture on human values: Delivered at the university of michigan}, Apr. 1978. Retrieved May 7, 2007, from http://www.tannerlectures.utah.edu/lectures/popper80.pdf.
• 14: Simone Santini , Amarnath Gupta , Ramesh Jain, Emergent Semantics through Interaction in Image Databases, IEEE Transactions on Knowledge and Data Engineering, v.13 n.3, p.337-351, May 2001 [doi>10.1109/69.929893]
• 15: S. Santini and R. Jain. The "El NiÜno"; Image Database System. In IEEE Int. Conf. on Multimedia Computing and Systems, Vol. 1, pages 524--529, 1999.
• 16: A. Scherp. A Component Framework for Personalized Multimedia Applications. PhD thesis, Carl von Ossietzky University of Oldenburg, School of Computing Science, Business Administration, Economics and Law, Department of Computing Science, 2007.
• 17: Ansgar Scherp , Susanne Boll, Context-driven smart authoring of multimedia content with xSMART, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101323]
• 18: A. Scherp and S. Boll. MM4U-a framework for creating personalized multimedia content. In S. Nepal and U. Srinivasan, editors, Managing Multimedia Semantics, chapter 11, pages 246--287. Idea Group Publishing, 2005.
• 19: Ansgar Scherp , Susanne Boll, Paving the Last Mile for Multi-Channel Multimedia Presentation Generation, Proceedings of the 11th International Multimedia Modelling Conference, p.190-197, January 12-14, 2005 [doi>10.1109/MMMC.2005.58]
• 20: A. Scherp, S. Boll, and H. Cremer. Emergent semantics in personalized multimedia content. J. of Digital Information Management, 5(2), Apr. 2007.
• 21: B. Schilit, N. Adams, and R. Want. Context-Aware Computing Applications. In Workshop on Mobile Computing Systems and Applications; Santa Cruz, CA, USA, pages 85--90. IEEE Computer Society Press, 1994.
• 22: A. Schmidt, M. Beigl, and H.-W. Gellersen. There is more to context than location. Computers & Graphics, 23(6):893--901, 1999.
• 23: D. Sreenath, W. Grosky, and F. Fotouhi. Deriving emergent web page semantics. In Workshop on Implicit Measures of User Interests and Preferences at the 26th Annual Int. ACM SIGIR Conf.; Toronto, Canada, Aug. 2003.
• 24: Stanford Encyclopedia of Philosophy, USA. Karl Popper (Stanford encyclopedia of philosophy), Oct. 2006. Retrieved June 28, 2007, from http://plato.stanford.edu/entries/popper/.
• 25: Utz Westermann , Ramesh Jain, {\rm E} - A Generic Event Model for Event-Centric Multimedia Data Management in eChronicle Applications, Proceedings of the 22nd International Conference on Data Engineering Workshops, p.106, April 03-07, 2006 [doi>10.1109/ICDEW.2006.1]
• 26: Utz Westermann , Ramesh Jain, Toward a Common Event Model for Multimedia Applications, IEEE MultiMedia, v.14 n.1, p.19-29, January 2007 [doi>10.1109/MMUL.2007.23]
• 27: Wikipedia. 4 (number), June 2007. Retrieved July 3, 2007, from http://en.wikipedia.org/wiki/4 (number)#In other fields.
• 28: 3rd Special Workshop on Multimedia Semantics; Pisa, Italy, June 2005. Retrieved January 30, 2007, from http://www.kettering.edu/<pstanche/wms05homepage/wms05.html.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.1 Systems and Information Theory
          Subjects: Information theory

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.1 Systems and Information Theory
          Subjects: Value of information
      H.1.2 User/Machine Systems
          Subjects: Human information processing; Human factors

General Terms:
Algorithms, Design, Human Factors, Management

Keywords:
ecosystem, events, multimedia authoring, multimedia semantics, semantics