Interactive components for visual exploration of multimedia archives

ABSTRACT

With the increase of online resources, one main challenge for multimedia content providers is to provide efficient and user friendly tools for a deep and shallow navigation adapted to large scale audiovisual content. This paper describes a generic framework to build visual interactive applications the objectives of which are to enhance the understanding and to allow easy access to multimedia resources and management. Visual Maps are built on multi-modal similarity matrices computed from automatically extracted descriptors and use graph clustering and layout methods. Active relevance feedback methods are applied to allow users to control the maps evolution according to their needs. The First results of users' evaluation are presented for one of our tools.

REFERENCES

• 1: Julien Law-To , Olivier Buisson , Valerie Gouet-Brunet , Nozha Boujemaa, Robust voting algorithm based on labels of behavior for video copy detection, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180826]
• 2: N. Boujemaa and J. Fauqueur and M. Ferecatu and F. Fleuret and V. Gouet and B. Le Saux and H. Sahbi", IKONA for interactive specific and generic image retrieval", MMCBIR 2001, France", 2001.
• 3: N. Grira, M. Crucianu, and N. Boujemaa. Fuzzy clustering with pairwise constraints for knowledge-driven image categorization. In IEEE Proceedings on Vision, Image and Signal Processing, 2006.
• 4: M. Larson, S. Eickeler, J. Köhler. Supporting radio archive workflows with vocabulary independent spoken keyword search. Searching Spontaneous Conversational Speech Workshop, SIGIR 2007, Amsterdam
• 5: A. Joly, C. Frélicot and O. Buisson, Feature statistical retrieval applied to content-based copy identification, in Proc. of Int. Conf. on Image Processing, 2004.
• 6: A. Joly, O. Buisson and C. Frélicot, Content-Based Copy Retrieval Using Distorsion-based Probabilistic Similarity Search, in IEEE Transactions on Multimedia, 2007.
• 7: Sébastien Poullot , Olivier Buisson , Michel Crucianu, Z-grid-based probabilistic retrieval for scaling up content-based copy detection, Proceedings of the 6th ACM international conference on Image and video retrieval, p.348-355, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282334]
• 8: Jérôme Thièvre PHD Thesis, INA/Univ of Montpellier, 2006
• 9: Ivan Herman , Guy Melançon , M. Scott Marshall, Graph Visualization and Navigation in Information Visualization: A Survey, IEEE Transactions on Visualization and Computer Graphics, v.6 n.1, p.24-43, January 2000 [doi>10.1109/2945.841119]
• 10: A. Noack. An energy model for visual graph clustering. In G. Liotta, editor, 11th International Symposium on Graph Drawing (GD 2003), LNCS 2912, pages 425--436, Berlin, 2004. Springer-Verlag.
• 11: Thomas M. J. Fruchterman , Edward M. Reingold, Graph drawing by force-directed placement, Software—Practice & Experience, v.21 n.11, p.1129-1164, Nov. 1991 [doi>10.1002/spe.4380211102]
• 12: A. Noack. Energy-based clustering of graphs with non uniform degrees. In 14th International Symposium on Graph Drawing (GD 2006), pages 309--320, Limerick, Ireland, 2006.
• 13: H. Goëau and O. Buisson and M-L. Viaud}, Image Collection Structuring Based On Evidential Active Learner, Sixth International Workshop on Content-Based Multimedia Indexing, London, UK, 2008.
• 14: H. Goëau and J. Thièvre and M-L. Viaud and D. Pellerin, Interactive Visualization Tool with Graphic Table of Video Contents, EEE International Conference on Multimedia and Expo, p 807--810, Beijing, China, 2007.
• 15: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 16: Brian Shackel, Usability—context, framework, definition, design and evaluation, Human factors for informatics usability, Cambridge University Press, New York, NY, 1991
• 17: Ben Shneiderman, Designing the user interface (2nd ed.): strategies for effective human-computer interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback; Information filtering
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.7 Feature Measurement
          Subjects: Feature representation

General Terms:
Algorithms, Documentation, Experimentation, Human Factors, Theory

Keywords:
active learning, cross modal descriptors, index structuring, information visualization, interactivity, multimedia archives, scalability