ViGOR: a grouping oriented interface for search and retrieval in video libraries

ABSTRACT

In this paper, we present ViGOR (Video Grouping, Organisation and Retrieval) a video retrieval system that allows users to group videos in order to facilitate video retrieval tasks. In this way users are able to visualise and conceptualise many aspects of their search tasks and carry out a localised search in order to solve a more global search problem. The main objective of this work is to aid users while carrying out explorative video retrieval tasks; these tasks can be often ambiguous and multi-faceted. Two user evaluations were carried out in order to evaluate the usefulness of this grouping paradigm for assisting users. The first evaluation involved users carrying out broad tasks on YouTube, and gave insights into the application of our interface to a vast online video collection. The second evaluation involved users carrying out focused tasks on the TRECVID 2007 video collection, allowing a comparison over a local collection, on which we could extract a number of content-based features. The results of our evaluations show that the use of the ViGOR system results in an increase in user performance and user satisfaction, showing the potential of a grouping paradigm for video search for various tasks in a variety of diverse video collections.

REFERENCES

• 1: Von Ahn, L., Maurer, B., McMillen, C., Abraham, D. And Blum, M. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science, September 2008, pp 1465 -- 1468. (2008)
• 2: Borlund, P. The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Inf. Res. 8(3). (2003).
• 3: Katriina Byström , Kalervo Järvelin, Task complexity affects information seeking and use, Information Processing and Management: an International Journal, v.31 n.2, p.191-213, March/April 1995 [doi>10.1016/0306-4573(94)00041-Z]
• 4: Iain Campbell, Interactive Evaluation of the Ostensive ModelUsing a New Test Collection of Images with Multiple Relevance Assessments, Information Retrieval, v.2 n.1, p.89-114, February 2000 [doi>10.1023/A:1009902203782]
• 5: Christel, M.G, and Conescu, R.M. Mining Novice User Activity in TRECVID Interactive Retrieval Tasks. In Proc CIVR 2006, 21--30. (2006)
• 6: Michael G. Christel, Establishing the utility of non-text search for news video retrieval with real world users, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291395]
• 7: Nick Craswell , Martin Szummer, Random walks on the click graph, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277784]
• 8: Adam M. Fass , Eric A. Bier , Eyton Adar, PicturePiper: using a re-configurable pipeline to find images on the Web, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.51-62, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354411]
• 9: James Fogarty , Desney Tan , Ashish Kapoor , Simon Winder, CueFlik: interactive concept learning in image search, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357061]
• 10: Guy, M. and Tonkin, E. Folksonomies Tidying Up Tags, D-Lib Magazine, Volume 12, Number 1, (2006).
• 11: Alejandro Jaimes , Mike Christel , Sébastien Gilles , Ramesh Sarukkai , Wei-Ying Ma, Multimedia information retrieval: what is it, and why isn't anyone using it?, Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval, p.3-8, November 10-11, 2005, Hilton, Singapore [doi>10.1145/1101826.1101829]
• 12: Martin J. Halvey , Mark T. Keane, Analysis of online video search and sharing, Proceedings of the eighteenth conference on Hypertext and hypermedia, September 10-12, 2007, Manchester, UK [doi>10.1145/1286240.1286301]
• 13: Alexander G. Hauptmann , Michael G. Christel, Successful approaches in the TREC video retrieval evaluations, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027681]
• 14: Alexander G. Hauptmann , Wei-Hao Lin , Rong Yan , Jun Yang , Ming-Yu Chen, Extreme video retrieval: joint maximization of human and computer performance, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180721]
• 15: Hopfgartner, F. Understanding Video Retrieval. VDM Verlag (2007)
• 16: Frank Hopfgartner , David Vallet , Martin Halvey , Joemon Jose, Search trails using user feedback to improve video search, Proceeding of the 16th ACM international conference on Multimedia, October 26-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1459359.1459405]
• 17: Nakazato, M., Manola, L. and Huang, T.S. ImageGrouper: A Group-Oriented User Interface for Content-Based Image Retrieval and Digital Image Arrangement. J. Vis. Lang. Comput. 14, 363--386, (2003).
• 18: Milind Naphade , John R. Smith , Jelena Tesic , Shih-Fu Chang , Winston Hsu , Lyndon Kennedy , Alexander Hauptmann , Jon Curtis, Large-Scale Concept Ontology for Multimedia, IEEE MultiMedia, v.13 n.3, p.86-91, July 2006 [doi>10.1109/MMUL.2006.63]
• 19: Ork de Rooij , Cees G.M. Snoek , Marcel Worring, MediaMill: fast and effective video search using the forkbrowser, Proceedings of the 2008 international conference on Content-based image and video retrieval, July 07-09, 2008, Niagara Falls, Canada [doi>10.1145/1386352.1386431]
• 20: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 21: Snoek, C., Worring, M., Koelma, D., and Smeulders, A. Learned Lexicon-Driven Interactive Video Retrieval. In Proc CIVR 2006, 11--20.
• 22: Jana Urban , Joemon M. Jose, EGO: A personalized multimedia management and retrieval tool: Research Articles, International Journal of Intelligent Systems, v.21 n.7, p.725-745, July 2006 [doi>10.1002/int.v21:7]
• 23: Robert Villa , Nicholas Gildea , Joemon M. Jose, A faceted interface for multimedia search, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390498]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Web-based interaction

General Terms:
Design, Experimentation, Human Factors, Management

Keywords:
search, user studies, video, visualisation