Search trails using user feedback to improve video search

ABSTRACT

In this paper we present an innovative approach for aiding users in the difficult task of video search. We use community based feedback mined from the interactions of previous users of our video search system to aid users in their search tasks. This feedback is the basis for providing recommendations to users of our video retrieval system. The ultimate goal of this system is to improve the quality of the results that users find, and in doing so, help users to explore a large and difficult information space and help them consider search options that they may not have considered otherwise. In particular we wish to make the difficult task of search for video much easier for users. The results of a user evaluation indicate that we achieved our goals, the performance of the users in retrieving relevant videos improved, and users were able to explore the collection to a greater extent.

REFERENCES

• 1: Adcock, J., Pickens, J., Cooper, M., Anthony, L., Chen, F. and Qvarfordt, P. FXPAL Interactive Search Experiments for TRECVID 2007. In Proc. TRECVID 2007.
• 2: Christel, M. G., and Conescu, R. M. Mining Novice User Activity in TRECVID Interactive Retrieval Tasks. In Proc CIVR 2006, 21--30.
• 3: Michael G. Christel, Establishing the utility of non-text search for news video retrieval with real world users, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291395]
• 4: Nick Craswell , Martin Szummer, Random walks on the click graph, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277784]
• 5: Jill Freyne , Rosta Farzan , Peter Brusilovsky , Barry Smyth , Maurice Coyle, Collecting community wisdom: integrating social search & social navigation, Proceedings of the 12th international conference on Intelligent user interfaces, January 28-31, 2007, Honolulu, Hawaii, USA [doi>10.1145/1216295.1216312]
• 6: David Goldberg , David Nichols , Brian M. Oki , Douglas Terry, Using collaborative filtering to weave an information tapestry, Communications of the ACM, v.35 n.12, p.61-70, Dec. 1992 [doi>10.1145/138859.138867]
• 7: Martin J. Halvey , Mark T. Keane, Analysis of online video search and sharing, Proceedings of the eighteenth conference on Hypertext and hypermedia, September 10-12, 2007, Manchester, UK [doi>10.1145/1286240.1286301]
• 8: Micheline Hancock-Beaulieu , Stephen Walker, An evaluation of automatic query expansion in an online library catalogue, Journal of Documentation, v.48 n.4, p.406-421, Dec. 1992 [doi>10.1108/eb026906]
• 9: Hopfgartner, F., Urban, J., Villa, R. and Jose, J. Simulated Testing of an Adaptive Multimedia Information Retrieval System. In Proc. CBMI 2007, IEEE (2007), 328--335.
• 10: Hopfgartner, F. Understanding Video Retrieval. VDM Verlag (2007)
• 11: Alejandro Jaimes , Mike Christel , Sébastien Gilles , Ramesh Sarukkai , Wei-Ying Ma, Multimedia information retrieval: what is it, and why isn't anyone using it?, Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval, p.3-8, November 10-11, 2005, Hilton, Singapore [doi>10.1145/1101826.1101829]
• 12: Diane Kelly , Jaime Teevan, Implicit feedback for inferring user preference: a bibliography, ACM SIGIR Forum, v.37 n.2, p.18-28, Fall 2003 [doi>10.1145/959258.959260]
• 13: Jingjing Liu , Wei Lai , Xian-Sheng Hua , Yalou Huang , Shipeng Li, Video search re-ranking via multi-graph propagation, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291279]
• 14: Milind Naphade , John R. Smith , Jelena Tesic , Shih-Fu Chang , Winston Hsu , Lyndon Kennedy , Alexander Hauptmann , Jon Curtis, Large-Scale Concept Ontology for Multimedia, IEEE MultiMedia, v.13 n.3, p.86-91, July 2006 [doi>10.1109/MMUL.2006.63]
• 15: Paul Resnick , Neophytos Iacovou , Mitesh Suchak , Peter Bergstrom , John Riedl, GroupLens: an open architecture for collaborative filtering of netnews, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.175-186, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.192905]
• 16: Gerard Salton , Chris Buckley, Improving retrieval performance by relevance feedback, Readings in information retrieval, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
• 17: Upendra Shardanand , Pattie Maes, Social information filtering: algorithms for automating “word of mouth”, Proceedings of the SIGCHI conference on Human factors in computing systems, p.210-217, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223931]
• 18: Alan F. Smeaton , Paul Over , Wessel Kraaij, Evaluation campaigns and TRECVid, Proceedings of the 8th ACM international workshop on Multimedia information retrieval, October 26-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178677.1178722]
• 19: Barry Smyth , Evelyn Balfe , Jill Freyne , Peter Briggs , Maurice Coyle , Oisin Boydell, Exploiting Query Repetition and Regularity in an Adaptive Community-Based Web Search Engine, User Modeling and User-Adapted Interaction, v.14 n.5, p.383-423, January 2005 [doi>10.1007/s11257-004-5270-4]
• 20: Snoek, C., Worring, M., Koelma, D., and Smeulders, A. Learned Lexicon-Driven Interactive Video Retrieval. In Proc CIVR 2006, 11--20.
• 21: Amanda Spink , Howard Greisdorf , Judy Bateman, From highly relevant to not relevant: examining different regions of relevance, Information Processing and Management: an International Journal, v.34 n.5, p.599-621, Sept. 1998 [doi>10.1016/S0306-4573(98)00025-9]
• 22: Alan Wexelblat , Pattie Maes, Footprints: history-rich tools for information foraging, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.270-277, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303060]
• 23: Ryen W. White , Mikhail Bilenko , Silviu Cucerzan, Studying the use of popular destinations to enhance web search interaction, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277771]
• 24: Vallet, D., Hopfgartner, F., and Jose, J. Use of Implicit Graph for Recommending Relevant Videos: A Simulated Evaluation. In Proc ECIR 2008.
• 25: Bo Yang , Tao Mei , Xian-Sheng Hua , Linjun Yang , Shi-Qiang Yang , Mingjing Li, Online video recommendation based on multimodal fusion and relevance feedback, Proceedings of the 6th ACM international conference on Image and video retrieval, p.73-80, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282290]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing

General Terms:
Experimentation, Human Factors

Keywords:
collaborative, community, feedback, recommender, search, user studies, video