Improving user confidence in cultural heritage aggregated results

ABSTRACT

State of the art web search systems enable aggregation of information from many sources. Users are challenged to assess the reliability of information from different sources. We report on an empirical user study on the effect of displaying credibility ratings of multiple cultural heritage sources (e.g. museum websites, art blogs) on users' search performance and selection. The results of our online interactive study (N=122) show that when explicitly presenting these ratings, people become significantly more confident in their selection of information from aggregated results.

REFERENCES

• 1: Alia Amin , Jacco van Ossenbruggen , Lynda Hardman , Annelies van Nispen, Understanding cultural heritage experts' information seeking needs, Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries, June 16-20, 2008, Pittsburgh PA, PA, USA [doi>10.1145/1378889.1378897]
• 2: Alia Amin , Junte Zhang , Henriette Cramer , Lynda Hardman , Vanessa Evers, The effects of source credibility ratings in a cultural heritage information aggregator, Proceedings of the 3rd workshop on Information credibility on the web, April 20-20, 2009, Madrid, Spain [doi>10.1145/1526993.1527003]
• 3: Henriette Cramer , Vanessa Evers , Satyan Ramlal , Maarten Someren , Lloyd Rutledge , Natalia Stash , Lora Aroyo , Bob Wielinga, The effects of transparency on trust in and acceptance of a content-based art recommender, User Modeling and User-Adapted Interaction, v.18 n.5, p.455-496, November 2008 [doi>10.1007/s11257-008-9051-3]
• 4: C. Hovland and W. Weiss. The influence of source credibility on communication effectiveness. The Public Opinion Quarterly, 15(4):635--650, 1951.
• 5: Vanessa Murdock , Mounia Lalmas, Workshop on aggregated search, ACM SIGIR Forum, v.42 n.2, December 2008 [doi>10.1145/1480506.1480520]
• 6: K. Tanaka, X. Zhou, and A. Jatowt, editors. Proc. of WICOW '09., New York, NY, USA, 2009. ACM.
• 7: Shawn Tseng , B. J. Fogg, Credibility and computing technology, Communications of the ACM, v.42 n.5, p.39-44, May 1999 [doi>10.1145/301353.301402]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries
          Subjects: User issues

General Terms:
Design, Experimentation, Human Factors

Keywords:
aggregated search, credibility, cultural heritage, quantitative user study