Trust building with explanation interfaces

ABSTRACT

Based on our recent work on the development of a trust model for recommender agents and a qualitative survey, we explore the potential of building users' trust with explanation interfaces. We present the major results from the survey, which provided a roadmap identifying the most promising areas for investigating design issues for trust-inducing interfaces. We then describe a set of general principles derived from an in-depth examination of various design dimensions for constructing explanation interfaces, which most contribute to trust formation. We present results of a significant-scale user study, which indicate that the organization-based explanation is highly effective in building users' trust in the recommendation interface, with the benefit of increasing users' intention to return to the agent and save cognitive effort.

REFERENCES

• 1: Rakesh Agrawal , Tomasz Imieliński , Arun Swami, Mining association rules between sets of items in large databases, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.207-216, May 25-28, 1993, Washington, D.C., United States
• 2: Armengol, E., Palaudàries, A., Plaza, E. Individual prognosis of diabetes long-term risks: a CBR approach. Methods of Information in Medicine 40, 2001, 46--51.
• 3: Robin D. Burke , Kristian J. Hammond , Benjamin C. Young, The FindMe Approach to Assisted Browsing, IEEE Expert: Intelligent Systems and Their Applications, v.12 n.4, p.32-40, July 1997 [doi>10.1109/64.608186]
• 4: Carenini, G. and Moore, J. Multimedia explanations in IDEA decision support system. Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems, 1998.
• 5: Chen, L. and Pu, P. Trust building in recommender agents. In Proceedings of the Workshop on Web Personalization, Recommender Systems and Intelligent User Interfaces at the 2nd International Conference on E-Business and Telecommunication Networks (ICETE'02), 2005.
• 6: Boi Faltings , Pearl Pu , Marc Torrens , Paolo Viappiani, Designing example-critiquing interaction, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964449]
• 7: Sonja Grabner-Kräuter , Ewald A. Kaluscha, Empirical research in on-line trust: a review and critical assessment, International Journal of Human-Computer Studies, v.58 n.6, p.783-812, June 2003 [doi>10.1016/S1071-5819(03)00043-0]
• 8: Jonathan L. Herlocker , Joseph A. Konstan , John Riedl, Explaining collaborative filtering recommendations, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.241-250, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358995]
• 9: David A. Klein , Edward H. Shortliffe, A framework for explaining decision-theoretic advice, Artificial Intelligence, v.67 n.2, p.201-243, June 1994 [doi>10.1016/0004-3702(94)90053-1]
• 10: McCarthy, K., Reilly, J., McGinty, L. and Smyth, B. Thinking positively -- explanatory feedback for conversational recommender systems. In Proceedings of the Workshop on Explanation in CBR at the Seventh European Conference on Case-Based Reasoning (ECCB'04), 2004, 115--124.
• 11: Kevin McCarthy , James Reilly , Lorraine McGinty , Barry Smyth, Experiments in dynamic critiquing, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040871]
• 12: McGinty, L. and Smyth, B. On the role of diversity in conversational recommender systems. In Proceedings of the Fifth International Conference on Case-Based Reasoning (ICCBR'03), 2003, 276--290.
• 13: McKnight, D.H., and Chervany, N.L. What trust means in e-commerce customer relationships: conceptual typology. International Journal of Electronic Commerce, 2002, 35--59.
• 14: McSherry, D. Similarity and compromise. In Proceedings of the International Conference on Case-Based Reasoning Research and Development (ICCBR'03), 2003, 291--305.
• 15: McSherry, D. Explanation in recommender systems. In Workshop Proceedings of the 7th European Conference on Case-Based Reasoning, 2004, 125--134.
• 16: John O'Donovan , Barry Smyth, Trust in recommender systems, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040870]
• 17: Price, B. and Messinger, P.R. Optimal recommendation sets: covering uncertainty over user preferences. In National Conference on Artificial Intelligence (AAAI'05), 2005.
• 18: Pearl Pu , Li Chen, Integrating tradeoff support in product search tools for e-commerce sites, Proceedings of the 6th ACM conference on Electronic commerce, p.269-278, June 05-08, 2005, Vancouver, BC, Canada [doi>10.1145/1064009.1064038]
• 19: Pearl Pu , Boi Faltings , Marc Torrens, Effective Interaction Principles for Online Product Search Environments, Proceedings of the Web Intelligence, IEEE/WIC/ACM International Conference on (WI'04), p.724-727, September 20-24, 2004 [doi>10.1109/WI.2004.59]
• 20: Pearl Huan Z. Pu , Pratyush Kumar, Evaluating example-based search tools, Proceedings of the 5th ACM conference on Electronic commerce, May 17-20, 2004, New York, NY, USA [doi>10.1145/988772.988804]
• 21: Hideo Shimazu, ExpertClerk: A Conversational Case-Based Reasoning Tool forDeveloping Salesclerk Agents in E-Commerce Webshops, Artificial Intelligence Review, v.18 n.3-4, p.223-244, December 2002 [doi>10.1023/A:1020757023711]
• 22: Rashmi Sinha , Kirsten Swearingen, The role of transparency in recommender systems, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506619]
• 23: Sørmo, F. and Aamodt, A. Knowledge communication and CBR. In Proceedings of the ECCBR-02 Workshop on Case-Based Reasoning for Education and Training, 2002, 47--59.
• 24: Cai-Nicolas Ziegler , Sean M. McNee , Joseph A. Konstan , Georg Lausen, Improving recommendation lists through topic diversification, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060754]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Software psychology
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI); Evaluation/methodology; User-centered design

General Terms:
Algorithms, Design, Experimentation, Human Factors

Keywords:
explanation interfaces, recommender agents, tradeoff assistance, trust building