Expert recommender systems in practice: evaluating semi-automatic profile generation

ABSTRACT

Expert recommender systems (ERS) are considered a promising technology in knowledge management. However, there are very few studies which evaluated their appropriation in practice. In this paper, we present results of a case study of expert recommender technology in a large European industrial association. Unlike existing expert recommender approaches, the system involves users in selecting textual documents for semi-automatic profile generation. Our study focuses on the appropriation of this functionality and discusses impacts from an organizational perspective.

REFERENCES

• 1: M. S. Ackerman , T. W. Malone, Answer Garden: a tool for growing organizational memory, Proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on Office information systems, p.31-39, April 25-27, 1990, Cambridge, Massachusetts, United States
• 2: Mark S. Ackerman , Volker Wulf , Volkmar Pipek, Sharing Expertise: Beyond Knowledge Management, MIT Press, Cambridge, MA, 2002
• 3: Agostini, A., Albolino, S, De Paoli, F, Grasso, A. M,. Hinrichs, E. Supporting Communities by Providing Multiple Views, in: Proceedings of Communities and Technologies, Kluwer 2005, pp. 437--456
• 4: Liam J. Bannon , Kari Kuutti, Shifting Perspectives on Organizational Memory: From Storage to Active Remembering, Proceedings of the 29th Hawaii International Conference on System Sciences Volume 3: Collaboration Systems and Technology, p.156, January 03-06, 1996
• 5: Erin Bradner , Wendy A. Kellogg , Thomas Erickson, The adoption and use of “BABBLE”: a field study of chat in the workplace, Proceedings of the Sixth European conference on Computer supported cooperative work, p.139-158, August 1999, Copenghagen, Denmark
• 6: Cohen, D.; Prusak, L. In Good Company: How Social Capital makes Organizations Work, Harvard Business School Press, Boston 2001
• 7: Deerwester, S., Dumais, S., Furnas G., Landauer, T. and Harshman, R. Indexing by Latent Semantic Analysis. Journal of the American Society of Information Science, Vol. 41, No. 6, 1990, pp. 391--407
• 8: Kate Ehrlich , N. Sadat Shami, Searching for expertise, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357224]
• 9: Leonard N. Foner, Yenta: a multi-agent, referral-based matchmaking system, Proceedings of the first international conference on Autonomous agents, p.301-307, February 05-08, 1997, Marina del Rey, California, United States [doi>10.1145/267658.267732]
• 10: Kristina Groth , John Bowers, On finding things out: situating organisational knowledge in CSCW, Proceedings of the seventh conference on European Conference on Computer Supported Cooperative Work, p.279-298, September 16-20, 2001, Bonn, Germany
• 11: Marlene Huysman , Dirk de Wit, Knowledge Sharing in Practice, Kluwer Academic Publishers, Norwell, MA, 2002
• 12: Huysman, M., Wulf, V. IT to Support Knowledge Sharing in Communities: Towards a Social Capital Analysis, in: Journal on Information Technology (JIT), No. 1, Vol. 21, (2006), pp. 40--51
• 13: Henry Kautz , Bart Selman , Mehul Shah, Referral Web: combining social networks and collaborative filtering, Communications of the ACM, v.40 n.3, p.63-65, March 1997 [doi>10.1145/245108.245123]
• 14: Lindgren, R., Henfriedsson, O., Schultze, U. Design Principles for Competence Management Systems: A Synthesis of an Action Research Study. In: MIS Quaterly, Vol. 28, 2004, pp. 435--427
• 15: Maybury, M.; D'Amore, R.; House, D. Automated Discovery and Mapping of Expertise, in Ackerman, M.; Pipek, V.; Wulf, V. (eds): Expertise Sharing: Beyond Knowledge Management, MIT-Press, 2002, pp. 359--382
• 16: Robert McArthur , Peter Bruza, Discovery of implicit and explicit connections between people using email utterance, Proceedings of the eighth conference on European Conference on Computer Supported Cooperative Work, p.21-40, September 14-18, 2003, Helsinki, Finland
• 17: David Wright Mcdonald , Mark S. Ackerman, Supporting nuance in groupware design: moving from naturalistic expertise location to expertise recommendation, University of California, Irvine, 2000
• 18: Wanda J. Orlikowski, Evolving the notes: organizational change around groupware technology, Groupware and teamwork: invisible aid or technical hindrance?, John Wiley & Sons, Inc., New York, NY, 1997
• 19: W. Pohs , G. Pinder , C. Dougherty , M. White, The Lotus Knowledge Discovery System: tools and experiences, IBM Systems Journal, v.40 n.4, p.956-966, October 2001
• 20: Polanyi, M. Implizites Wissen, 1. Auflage. Frankfurt am Main: Suhrkamp Taschenbuch Verlag, 1985
• 21: Tim Reichling , Michael Veith, Expertise sharing in a heterogeneous organizational environment, Proceedings of the ninth conference on European Conference on Computer Supported Cooperative Work, p.325-345, September 18-22, 2005, Paris, France
• 22: Tim Reichling , Michael Veith , Volker Wulf, Expert Recommender: Designing for a Network Organization, Computer Supported Cooperative Work, v.16 n.4-5, p.431-465, October 2007 [doi>10.1007/s10606-007-9055-2]
• 23: N. Sadat Shami , Kate Ehrlich , David R. Millen, Pick me!: link selection in expertise search results, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357223]
• 24: Vladimir Soroka , Michal Jacovi, The diffusion of reachOut: analysis and framework for the successful diffusion of collaboration technologies, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031658]
• 25: Streeter, L. A.; Lochbaum, K. A. An expert/expert location system based on an automatic representation of semantic structure, in Proceedings of the 4th Conference on Artificial Intelligence Applications, San Diego, 1988, ACM-Press, New York, 1988, pp. 345--350
• 26: Susman, G., Evered, R. An assessment of the scientific merits of action research, Administrative Science Quarterly, 23, 1978, pp. 582--603.
• 27: Adriana Vivacqua , Henry Lieberman, Agents to assist in finding help, Proceedings of the SIGCHI conference on Human factors in computing systems, p.65-72, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332408]
• 28: Wenger, E. Communities of Practice, Cambridge University Press, Cambridge1998
• 29: Volker Wulf , Markus Rohde, Towards an integrated organization and technology development, Proceedings of the 1st conference on Designing interactive systems: processes, practices, methods, & techniques, p.55-64, August 23-25, 1995, Ann Arbor, Michigan, United States [doi>10.1145/225434.225441]
• 30: Jun Zhang , Mark S. Ackerman , Lada Adamic, Expertise networks in online communities: structure and algorithms, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242603]

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES
      Subjects: Sociology

General Terms:
Design, Human Factors, Performance

Keywords:
expertise recommender system, knowledge management, second wave