Formal models for expert finding in enterprise corpora

ABSTRACT

Searching an organization's document repositories for experts provides a cost effective solution for the task of expert finding. We present two general strategies to expert searching given a document collection which are formalized using generative probabilistic models. The first of these directly models an expert's knowledge based on the documents that they are associated with, whilst the second locates documents on topic, and then finds the associated expert. Forming reliable associations is crucial to the performance of expert finding systems. Consequently, in our evaluation we compare the different approaches, exploring a variety of associations along with other operational parameters (such as topicality). Using the TREC Enterprise corpora, we show that the second strategy consistently outperforms the first. A comparison against other unsupervised techniques, reveals that our second model delivers excellent performance.

REFERENCES

• 1: Christopher S. Campbell , Paul P. Maglio , Alex Cozzi , Byron Dom, Expertise identification using email communications, Proceedings of the twelfth international conference on Information and knowledge management, November 03-08, 2003, New Orleans, LA, USA [doi>10.1145/956863.956965]
• 2: N. Craswell, D. Hawking, A. M. Vercoustre, and P. Wilkins. P@noptic expert: Searching for experts not just for documents. In Ausweb, 2001. URL: http://es.csiro.au/pubs/craswell_ausweb01.pdf.
• 3: N. Craswell, A. de Vries, and I. Soboroff. Overview of the trec-2005 enterprise track. TREC 2005 Conference Notebook, pages 199--205, 2005.
• 4: Raymond D'Amore, Expertise community detection, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009089]
• 5: Thomas H. Davenport , Lawrence Prusak , Laurence Prusak, Working Knowledge: How Organizations Manage What They Know, Harvard Business School Press, Boston, MA, 1997
• 6: Fumio Hattori , Takeshi Ohguro , Makoto Yokoo , Shigeo Matsubara , Sen Yoshida, Socialware: multiagent systems for supporting network communities, Communications of the ACM, v.42 n.3, p.55-ff., March 1999 [doi>10.1145/295685.295701]
• 7: David Hawking, Challenges in enterprise search, Proceedings of the 15th Australasian database conference, p.15-24, January 01, 2004, Dunedin, New Zealand
• 8: Morten Hertzum , Annelise Mark Pejtersen, The information-seeking practices of engineers: searching for documents as well as for people, Information Processing and Management: an International Journal, v.36 n.5, p.761-778, Sept. 2000 [doi>10.1016/S0306-4573(00)00011-X]
• 9: D. Hiemstra. Using Language Models for Information Retrieval. PhD thesis, University of Twente, 2001.
• 10: H. Kautz, B. Selman, and A. Milewski. Agent amplified communication. In Proceedings of the Thirteenth National Conference on Artificial Intelligence (AAAI-96), pages 3--9, 1996.
• 11: M Maron , S Curry , P Thompson, An inductive search system: Theory, design, and implementation, IEEE Transactions on Systems, Man and Cybernetics, v.16 n.1, p.21-28, Jan./Feb. 1986 [doi>10.1109/TSMC.1986.289278]
• 12: David W. McDonald , Mark S. Ackerman, Expertise recommender: a flexible recommendation system and architecture, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.231-240, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358994]
• 13: David R. H. Miller , Tim Leek , Richard M. Schwartz, A hidden Markov model information retrieval system, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.214-221, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312680]
• 14: Audris Mockus , James D. Herbsleb, Expertise browser: a quantitative approach to identifying expertise, Proceedings of the 24th International Conference on Software Engineering, May 19-25, 2002, Orlando, Florida [doi>10.1145/581339.581401]
• 15: Jay M. Ponte , W. Bruce Croft, A language modeling approach to information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.275-281, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291008]
• 16: Mark Sanderson , Justin Zobel, Information retrieval system evaluation: effort, sensitivity, and reliability, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076064]
• 17: TREC. Enterprise track, 2005. URL: http://www.ins.cwi.nl/projects/trec-ent/wiki/.
• 18: W3C. The W3C test collection, 2005. URL: http://research.microsoft.com/users/nickcr/w3c-summary.html.
• 19: D. Yimam. Expert finding systems for organizations: Domain analysis and the demoir approach. In ECSCW 999 Workshop: Beyond KNowledge Management: Managing Expertise, pages 276--283, New York, NY, USA, 1996. ACM Press.
• 20: D. Yimam-Seid and A. Kobsa. Expert finding systems for organizations: Problem and domain analysis and the demoir approach. Journal of Organizational Computing and Electronic Commerce, 13(1): 1--24, 2003.
• 21: Chengxiang Zhai , John Lafferty, A study of smoothing methods for language models applied to Ad Hoc information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.334-342, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384019]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
      H.3.3 Information Search and Retrieval
      H.3.4 Systems and Software
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.2 Types of Systems
      H.4.m Miscellaneous

General Terms:
Algorithms, Experimentation, Measurement, Performance

Keywords:
enterprise search, expert finding