Modeling multi-step relevance propagation for expert finding

ABSTRACT

An expert finding system allows a user to type a simple text query and retrieve names and contact information of individuals that possess the expertise expressed in the query. This paper proposes a novel approach to expert finding in large enterprises or intranets by modeling candidate experts (persons), web documents and various relations among them with so-called expertise graphs. As distinct from the state of-the-art approaches estimating personal expertise through one-step propagation of relevance probability from documents to the related candidates, our methods are based on the principle of multi-step relevance propagation in topic specific expertise graphs. We model the process of expert finding by probabilistic random walks of three kinds: finite, infinite and absorbing. Experiments on TREC Enterprise Track data originating from two large organizations show that our methods using multi-step relevance propagation improve over the baseline one-step propagation based method in almost all cases.

REFERENCES

• 1: IBM Professional Marketplace matches consultants with clients. White paper. November 2006.
• 2: Enterprise search from Microsoft: Empower people to find information and expertise. White paper. Microsoft, January 2007.
• 3: Mark S. Ackerman , Volker Wulf , Volkmar Pipek, Sharing Expertise: Beyond Knowledge Management, MIT Press, Cambridge, MA, 2002
• 4: Eugene Agichtein , Carlos Castillo , Debora Donato , Aristides Gionis , Gilad Mishne, Finding high-quality content in social media, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA [doi>10.1145/1341531.1341557]
• 5: Krisztian Balog , Leif Azzopardi , Maarten de Rijke, Formal models for expert finding in enterprise corpora, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148181]
• 6: Krisztian Balog , Toine Bogers , Leif Azzopardi , Maarten de Rijke , Antal van den Bosch, Broad expertise retrieval in sparse data environments, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277836]
• 7: Krisztian Balog , Maarten de Rijke, Finding experts and their eetails in e-mail corpora, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1136002]
• 8: I. Becerra-Fernandez. Facilitating the online search of experts at NASA using expert seeker people-finder. In PAKM'00, Third International Conference on Practical Aspects of Knowledge Management, 2000.
• 9: Mikhail Bilenko , Ryen W. White, Mining the search trails of surfing crowds: identifying relevant websites from user activity, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China [doi>10.1145/1367497.1367505]
• 10: Christopher S. Campbell , Paul P. Maglio , Alex Cozzi , Byron Dom, Expertise identification using email communications, Proceedings of the twelfth international conference on Information and knowledge management, November 03-08, 2003, New Orleans, LA, USA [doi>10.1145/956863.956965]
• 11: Y. Cao, J. Liu, S. Bao, and H. Li. Research on expert search at enterprise track of trec 2005. In Proceedings of 14th Text Retrieval Conference (TREC 2005), 2005.
• 12: H. Chen, H. Shen, J. Xiong, S. Tan, and X. Cheng. Social Network Structure behind the Mailing Lists: ICT-IIIS at TREC 2006 Expert Finding Track. In Proceeddings of the 15th Text REtrieval Conference (TREC 2006), 2006.
• 13: Kevyn Collins-Thompson , Jamie Callan, Query expansion using random walk models, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099727]
• 14: N. Craswell, A. de Vries, and I. Soboroff. Overview of the trec-2005 enterprise track. In Proceedings of TREC-2005, Gaithersburg, USA, 2005.
• 15: N. Craswell, D. Hawking, A.-M. Vercoustre, and P. Wilkins. Panoptic expert: Searching for experts not just for documents. In Ausweb Poster Proceedings, Queensland, Australia, 2001.
• 16: Nick Craswell , Martin Szummer, Random walks on the click graph, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277784]
• 17: F. Crestani, Application of Spreading Activation Techniques in InformationRetrieval, Artificial Intelligence Review, v.11 n.6, p.453-482, Dec. 1997 [doi>10.1023/A:1006569829653]
• 18: T. Davenport. Knowledge Management at Microsoft. White paper. 1997.
• 19: T. Davenport. Ten principles of knowledge management and four case studies. Knowledge and Process Management, 4(3), 1998.
• 20: L. Fields. 3 great databases for finding experts. The Expert Advisor, (3), March 2007.
• 21: Sanda Harabagiu , Finley Lacatusu , Andrew Hickl, Answering complex questions with random walk models, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148211]
• 22: David Hawking, Challenges in enterprise search, Proceedings of the 15th Australasian database conference, p.15-24, January 01, 2004, Dunedin, New Zealand
• 23: D. Hiemstra. Using Language Models for Information Retrieval. Phd thesis, University of Twente, 2001.
• 24: D. Hiemstra, H. Rode, R. van Os, and J. Flokstra. Pftijah: text search in an xml database system. In Proceedings of the 2nd International Workshop on Open Source Information Retrieval (OSIR), pages 12--17, August 2006.
• 25: M. Idinopulos and L. Kempler. Do you know who your experts are? The McKinsey Quarterly, (4), 2003.
• 26: Glen Jeh , Jennifer Widom, Scaling personalized web search, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775191]
• 27: Pawel Jurczyk , Eugene Agichtein, Discovering authorities in question answer communities by using link analysis, Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10, 2007, Lisbon, Portugal [doi>10.1145/1321440.1321575]
• 28: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM (JACM), v.46 n.5, p.604-632, Sept. 1999 [doi>10.1145/324133.324140]
• 29: Oren Kurland , Lillian Lee, Respect my authority!: HITS without hyperlinks, utilizing cluster-based language models, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148188]
• 30: John Lafferty , Chengxiang Zhai, Document language models, query models, and risk minimization for information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.111-119, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383970]
• 31: R. Lempel , S. Moran, SALSA: the stochastic approach for link-structure analysis, ACM Transactions on Information Systems (TOIS), v.19 n.2, p.131-160, April 2001 [doi>10.1145/382979.383041]
• 32: Xiaoyong Liu , W. Bruce Croft , Matthew Koll, Finding experts in community-based question-answering services, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099644]
• 33: W. Lu, S. Robertson, A. Macfarlane, and H. Zhao. Window-based Enterprise Expert Search. In Proceeddings of the 15th Text REtrieval Conference (TREC 2006), 2006.
• 34: Craig Macdonald , Iadh Ounis, Voting for candidates: adapting data fusion techniques for an expert search task, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA [doi>10.1145/1183614.1183671]
• 35: M. T. Maybury. Expert finding systems. Technical Report MTR06B000040, MITRE Corporation, 2006.
• 36: Marc A. Najork , Hugo Zaragoza , Michael J. Taylor, Hits on the web: how does it compare?, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277823]
• 37: Andrew Y. Ng , Alice X. Zheng , Michael I. Jordan, Stable algorithms for link analysis, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.258-266, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384003]
• 38: L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical report, Stanford University, 1998.
• 39: Desislava Petkova , W. Bruce Croft, Proximity-based document representation for named entity retrieval, Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10, 2007, Lisbon, Portugal [doi>10.1145/1321440.1321542]
• 40: M. Richardson and P. Domingos. The intelligent surfer: Probabilistic combination of link and content information in pagerank. In NIPS '01: Advances in Neural Information Processing Systems, 2001.
• 41: P. Serdyukov and D. Hiemsta. Being omnipresent to be almighty: The importance of the global web evidence for organizational expert finding. In In FCHER'08: Proceedings of the SIGIR'08 Workshop on Future Challenges in Expertise Retrieval, 2008.
• 42: P. Serdyukov and D. Hiemstra. Modeling documents as mixtures of persons for expert finding. In ECIR, pages 309--320, 2008.
• 43: Pavel Serdyukov , Djoerd Hiemstra , Maarten Fokkinga , Peter M. G. Apers, Generative modeling of persons and documents for expert search, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277929]
• 44: Pavel Serdyukov , Henning Rode , Djoerd Hiemstra, Exploiting sequential dependencies for expert finding, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390508]
• 45: Pavel Serdyukov , Henning Rode , Djoerd Hiemstra, Modeling expert finding as an absorbing random walk, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390509]
• 46: Azadeh Shakery , ChengXiang Zhai, A probabilistic relevance propagation model for hypertext retrieval, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA [doi>10.1145/1183614.1183693]
• 47: Xiaodan Song , Belle L. Tseng , Ching-Yung Lin , Ming-Ting Sun, Personalized recommendation driven by information flow, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148258]
• 48: Kristina Toutanova , Christopher D. Manning , Andrew Y. Ng, Learning random walk models for inducing word dependency distributions, Proceedings of the twenty-first international conference on Machine learning, p.103, July 04-08, 2004, Banff, Alberta, Canada [doi>10.1145/1015330.1015442]
• 49: T. Tsikrika, P. Serdyukov, H. Rode, T. Westerveld, R. Aly, D. Hiemstra, and A. de Vries. Structured Document Retrieval, Multimedia Retrieval, and Entity Ranking using PF/Tijah. In INEX 2007, 2007.
• 50: Hugo Zaragoza , Henning Rode , Peter Mika , Jordi Atserias , Massimiliano Ciaramita , Giuseppe Attardi, Ranking very many typed entities on wikipedia, Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10, 2007, Lisbon, Portugal [doi>10.1145/1321440.1321599]
• 51: Jun Zhang , Mark S. Ackerman , Lada Adamic, Expertise networks in online communities: structure and algorithms, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242603]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Experimentation, Measurement, Performance

Keywords:
enterprise search, expert finding, expertise, language models, markov processes, random walks