Enhancing digital libraries with TechLens+

ABSTRACT

The number of research papers available is growing at a staggering rate. Researchers need tools to help them find the papers they should read among all the papers published each year. In this paper, we present and experiment with hybrid recommender algorithms that combine Collaborative Filtering and Content-based. Filtering to recommend research papers to users. Our hybrid algorithms combine the strengths of each filtering approach to address their individual weaknesses. We evaluated our algorithms through offline experiments on a database of 102, 000 research papers, and through an online experiment with 110 users. For both experiments we used a dataset created from the CiteSeer repository of computer science research papers. We developed separate English and Portuguese versions of the interface and specifically recruited American and Brazilian users to test for cross-cultural effects. Our results show that users value paper recommendations, that the hybrid algorithms can be successfully combined, that different algorithms are more suitable for recommending different kinds of papers, and that users with different levels of experience perceive recommendations differently These results can be applied to develop recommender systems for other types of digital libraries.

REFERENCES

• 1: ACM Digital Library, http://www.acm.org/dl, 2004.
• 2: Marko Balabanović , Yoav Shoham, Fab: content-based, collaborative recommendation, Communications of the ACM, v.40 n.3, p.66-72, March 1997 [doi>10.1145/245108.245124]
• 3: Kurt D. Bollacker , Steve Lawrence , C. Lee Giles, A system for automatic personalized tracking of scientific literature on the Web, Proceedings of the fourth ACM conference on Digital libraries, p.105-113, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313270]
• 4: Breese, J., D. Heckerman, and C. Kadie. Empirical Analysis of Predictive Algorithms for Collaborative Filtering. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI 98), Madison, WI, 1998, pp. 43--52.
• 5: Robin Burke, Hybrid Recommender Systems: Survey and Experiments, User Modeling and User-Adapted Interaction, v.12 n.4, p.331-370, November 2002 [doi>10.1023/A:1021240730564]
• 6: Claypool, M., A. Gokhale, T. Miranda, P. Murnikov, D. Netes, and M. Sartin. Combining Content--Based and Collaborative Filters in an Online Newspaper. ACM SIGIR '99 Workshop on Recommender Systems, Berkeley, CA, 1999.
• 7: Paul Cotter , Barry Smyth, PTV: Intelligent Personalised TV Guides, Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, p.957-964, July 30-August 03, 2000
• 8: eBizSearch, http://gunther.smeal.psu.edu/, 2004.
• 9: Google, http://www.google.com/, 2004.
• 10: Jonathan L. Herlocker , Joseph A. Konstan , Al Borchers , John Riedl, An algorithmic framework for performing collaborative filtering, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.230-237, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312682]
• 11: Krishna Bharat , Tomonari Kamba , Michael Albers, Personalized, interactive news on the Web, Multimedia Systems, v.6 n.5, p.349-358, sept. 1998 [doi>10.1007/s005300050098]
• 12: Karypis, G., SUGGEST Top-N Recommendation Engine, http://www.cs.umn.edu/.karypis/suggest/, 2000.
• 13: LANL (arXiv) e-Print Archive, http://arxiv.org/, 2004.
• 14: Lawrence, S., Access to Scientific literature. The Nature Yearbook of Science and Technology, 420(19), 2001, p. 86--88.
• 15: McCallum, A. K., Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering, http://www-2.cs.cmu.edu/mccallum/bow/, 1996.
• 16: Sean M. McNee , Istvan Albert , Dan Cosley , Prateep Gopalkrishnan , Shyong K. Lam , Al Mamunur Rashid , Joseph A. Konstan , John Riedl, On the recommending of citations for research papers, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587096]
• 17: Melville, P., R. J. Mooney, and R. Nagarajan. Content-Boosted Collaborative Filtering. ACM SIGIR 2001 Workshop on Recommender Systems, New Orleans, LA, 2001.
• 18: NSF, N.S.F. Academic Research and Development. 1999.
• 19: New-Zealand Digital Library, http://www.sadl.uleth.ca/nz/cgi-bin/library, 2004.
• 20: Penn State University, CiteSeer.IST, http://citeseer.ist.psu.edu/, 2004.
• 21: Paul Resnick , Neophytos Iacovou , Mitesh Suchak , Peter Bergstrom , John Riedl, GroupLens: an open architecture for collaborative filtering of netnews, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.175-186, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.192905]
• 22: Gerard Salton , Christopher Buckley, Term-weighting approaches in automatic text retrieval, Information Processing and Management: an International Journal, v.24 n.5, p.513-523, 1988 [doi>10.1016/0306-4573(88)90021-0]
• 23: Upendra Shardanand , Pattie Maes, Social information filtering: algorithms for automating “word of mouth”, Proceedings of the SIGCHI conference on Human factors in computing systems, p.210-217, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223931]
• 24: Allison Woodruff , Rich Gossweiler , James Pitkow , Ed H. Chi , Stuart K. Card, Enhancing a digital book with a reading recommender, Proceedings of the SIGCHI conference on Human factors in computing systems, p.153-160, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332419]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process; Information filtering
      H.3.7 Digital Libraries
          Subjects: User issues; Systems issues

General Terms:
Algorithms, Experimentation, Human Factors

Keywords:
collaborative filtering, content-based filtering, digital libraries, hybrid recommender systems