Comparing metrics across TREC and NTCIR:

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Comparing metrics across TREC and NTCIR:: the robustness to pool depth bias

Full text

Pdf (108 KB)

Source

Annual ACM Conference on Research and Development in Information Retrieval archive
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval table of contents

Singapore, Singapore

POSTER SESSION: Posters group 1: evaluation, text collections and user/personalized IR table of contents

Pages 691-692

Year of Publication: 2008

ISBN:978-1-60558-164-4

Author

Tetsuya Sakai

NewsWatch, Inc., Tokyo, Japan

Sponsors

ACM: Association for Computing Machinery
SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 18, Downloads (12 Months): 158, Citation Count: 3

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1390334.1390454 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Chris Buckley , Ellen M. Voorhees, Retrieval evaluation with incomplete information, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009000]
	2	Kalervo Järvelin , Jaana Kekäläinen, Cumulated gain-based evaluation of IR techniques, ACM Transactions on Information Systems (TOIS), v.20 n.4, p.422-446, October 2002 [doi>10.1145/582415.582418]
	3	Moffat, A. and Zobel, J.:Rank-Biased Precision for Measurement of Retrieval Effectiveness, ACM TOIS, under review, 2008.
	4	Tetsuya Sakai, Evaluating evaluation metrics based on the bootstrap, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148261]
	5	Sakai, T.:Comparing Metrics across TREC and NTCIR:The Robustness to System Bias, Information Processing Society of Japan SIGTechnical Reports, 2008-FI-91, to appear, 2008.
	6	Tetsuya Sakai , Noriko Kando, On information retrieval metrics designed for evaluation with incomplete relevance assessments, Information Retrieval, v.11 n.5, p.447-470, October 2008 [doi>10.1007/s10791-008-9059-7]
	7	Emine Yilmaz , Javed A. Aslam, Estimating average precision with incomplete and imperfect judgments, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA [doi>10.1145/1183614.1183633]
	8	Justin Zobel, How reliable are the results of large-scale information retrieval experiments?, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.307-314, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291014]

CITED BY 3

	Tetsuya Sakai, Comparing metrics across TREC and NTCIR: the robustness to system bias, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA
	Tetsuya Sakai , Noriko Kando, On information retrieval metrics designed for evaluation with incomplete relevance assessments, Information Retrieval, v.11 n.5, p.447-470, October 2008
	Tetsuya Sakai , Noriko Kando, On information retrieval metrics designed for evaluation with incomplete relevance assessments, Information Retrieval, v.11 n.5, p.447-470, October 2008