EEMCS

Home > Publications
Home University of Twente
Education
Research
Prospective Students
Jobs
Publications
Intranet (internal)
 
 Nederlands
 Contact
 Search
 Organisation

EEMCS EPrints Service


15903 When is query performance prediction effective?
Home Policy Brochure Browse Search User Area Contact Help

Hauff, C. and Azzopardi, L. (2009) When is query performance prediction effective? In: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, 19-23 July 2009, Boston, MA, USA. pp. 830-831. ACM. ISBN 978-1-60558-483-6

Full text available as:

PDF
- Univ. of Twente only
278 Kb

Official URL: http://dx.doi.org/10.1145/1571941.1572150

Exported to Metis

Abstract

The utility of Query Performance Prediction (QPP) methods is commonly evaluated by reporting correlation coefficients to denote how well the methods perform at predicting the retrieval performance of a set of queries. However, a quintessential question remains unexplored: how strong does the correlation need to be in order to realize an increase in retrieval performance? In this work, we address this question in the context of Selective Query Expansion (SQE) and perform a large-scale experiment. The results show that to consistently and predictably improve retrieval effectiveness in the ideal SQE setting, a Kendall's Tau correlation of tau>=0.5 is required, a threshold which most existing query performance prediction methods fail to reach.

Item Type:Conference or Workshop Paper (Extended Abstract, Poster)
Research Group:EWI-HMI: Human Media Interaction
Research Program:CTIT-NICE: Natural Interaction in Computer-mediated Environments
Research Project:MultimediaN/N5: Semantic access
ID Code:15903
Status:Published
Deposited On:31 August 2009
Refereed:Yes
International:Yes
More Information:statisticsmetis

Export this item as:

To request a copy of the PDF please email us request copy

To correct this item please ask your editor

Repository Staff Only: edit this item