Home > Publications
Home University of Twente
Prospective Students
Intranet (internal)

EEMCS EPrints Service

15903 When is query performance prediction effective?
Home Policy Brochure Browse Search User Area Contact Help

Hauff, C. and Azzopardi, L. (2009) When is query performance prediction effective? In: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, 19-23 July 2009, Boston, MA, USA. pp. 830-831. ACM. ISBN 978-1-60558-483-6

Full text available as:

- Univ. of Twente only
278 Kb

Official URL:

Exported to Metis


The utility of Query Performance Prediction (QPP) methods is commonly evaluated by reporting correlation coefficients to denote how well the methods perform at predicting the retrieval performance of a set of queries. However, a quintessential question remains unexplored: how strong does the correlation need to be in order to realize an increase in retrieval performance? In this work, we address this question in the context of Selective Query Expansion (SQE) and perform a large-scale experiment. The results show that to consistently and predictably improve retrieval effectiveness in the ideal SQE setting, a Kendall's Tau correlation of tau>=0.5 is required, a threshold which most existing query performance prediction methods fail to reach.

Item Type:Conference or Workshop Paper (Extended Abstract, Poster)
Research Group:EWI-HMI: Human Media Interaction
Research Program:CTIT-NICE: Natural Interaction in Computer-mediated Environments
Research Project:MultimediaN/N5: Semantic access
ID Code:15903
Deposited On:31 August 2009
More Information:statisticsmetis

Export this item as:

To request a copy of the PDF please email us request copy

To correct this item please ask your editor

Repository Staff Only: edit this item