Browsing by Author "Lease M."
Now showing items 1-2 of 2
-
Intelligent topic selection for low-cost information retrieval evaluation: A New perspective on deep vs. shallow judging
Kutlu M.; Elsayed T.; Lease M. ( Elsevier Ltd , 2018 , Article)While test collections provide the cornerstone for Cranfield-based evaluation of information retrieval (IR) systems, it has become practically infeasible to rely on traditional pooling techniques to construct test collections ... -
When rank order isn't enough: New statistical-significance-aware correlation measures
Kutlu M.; Elsayed T.; Hasanain M.; Lease M. ( Association for Computing Machinery , 2018 , Conference Paper)Because it is expensive to construct test collections for Cranfield-based evaluation of information retrieval systems, a variety of lower-cost methods have been proposed. The reliability of these methods is often validated ...