Search
Now showing items 751-752 of 752
The many benefits of annotator rationales for relevance judgments
(
International Joint Conferences on Artificial Intelligence
, 2017 , Conference Paper)
When collecting subjective human ratings of items, it can be difficult to measure and enforce data quality due to task subjectivity and lack of insight into how judges arrive at each rating decision. To address this, we ...
Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments
(
AAAI Press
, 2016 , Conference Paper)
When collecting subjective human ratings of items, it can be difficult to measure and enforce data quality due to task subjectivity and lack of insight into how judges’ arrive at each rating decision. To address this, we ...