CheckThat! at CLEF 2019: Automatic identification and verification of claims
Author | Elsayed, Tamer |
Author | Nakov, Preslav |
Author | Barrón-Cedeño, Alberto |
Author | Hasanain, Maram |
Author | Suwaileh, Reem |
Author | Da San Martino, Giovanni |
Author | Atanasova, Pepa |
Available date | 2024-03-11T06:03:06Z |
Publication Date | 2019 |
Publication Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
Resource | Scopus |
ISSN | 3029743 |
Abstract | We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F 1 for classification tasks. |
Language | en |
Publisher | Springer Verlag |
Subject | Information retrieval Automatic identification Classification tasks Cross-language evaluation forums Evaluation framework Political debates Automation |
Type | Conference Paper |
Pagination | 309-315 |
Volume Number | 11438 LNCS |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
-
Computer Science & Engineering [2402 items ]