Show simple item record

AuthorShaar, Shaden
AuthorHasanain, Maram
AuthorHamdan, Bayan
AuthorAli, Zien Sheikh
AuthorHaouari, Fatima
AuthorNikolov, Alex
AuthorKutlu, Mucahid
AuthorKartal, Yavuz Selim
AuthorAlam, Firoj
Authorda San Martino, Giovanni
AuthorBarrón-Cedeño, Alberto
AuthorMíguez, Rubén
AuthorBeltrán, Javier
AuthorElsayed, Tamer
AuthorNakov, Preslav
Available date2024-02-21T10:27:45Z
Publication Date2021-09
Publication NameCEUR Workshop Proceedings
CitationShaar, S., Hasanain, M., Hamdan, B., Ali, Z. S., Haouari, F., Nikolov, A., ... & Nakov, P. (2021, September). Overview of the CLEF-2021 CheckThat! Lab Task 1 on Check-Worthiness Estimation in Tweets and Political Debates. In CLEF (Working Notes) (pp. 369-392).
ISSN1613-0073
URIhttps://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85113440372&origin=inward
URIhttp://hdl.handle.net/10576/52030
AbstractWe present an overview of Task 1 of the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The task asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics in five languages: Arabic, Bulgarian, English, Spanish, and Turkish. A total of 15 teams participated in this task and most submissions managed to achieve sizable improvements over the baselines using Transformer-based models such as BERT and RoBERTa. Here, we describe the process of data collection and the task setup, including the evaluation measures, and we give a brief overview of the participating systems. We release to the research community all datasets from the lab as well as the evaluation scripts, which should enable further research in check-worthiness estimation for tweets and political debates.
Sponsor- NPRP grant #NPRP-11S-1204-170060 from the Qatar National Research Fund (a member of Qatar Foundation). - GSRA grant #GSRA6-1-0611-19074 from the Qatar National Research Fund.
Languageen
PublisherCEUR-WS
SubjectCheck-worthiness estimation
Computational journalism
COVID-19
Detecting previously fact-checked claims
Fact-checking
Social media verification
Veracity
Verified claims retrieval
TitleOverview of the CLEF-2021 CheckThat! Lab Task 1 on check-worthiness estimation in tweets and political debates
TypeConference Paper
Pagination369-392
Volume Number2936
dc.accessType Full Text


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record