Overview of the CLEF-2021 CheckThat! Lab Task 1 on check-worthiness estimation in tweets and political debates
عرض / فتح
التاريخ
2021-09المؤلف
Shaar, ShadenHasanain, Maram
Hamdan, Bayan
Ali, Zien Sheikh
Haouari, Fatima
Nikolov, Alex
Kutlu, Mucahid
Kartal, Yavuz Selim
Alam, Firoj
da San Martino, Giovanni
Barrón-Cedeño, Alberto
Míguez, Rubén
Beltrán, Javier
Elsayed, Tamer
Nakov, Preslav
...show more authors ...show less authors
البيانات الوصفية
عرض كامل للتسجيلةالملخص
We present an overview of Task 1 of the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The task asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics in five languages: Arabic, Bulgarian, English, Spanish, and Turkish. A total of 15 teams participated in this task and most submissions managed to achieve sizable improvements over the baselines using Transformer-based models such as BERT and RoBERTa. Here, we describe the process of data collection and the task setup, including the evaluation measures, and we give a brief overview of the participating systems. We release to the research community all datasets from the lab as well as the evaluation scripts, which should enable further research in check-worthiness estimation for tweets and political debates.
معرّف المصادر الموحد
https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85113440372&origin=inwardDOI/handle
http://hdl.handle.net/10576/52030المجموعات
- علوم وهندسة الحاسب [2201 items ]
وثائق ذات صلة
عرض الوثائق المتصلة بواسطة: العنوان، المؤلف، المنشئ والموضوع.
-
Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media
Barrón-Cedeño, Alberto; Elsayed, Tamer; Nakov, Preslav; Da San Martino, Giovanni; Hasanain, Maram; Suwaileh, Reem; Haouari, Fatima; Babulkov, Nikolay; Hamdan, Bayan; Nikolov, Alex; Shaar, Shaden; Ali, Zien Sheikh... more authors ... less authors ( Springer Science and Business Media Deutschland GmbH , 2020 , Conference Paper)We present an overview of the third edition of the CheckThat! Lab at CLEF 2020. The lab featured five tasks in two different languages: English and Arabic. The first four tasks compose the full pipeline of claim verification ... -
Overview of CheckThat! 2020 English: Automatic Identification and Verification of Claims in Social Media
Shaar, Shaden; Nikolov, Alex; Babulkov, Nikolay; Alam, Firoj; Barrón-Cedeño, Alberto; Elsayed, Tamer; Hasanain, Maram; Suwaileh, Reem; Haouari, Fatima; da San Martino, Giovanni; Nakov, Preslav... more authors ... less authors ( CEUR-WS , 2020 , Conference Paper)We present an overview of the third edition of the CheckThat! Lab at CLEF 2020. The lab featured five tasks in Arabic and English, and here we focus on the three English tasks. Task 1 challenged the participants to predict ... -
BigIR at CLEF 2018: Detection and verification of check-worthy political claims
Yasser K.; Kutlu M.; Elsayed T. ( CEUR-WS , 2018 , Conference Paper)With the enormous amount of misinformation spread over the Internet, manual fact-checking is no longer feasible to prevent its negative impact. There is an urgent need for automated systems that can make fact-checking ...