Show simple item record

AuthorHasanain, Maram
AuthorHaouari, Fatima
AuthorSuwaileh, Reem
AuthorAli, Zien Sheikh
AuthorHamdan, Bayan
AuthorElsayed, Tamer
AuthorBarrón-Cedeño, Alberto
Authorda San Martino, Giovanni
AuthorNakov, Preslav
Available date2024-03-11T06:03:07Z
Publication Date2020
Publication NameCEUR Workshop Proceedings
ResourceScopus
ISSN16130073
URIhttp://hdl.handle.net/10576/52852
URIhttps://ceur-ws.org/Vol-2696/paper_257.pdf
AbstractIn this paper, we present an overview of the Arabic tasks of the third edition of the CheckThat! Lab at CLEF 2020. The lab featured three Arabic tasks over social media (and the Web): Task 1 on check-worthiness estimation, Task 3 on evidence retrieval, and Task 4 on claim verification. For evaluation, we collected a dataset of Arabic tweets and Web pages consisting of 7.5K tweets and 14,742 Web pages. The systems in the ranking tasks (Task 1 and Task 3) were evaluated using precision at 30 (P@30) and precision at 10 (P@10), respectively. F1 was the official evaluation measure for Task 4. Eight teams submitted runs to the Arabic tasks, which is double the number of teams participating in the Arabic tasks of the CheckThat! lab at CLEF 2019. The most successful approach to Task 1 used an Arabic pre-trained language model, while text similarity measures and linguistic features were used in the other tasks. We release to the research community all datasets from the lab, which should enable further research on automatic claim verification in Arabic social media.
SponsorThis work was made possible in part by NPRP grant# NPRP11S-1204-170060 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibility of the authors. The work of Reem Suwaileh was supported by GSRA grant# GSRA5-1-0527-18082 from the Qatar National Research Fund and the work of Fatima Haouari was supported by GSRA grant# GSRA6-1-0611-19074 from the Qatar National Research Fund.
Languageen
PublisherCEUR-WS
SubjectAutomation
Linguistics
Social networking (online)
Automatic identification
Automatic verification
Evaluation measures
Language model
Linguistic features
Similarity measure
Social media
Text similarity
Web tasks
Web-page
Laboratories
TitleOverview of CheckThat! 2020 Arabic: Automatic Identification and Verification of Claims in Social Media
TypeConference Paper
Volume Number2696
dc.accessType Abstract Only


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record