Show simple item record

AuthorNakov, Preslav
AuthorDa San Martino, Giovanni
AuthorElsayed, Tamer
AuthorBarrón-Cedeño, Alberto
AuthorMíguez, Rubén
AuthorShaar, Shaden
AuthorAlam, Firoj
AuthorHaouari, Fatima
AuthorHasanain, Maram
AuthorMansour, Watheq
AuthorHamdan, Bayan
AuthorAli, Zien Sheikh
AuthorBabulkov, Nikolay
AuthorNikolov, Alex
AuthorShahi, Gautam Kishore
AuthorStruß, Julia Maria
AuthorMandl, Thomas
AuthorKutlu, Mucahid
AuthorKartal, Yavuz Selim
Available date2024-02-20T11:38:01Z
Publication Date2021-09-14
Publication NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Identifierhttp://dx.doi.org/10.1007/978-3-030-85251-1_19
CitationNakov, P., Da San Martino, G., Elsayed, T., Barrón-Cedeño, A., Míguez, R., Shaar, S., ... & Kartal, Y. S. (2021). Overview of the CLEF–2021 CheckThat! lab on detecting check-worthy claims, previously fact-checked claims, and fake news. In Experimental IR Meets Multilinguality, Multimodality, and Interaction: 12th International Conference of the CLEF Association, CLEF 2021, Virtual Event, September 21–24, 2021, Proceedings 12 (pp. 264-291). Springer International Publishing.
ISBN978-3-030-85250-4
ISSN0302-9743
URIhttps://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85115877178&origin=inward
URIhttp://hdl.handle.net/10576/51994
AbstractWe describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian, English, Spanish, and Turkish. Task 1 asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics (in all five languages). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims (in Arabic and English). Task 3 asks to predict the veracity of a news article and its topical domain (in English). The evaluation is based on mean average precision or precision at rank k for the ranking tasks, and macro-F1 for the classification tasks. This was the most popular CLEF-2021 lab in terms of team registrations: 132 teams. Nearly one-third of them participated: 15, 5, and 25 teams submitted official runs for tasks 1, 2, and 3, respectively.
SponsorThis work is made possible by: - NPRP grant #NPRP-11S-1204-170060 from the Qatar National Research Fund (a member of Qatar Foundation). - GSRA grant #GSRA6-1-0611-19074 from the Qatar National Research Fund.
Languageen
PublisherSpringer Science and Business Media Deutschland GmbH
SubjectCheck-worthiness estimation
COVID-19
Disinformation
Fact-checking
Fake news detection
Misinformation
Verified claim retrieval
TitleOverview of the CLEF–2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News
TypeConference Paper
Pagination264-291
Volume Number12880 LNCS
EISBN978-3-030-85251-1
dc.accessType Abstract Only


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record