TY - GEN
T1 - The CLEF-2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News
AU - Nakov, Preslav
AU - Da San Martino, Giovanni
AU - Elsayed, Tamer
AU - Barrón-Cedeño, Alberto
AU - Míguez, Rubén
AU - Shaar, Shaden
AU - Alam, Firoj
AU - Haouari, Fatima
AU - Hasanain, Maram
AU - Babulkov, Nikolay
AU - Nikolov, Alex
AU - Shahi, Gautam Kishore
AU - Struß, Julia Maria
AU - Mandl, Thomas
N1 - Publisher Copyright:
© 2021, Springer Nature Switzerland AG.
PY - 2021
Y1 - 2021
N2 - We describe the fourth edition of the CheckThat! Lab, part of the 2021 Cross-Language Evaluation Forum (CLEF). The lab evaluates technology supporting various tasks related to factuality, and it is offered in Arabic, Bulgarian, English, and Spanish. Task 1 asks to predict which tweets in a Twitter stream are worth fact-checking (focusing on COVID-19). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims. Task 3 asks to predict the veracity of a target news article and its topical domain. The evaluation is carried out using mean average precision or precision at rank k for the ranking tasks, and F1 for the classification tasks.
AB - We describe the fourth edition of the CheckThat! Lab, part of the 2021 Cross-Language Evaluation Forum (CLEF). The lab evaluates technology supporting various tasks related to factuality, and it is offered in Arabic, Bulgarian, English, and Spanish. Task 1 asks to predict which tweets in a Twitter stream are worth fact-checking (focusing on COVID-19). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims. Task 3 asks to predict the veracity of a target news article and its topical domain. The evaluation is carried out using mean average precision or precision at rank k for the ranking tasks, and F1 for the classification tasks.
KW - COVID-19
KW - Check-worthiness estimation
KW - Disinformation
KW - Fact-checking
KW - Fake news
KW - Misinformation
KW - Verified claim retrieval
UR - http://www.scopus.com/inward/record.url?scp=85107373089&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-72240-1_75
DO - 10.1007/978-3-030-72240-1_75
M3 - Conference contribution
AN - SCOPUS:85107373089
SN - 9783030722395
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 639
EP - 649
BT - Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Proceedings
A2 - Hiemstra, Djoerd
A2 - Moens, Marie-Francine
A2 - Mothe, Josiane
A2 - Perego, Raffaele
A2 - Potthast, Martin
A2 - Sebastiani, Fabrizio
PB - Springer Science and Business Media Deutschland GmbH
T2 - 43rd European Conference on Information Retrieval, ECIR 2021
Y2 - 28 March 2021 through 1 April 2021
ER -