The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

Preslav Nakov; Alberto Barrón-Cedeño; Giovanni Da San Martino; Firoj Alam; Julia Maria Struß; Thomas Mandl; Rubén Míguez; Tommaso Caselli; Mucahid Kutlu; Wajdi Zaghouani; Chengkai Li; Shaden Shaar; Gautam Kishore Shahi; Hamdy Mubarak; Alex Nikolov; Nikolay Babulkov; Yavuz Selim Kartal; Javier Beltrán

doi:10.1007/978-3-030-99739-7_52

The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

Preslav Nakov^*, Alberto Barrón-Cedeño, Giovanni Da San Martino, Firoj Alam, Julia Maria Struß, Thomas Mandl, Rubén Míguez, Tommaso Caselli, Mucahid Kutlu, Wajdi Zaghouani, Chengkai Li, Shaden Shaar, Gautam Kishore Shahi, Hamdy Mubarak, Alex Nikolov, Nikolay Babulkov, Yavuz Selim Kartal, Javier Beltrán

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

54 Citations (Scopus)

Abstract

The fifth edition of the CheckThat! Lab is held as part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting various factuality tasks in seven languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 focuses on disinformation related to the ongoing COVID-19 infodemic and politics, and asks to predict whether a tweet is worth fact-checking, contains a verifiable factual claim, is harmful to the society, or is of interest to policy makers and why. Task 2 asks to retrieve claims that have been previously fact-checked and that could be useful to verify the claim in a tweet. Task 3 is to predict the veracity of a news article. Tasks 1 and 3 are classification problems, while Task 2 is a ranking one.

Original language	English
Title of host publication	Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings
Editors	Matthias Hagen, Suzan Verberne, Craig Macdonald, Christin Seifert, Krisztian Balog, Kjetil Nørvåg, Vinay Setty
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	416-428
Number of pages	13
ISBN (Print)	9783030997380
DOIs	https://doi.org/10.1007/978-3-030-99739-7_52
Publication status	Published - 2022
Event	44th European Conference on Information Retrieval, ECIR 2022 - Stavanger, Norway Duration: 10 Apr 2022 → 14 Apr 2022

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13186 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	44th European Conference on Information Retrieval, ECIR 2022
Country/Territory	Norway
City	Stavanger
Period	10/04/22 → 14/04/22

Keywords

COVID-19
Check-worthiness
Disinformation
Fact-checking
Factuality
Fake news
Misinformation
Verified claim retrieval

Access to Document

10.1007/978-3-030-99739-7_52

Cite this

Nakov, P., Barrón-Cedeño, A., Da San Martino, G., Alam, F., Struß, J. M., Mandl, T., Míguez, R., Caselli, T., Kutlu, M., Zaghouani, W., Li, C., Shaar, S., Shahi, G. K., Mubarak, H., Nikolov, A., Babulkov, N., Kartal, Y. S., & Beltrán, J. (2022). The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection. In M. Hagen, S. Verberne, C. Macdonald, C. Seifert, K. Balog, K. Nørvåg, & V. Setty (Eds.), Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings (pp. 416-428). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13186 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-99739-7_52

Nakov, Preslav ; Barrón-Cedeño, Alberto ; Da San Martino, Giovanni et al. / The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection. Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings. editor / Matthias Hagen ; Suzan Verberne ; Craig Macdonald ; Christin Seifert ; Krisztian Balog ; Kjetil Nørvåg ; Vinay Setty. Springer Science and Business Media Deutschland GmbH, 2022. pp. 416-428 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{94d16a2285304bf3bd5428d6b46cc77b,

title = "The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection",

abstract = "The fifth edition of the CheckThat! Lab is held as part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting various factuality tasks in seven languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 focuses on disinformation related to the ongoing COVID-19 infodemic and politics, and asks to predict whether a tweet is worth fact-checking, contains a verifiable factual claim, is harmful to the society, or is of interest to policy makers and why. Task 2 asks to retrieve claims that have been previously fact-checked and that could be useful to verify the claim in a tweet. Task 3 is to predict the veracity of a news article. Tasks 1 and 3 are classification problems, while Task 2 is a ranking one.",

keywords = "COVID-19, Check-worthiness, Disinformation, Fact-checking, Factuality, Fake news, Misinformation, Verified claim retrieval",

author = "Preslav Nakov and Alberto Barr{\'o}n-Cede{\~n}o and {Da San Martino}, Giovanni and Firoj Alam and Stru{\ss}, {Julia Maria} and Thomas Mandl and Rub{\'e}n M{\'i}guez and Tommaso Caselli and Mucahid Kutlu and Wajdi Zaghouani and Chengkai Li and Shaden Shaar and Shahi, {Gautam Kishore} and Hamdy Mubarak and Alex Nikolov and Nikolay Babulkov and Kartal, {Yavuz Selim} and Javier Beltr{\'a}n",

note = "Publisher Copyright: {\textcopyright} 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 44th European Conference on Information Retrieval, ECIR 2022 ; Conference date: 10-04-2022 Through 14-04-2022",

year = "2022",

doi = "10.1007/978-3-030-99739-7_52",

language = "English",

isbn = "9783030997380",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "416--428",

editor = "Matthias Hagen and Suzan Verberne and Craig Macdonald and Christin Seifert and Krisztian Balog and Kjetil N{\o}rv{\aa}g and Vinay Setty",

booktitle = "Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings",

address = "Germany",

}

Nakov, P, Barrón-Cedeño, A, Da San Martino, G, Alam, F, Struß, JM, Mandl, T, Míguez, R, Caselli, T, Kutlu, M, Zaghouani, W, Li, C, Shaar, S, Shahi, GK, Mubarak, H, Nikolov, A, Babulkov, N, Kartal, YS & Beltrán, J 2022, The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection. in M Hagen, S Verberne, C Macdonald, C Seifert, K Balog, K Nørvåg & V Setty (eds), Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13186 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 416-428, 44th European Conference on Information Retrieval, ECIR 2022, Stavanger, Norway, 10/04/22. https://doi.org/10.1007/978-3-030-99739-7_52

The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection. / Nakov, Preslav; Barrón-Cedeño, Alberto; Da San Martino, Giovanni et al.
Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings. ed. / Matthias Hagen; Suzan Verberne; Craig Macdonald; Christin Seifert; Krisztian Balog; Kjetil Nørvåg; Vinay Setty. Springer Science and Business Media Deutschland GmbH, 2022. p. 416-428 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13186 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

AU - Nakov, Preslav

AU - Barrón-Cedeño, Alberto

AU - Da San Martino, Giovanni

AU - Alam, Firoj

AU - Struß, Julia Maria

AU - Mandl, Thomas

AU - Míguez, Rubén

AU - Caselli, Tommaso

AU - Kutlu, Mucahid

AU - Zaghouani, Wajdi

AU - Li, Chengkai

AU - Shaar, Shaden

AU - Shahi, Gautam Kishore

AU - Mubarak, Hamdy

AU - Nikolov, Alex

AU - Babulkov, Nikolay

AU - Kartal, Yavuz Selim

AU - Beltrán, Javier

PY - 2022

Y1 - 2022

N2 - The fifth edition of the CheckThat! Lab is held as part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting various factuality tasks in seven languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 focuses on disinformation related to the ongoing COVID-19 infodemic and politics, and asks to predict whether a tweet is worth fact-checking, contains a verifiable factual claim, is harmful to the society, or is of interest to policy makers and why. Task 2 asks to retrieve claims that have been previously fact-checked and that could be useful to verify the claim in a tweet. Task 3 is to predict the veracity of a news article. Tasks 1 and 3 are classification problems, while Task 2 is a ranking one.

AB - The fifth edition of the CheckThat! Lab is held as part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting various factuality tasks in seven languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 focuses on disinformation related to the ongoing COVID-19 infodemic and politics, and asks to predict whether a tweet is worth fact-checking, contains a verifiable factual claim, is harmful to the society, or is of interest to policy makers and why. Task 2 asks to retrieve claims that have been previously fact-checked and that could be useful to verify the claim in a tweet. Task 3 is to predict the veracity of a news article. Tasks 1 and 3 are classification problems, while Task 2 is a ranking one.

KW - COVID-19

KW - Check-worthiness

KW - Disinformation

KW - Fact-checking

KW - Factuality

KW - Fake news

KW - Misinformation

KW - Verified claim retrieval

UR - http://www.scopus.com/inward/record.url?scp=85168739207&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-99739-7_52

DO - 10.1007/978-3-030-99739-7_52

M3 - Conference contribution

AN - SCOPUS:85168739207

SN - 9783030997380

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 416

EP - 428

BT - Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings

A2 - Hagen, Matthias

A2 - Verberne, Suzan

A2 - Macdonald, Craig

A2 - Seifert, Christin

A2 - Balog, Krisztian

A2 - Nørvåg, Kjetil

A2 - Setty, Vinay

PB - Springer Science and Business Media Deutschland GmbH

T2 - 44th European Conference on Information Retrieval, ECIR 2022

Y2 - 10 April 2022 through 14 April 2022

ER -

Nakov P, Barrón-Cedeño A, Da San Martino G, Alam F, Struß JM, Mandl T et al. The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection. In Hagen M, Verberne S, Macdonald C, Seifert C, Balog K, Nørvåg K, Setty V, editors, Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Proceedings. Springer Science and Business Media Deutschland GmbH. 2022. p. 416-428. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-99739-7_52

The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

EX-QNRF-NPRPS-22: Resources and Applications for Detecting and Classifying Polarized and Hate Speech in Arabic Social Media

Cite this

The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Projects

EX-QNRF-NPRPS-22: Resources and Applications for Detecting and Classifying Polarized and Hate Speech in Arabic Social Media

Cite this