Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques

Jakub Piskorski*, Nicolas Stefanovitch, Firoj Alam, Ricardo Campos, Dimitar Dimitrov, Alípio Jorge, Senja Pollak, Nikolay Ribin, Zoran Fijavž, Maram Hasanain, Purificação Silvano, Elisa Sartori, Nuno Guimarães, Ana Zwitter Vitez, Ana Filipa Pacheco, Ivan Koychev, Nana Yu, Preslav Nakov, Giovanni Da San Martino

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

Abstract

We present an overview of CheckThat! Lab's 2024 Task 3, which focuses on detecting 23 persuasion techniques at the text-span level in online media. The task covers five languages, namely, Arabic, Bulgarian, English, Portuguese, and Slovene, and highly-debated topics in the media, e.g., the Isreali-Palestian conflict, the Russia-Ukraine war, climate change, COVID-19, abortion, etc. A total of 23 teams registered for the task, and two of them submitted system responses which were compared against a baseline and a task organizers' system, which used a state-of-the-art transformer-based architecture. We provide a description of the dataset and the overall task setup, including the evaluation methodology, and an overview of the participating systems. The datasets accompanied with the evaluation scripts are released to the research community, which we believe will foster research on persuasion technique detection and analysis of online media content in various fields and contexts.

Original languageEnglish
Pages (from-to)299-310
Number of pages12
JournalCEUR Workshop Proceedings
Volume3740
Publication statusPublished - 12 Sept 2024
Event25th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2024 - Grenoble, France
Duration: 9 Sept 202412 Sept 2024

Keywords

  • Persuasion technique
  • media analysis
  • multilinguality

Fingerprint

Dive into the research topics of 'Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques'. Together they form a unique fingerprint.

Cite this