26 Hits in 2.1 sec

Checkworthiness in Automatic Claim Detection Models: Definitions and Analysis of Datasets [article]

Liesbeth Allein, Marie-Francine Moens
2020 arXiv   pre-print
After elaborate analysis of checkworthy claim selection procedures in fact-check organisations and analysis of state-of-the-art claim detection datasets, checkworthiness is defined as the concept of having  ...  claim detection models.  ...  Datasets and Computational Models The divergent interpretations of checkworthiness are reflected in the datasets used for training and testing checkworthy claim detection models.  ... 
arXiv:2008.08854v1 fatcat:w44osf7u55cyzf2or4vfimpfji

Claim Check-Worthiness Detection as Positive Unlabelled Learning [article]

Dustin Wright, Isabelle Augenstein
2020 arXiv   pre-print
As the first step of automatic fact checking, claim check-worthiness detection is a critical component of fact checking systems.  ...  In applying this, we out-perform the state of the art in two of the three tasks studied for claim check-worthiness detection in English.  ...  Acknowledgements This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 801199.  ... 
arXiv:2003.02736v2 fatcat:hh3zrki7o5fffnjlby3zcneicu

Leveraging Commonsense Knowledge on Classifying False News and Determining Checkworthiness of Claims [article]

Ipek Baris Schlicht, Erhan Sezerer, Selma Tekir, Oul Han, Zeyd Boukhers
2021 arXiv   pre-print
We compare the model's performance with the single-task BERT model and a state-of-the-art check-worthy claim detection tool to evaluate the check-worthy claim detection.  ...  In this paper, we propose to leverage commonsense knowledge for the tasks of false news classification and check-worthy claim detection.  ...  Dataset for Check-worthy Claim Detection To evaluate the model in claim-level, we used the ClaimBuster dataset (Arslan et al., 2020) .  ... 
arXiv:2108.03731v1 fatcat:okae6wvhnjc2tolqwaycly5fey

Sequential Modelling with Applications to Music Recommendation, Fact-Checking, and Speed Reading [article]

Christian Hansen
2021 arXiv   pre-print
text semantics in order to automatically fact-check claims, or "speed read" text for efficient further classification.  ...  Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains.  ...  ACKNOWLEDGMENTS Partly funded by Innovationsfonden DK, DABAI (5153-00004A), and AMAOS (7076-00121B).  ... 
arXiv:2109.06736v1 fatcat:xawmkvzhgng3vhhrs5xvwokqna

Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society [article]

Firoj Alam, Shaden Shaar, Fahim Dalvi, Hassan Sajjad, Alex Nikolov, Hamdy Mubarak, Giovanni Da San Martino, Ahmed Abdelali, Nadir Durrani, Kareem Darwish, Abdulaziz Al-Homaid, Wajdi Zaghouani (+5 others)
2021 arXiv   pre-print
To address this gap, we release a large dataset of 16K manually annotated tweets for fine-grained disinformation analysis that (i) focuses on COVID-19, (ii) combines the perspectives and the interests  ...  Finally, we show strong evaluation results using pretrained Transformers, thus confirming the practical utility of the dataset in monolingual vs. multilingual, and single task vs. multitask settings.  ...  This publication was also partially made possible by the innovation grant No. 21 -Misinformation and Social Networks Analysis in Qatar from Hamad Bin Khalifa University's (HBKU) Innovation Center.  ... 
arXiv:2005.00033v5 fatcat:pqmx6nl22jay7kvoiuunq4hrp4

Automated Fact-Checking: A Survey [article]

Xia Zeng, Amani S. Abumansour, Arkaitz Zubiaga
2021 arXiv   pre-print
This paper reviews relevant research on automated fact-checking covering both the claim detection and claim validation components.  ...  Researchers in the field of Natural Language Processing (NLP) have contributed to the task by building fact-checking datasets, devising automated fact-checking pipelines and proposing NLP methods to further  ...  Acknowledgments This work was supported by the Engineering and Physical Sciences Research Council (grant EP/V048597/1). Xia Zeng is funded by China Scholarship Council (CSC). Amani S.  ... 
arXiv:2109.11427v1 fatcat:6ezha6y5svf4zkq7brodmd3vke

That is a Known Lie: Detecting Previously Fact-Checked Claims [article]

Shaden Shaar, Giovanni Da San Martino, Nikolay Babulkov, Preslav Nakov
2020 arXiv   pre-print
As a result and over time, a large number of fact-checked claims have been accumulated, which increases the likelihood that a new claim in social media or a new statement by a politician might have already  ...  As manual fact-checking is very time-consuming (and fully automatic fact-checking has credibility issues), it is important to try to save this effort and to avoid wasting time on claims that have already  ...  Acknowledgments This research is part of the Tanbih project, 14 which aims to limit the effect of 'fake news," disinformation, propaganda, and media bias by making users aware of what they are reading.  ... 
arXiv:2005.06058v1 fatcat:57dic6w655hjvjvsktnuu2f2fm

SU-NLP at CheckThat! 2021: Check-Worthiness of Turkish Tweets

Buse Çarik, Reyyan Yeniterzi
2021 Conference and Labs of the Evaluation Forum  
We propose an ensemble of BERT models which ranked the second best in terms of MAP score.  ...  In order to prevent this disinformation spread, automated fact checking systems that identify and verify claims are needed.  ...  2020 Task 1, the identification of checkworthy claims, was carried out in English and Arabic languages [4] .  ... 
dblp:conf/clef/CarikY21 fatcat:662auhoscncuhmxdpxvwq2sg3i

Overview of CheckThat! 2020 English: Automatic Identification and Verification of Claims in Social Media

Shaden Shaar, Alex Nikolov, Nikolay Babulkov, Firoj Alam, Alberto Barrón-Cedeño, Tamer Elsayed, Maram Hasanain, Reem Suwaileh, Fatima Haouari, Giovanni Da San Martino, Preslav Nakov
2020 Conference and Labs of the Evaluation Forum  
and detecting previously fact-checked claims.  ...  A total of 18 teams participated in the English tasks, and most submissions managed to achieve sizable improvements over the baselines using models based on BERT, LSTMs, and CNNs.  ...  Acknowledgments This research is part of the Tanbih project, developed by the Qatar Computing Research Institute, HBKU and MIT-CSAIL, which aims to limit the effect of "fake news", propaganda, and media  ... 
dblp:conf/clef/ShaarNBABEHSHMN20 fatcat:ouilyth4czerzg35grm4sm6gjy

Automated fact‐checking: A survey

Xia Zeng, Amani S. Abumansour, Arkaitz Zubiaga
2021 Language and Linguistics Compass  
This article reviews relevant research on automated fact-checking covering both the claim detection and claim validation components.  ...  Researchers in the field of Natural Language Processing (NLP) have contributed to the task by building fact-checking datasets, devising automated fact-checking pipelines and proposing NLP methods to further  ...  ACKNOWLEDGEMENTS This work was supported by the Engineering and Physical Sciences Research Council (grant EP/ V048597/1). Xia Zeng was funded by China Scholarship Council. Amani S.  ... 
doi:10.1111/lnc3.12438 fatcat:63crsybycvbkjgkmzeuxqitpay

Computational fact checking

Sylvie Cazalens, Julien Leblay, Philippe Lamarre, Ioana Manolescu, Xavier Tannier
2018 Proceedings of the VLDB Endowment  
The term was born in the journalist community and referred the process of verifying and ensuring the accuracy of published media content; since 2012, however, it has increasingly focused on the analysis  ...  Thus, a very lively area of digital content management research has taken up these problems and works to propose foundations (models), algorithms, and implement them through concrete tools.  ...  Text analysis can be used to detect trends in news, extract the source of claims [23, 34, 33] or recognize rumors [6] .  ... 
doi:10.14778/3229863.3229880 fatcat:wx4kp42jyzgc5bvu7wyk3s3q5e

A Survey on Automated Fact-Checking [article]

Zhijiang Guo, Michael Schlichtkrull, Andreas Vlachos
2022 arXiv   pre-print
In this process, we present an overview of existing datasets and models, aiming to unify the various definitions given and identify common concepts.  ...  predict the veracity of claims.  ...  The authors would like to thank Rami Aly, Christos Christodoulopoulos, Nedjma Ousidhoum, and James Thorne for useful comments and suggestions.  ... 
arXiv:2108.11896v3 fatcat:zjfyftf4wfdbrjwnahaskrybqm

Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detection [article]

Lev Konstantinovskiy, Oliver Price, Mevan Babakar, Arkaitz Zubiaga
2020 arXiv   pre-print
In an effort to assist factcheckers in the process of factchecking, we tackle the claim detection task, one of the necessary stages prior to determining the veracity of a claim.  ...  Leveraging the expertise of professional factcheckers, we develop an annotation schema and a benchmark for automated claim detection that is more consistent across time, topics and annotators than previous  ...  This work has been partially funded by Open Society Foundation (OR2017-35395) and Omidyar Network.  ... 
arXiv:1809.08193v2 fatcat:oxob44vgqjcdjcvnzpuzi3b2oy

EvolutionTeam at CLEF2020 - CheckThat! lab : Integration of Linguistic and Sentimental Features in a Fake News Detection Approach

Ibtissam Touahri, Azzeddine Mazroui
2020 Conference and Labs of the Evaluation Forum  
lab, three tasks run in Arabic, namely check-worthiness on tweets, evidence retrieval, and claim verification that corresponds respectively to task1, task3, and task4.  ...  The third task is a classification task based on sentiment and linguistic features to compute the overlap and the contradiction between the claim and the detected check worthy sentences.  ...  [5] presented an automatic fact-checking system to detect fake news based on a neural ranking model to check sentence worthiness.  ... 
dblp:conf/clef/TouahriM20 fatcat:zvia2fognzgebpwbjwcluoxfzu

NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge [article]

Revanth Gangi Reddy, Sai Chetan, Zhenhailong Wang, Yi R. Fung, Kathryn Conger, Ahmed Elsayed, Martha Palmer, Preslav Nakov, Eduard Hovy, Kevin Small, Heng Ji
2022 arXiv   pre-print
We redefine the claim detection problem to include extraction of additional background attributes related to each claim and release 889 claims annotated over 143 news articles.  ...  In this work, we present NewsClaims, a new benchmark for knowledge-aware claim detection in the news domain.  ...  Results and Analysis: Table 6 shows that automatic models perform considerably worse than humans for claimer detection.  ... 
arXiv:2112.08544v3 fatcat:jn7fwfoornhwfnahuw33hwhohq
« Previous Showing results 1 — 15 out of 26 results