15 Hits in 6.7 sec

Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detection [article]

Lev Konstantinovskiy, Oliver Price, Mevan Babakar, Arkaitz Zubiaga
2020 arXiv   pre-print
Leveraging the expertise of professional factcheckers, we develop an annotation schema and a benchmark for automated claim detection that is more consistent across time, topics and annotators than previous  ...  In an effort to assist factcheckers in the process of factchecking, we tackle the claim detection task, one of the necessary stages prior to determining the veracity of a claim.  ...  This work has been partially funded by Open Society Foundation (OR2017-35395) and Omidyar Network.  ... 
arXiv:1809.08193v2 fatcat:oxob44vgqjcdjcvnzpuzi3b2oy

A Content Management Perspective on Fact-Checking

Sylvie Cazalens, Philippe Lamarre, Julien Leblay, Ioana Manolescu, Xavier Tannier
2018 Companion of the The Web Conference 2018 on The Web Conference 2018 - WWW '18  
We hope our work will provide interested researchers, journalists and fact checkers with an entry point in the existing literature as well as help develop a roadmap for future research and development  ...  for the future.  ...  Energy and Industrial Technology Development Organization (NEDO), Japan.  ... 
doi:10.1145/3184558.3188727 dblp:conf/www/CazalensLLMT18 fatcat:ux2zkw7mozapxnk32mxci54gxa

Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society [article]

Firoj Alam, Shaden Shaar, Fahim Dalvi, Hassan Sajjad, Alex Nikolov, Hamdy Mubarak, Giovanni Da San Martino, Ahmed Abdelali, Nadir Durrani, Kareem Darwish, Abdulaziz Al-Homaid, Wajdi Zaghouani (+5 others)
2021 arXiv   pre-print
To address this gap, we release a large dataset of 16K manually annotated tweets for fine-grained disinformation analysis that (i) focuses on COVID-19, (ii) combines the perspectives and the interests  ...  Addressing the issue requires solving a number of challenging problems such as identifying messages containing claims, determining their check-worthiness and factuality, and their potential to do harm  ...  We also want to thank the Atlantic Club in Bulgaria and DataBee for their support for the Bulgarian annotations.  ... 
arXiv:2005.00033v5 fatcat:pqmx6nl22jay7kvoiuunq4hrp4

Towards Explainable Fact Checking [article]

Isabelle Augenstein
2021 arXiv   pre-print
This development has spurred research in the area of automatic fact checking, from approaches to detect check-worthy claims and determining the stance of tweets towards claims, to methods to determine  ...  This thesis presents my research on automatic fact checking, including claim check-worthiness detection, stance detection and veracity prediction.  ...  The stance of each of these towards the claim is then annotated.  ... 
arXiv:2108.10274v2 fatcat:5s4an6irezcjfmvvhmiaeqarh4

Automated Fact-Checking for Assisting Human Fact-Checkers

Preslav Nakov, David Corney, Maram Hasanain, Firoj Alam, Tamer Elsayed, Alberto Barrón-Cedeño, Paolo Papotti, Shaden Shaar, Giovanni Da San Martino
2021 Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence   unpublished
These include identifying claims worth fact-checking, detecting relevant previously fact-checked claims, retrieving relevant evidence to fact-check a claim, and actually verifying a claim.  ...  However, the multiple advantages of free speech and direct communication are dimmed by the misuse of media to spread inaccurate or misleading claims.  ...  This work is also part of the Tanbih mega-project, developed at the Qatar Computing Research Institute, HBKU, which aims to limit the impact of "fake news," propaganda, and media bias by making users aware  ... 
doi:10.24963/ijcai.2021/619 fatcat:nfqws64wgzdadi7w6mkgvvychm

Mining social media for newsgathering: A review

Arkaitz Zubiaga
2019 Online Social Networks and Media  
Social media is becoming an increasingly important data source for learning about breaking news and for following the latest developments of ongoing news.  ...  In this paper, we provide an overview of research in data mining and natural language processing for mining social media for newsgathering.  ...  [123] introduced an annotation schema with seven types of tweets: (1) sentiment, tweets expressing emotions towards the event, (2) action, describing actions for event preparedness, (3) preparation,  ... 
doi:10.1016/j.osnem.2019.100049 fatcat:dt63zddmqba7vc47cyjve37i5q

Verifying Text Summaries of Relational Data Sets [article]

Saehan Jo, Immanuel Trummer, Weicheng Yu, Daniel Liu, Xuezhi Wang, Cong Yu, Niyati Mehta
2018 arXiv   pre-print
The tool focuses on natural language claims that translate into an SQL query and a claimed query result.  ...  In fully automated verification, our tool achieves significantly higher recall and precision than baselines from the areas of natural language query interfaces and fact-checking.  ...  Namely, we asked about learning overheads, preference for verifying correct claims, and for verifying incorrect claims.  ... 
arXiv:1804.07686v2 fatcat:6ujqeqmdgrf7hn7roy53mabsw4

Toward Veracity Assessment in RDF Knowledge Bases

Diego Esteves, Anisa Rula, Aniketh Janardhan Reddy, Jens Lehmann
2018 Journal of Data and Information Quality  
As a result of this exploratory analysis, we give insights and directions towards a beer architecture to tackle the complex task of fact-checking in knowledge bases.  ...  Despite current developments in the research area, the underlying framework faces many challenges. is article pinpoints and discusses these issues and conducts a thorough analysis of its pipeline, aiming  ...  For each seed instance, a Google query consisting of the subjects, objects and the automatically inferred keywords for the predicate is generated.  ... 
doi:10.1145/3177873 dblp:journals/jdiq/EstevesRRL18 fatcat:3m77bvdglbfcdljnsymfclnpmi

A Machine-Learning-Based Pipeline Approach to Automated Fact-Checking

Andreas Hanselowski
provide high-quality annotation of real fact-checking instances for all the tasks in the fact-checking process.  ...  However, despite significant progress in the field of automated fact-checking, substantial challenges remain: (i) The datasets available for training machine learning-based fact-checking systems do not  ...  Acknowledgments The doctoral program and ultimately this work has received extraordinary support  ... 
doi:10.25534/tuprints-00014136 fatcat:v2ptxb33jbdwpbhmyg2kdnovjy

Generating Fact Checking Briefs

Angela Fan, Aleksandra Piktus, Fabio Petroni, Guillaume Wenzek, Marzieh Saeidi, Andreas Vlachos, Antoine Bordes, Sebastian Riedel
2020 Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)   unpublished
To produce QABriefs, we develop QABRIEFER, a model that generates a set of questions conditioned on the claim, searches the web for evidence, and generates answers.  ...  However, despite good intentions, contributions from volunteers are often error-prone, and thus in practice restricted to claim detection.  ...  Towards automated factchecking: Developing an annotation schema and benchmark for consistent automated claim detec- tion.  ... 
doi:10.18653/v1/2020.emnlp-main.580 fatcat:qhc5fujdyfhrvchjttt6anpnou

Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society

Firoj Alam, Shaden Shaar, Fahim Dalvi, Hassan Sajjad, Alex Nikolov, Hamdy Mubarak, Giovanni Da San Martino, Ahmed Abdelali, Nadir Durrani, Kareem Darwish, Abdulaziz Al-Homaid, Wajdi Zaghouani (+5 others)
2021 Findings of the Association for Computational Linguistics: EMNLP 2021   unpublished
benchmark for consistent automated claim detection.  ...  In Advances in Informa- factchecking: Developing an annotation schema and tion Retrieval, ECIR ’19, pages 309–315, Cologne,  ... 
doi:10.18653/v1/2021.findings-emnlp.56 fatcat:fpkwoxgneng7zo6fzwd3tipysi

Proceedings of the GermEval 2021 Workshop on the Identification of Toxic, Engaging, and Fact-Claiming Comments [article]

Julian Risch, Anke Stoll, Lena Wilms, Michael Wiegand
On out-of-sample data, our best ensemble achieved a macro-F1 score of 0.73 (for all subtasks), and F1 scores of 0.72, 0.70, and 0.76 for subtasks 1, 2, and 3, respectively.  ...  In this contribution, we fine-tuned German BERT and German ELECTRA models to identify toxic (subtask 1), engaging (subtask 2), and fact-claiming comments (subtask 3) in Facebook data provided by the GermEval  ...  We would like to thank Marc Ziegele and Dominique Heinbach for the provision of annotated data as well as their valuable insight and support during data annotation.  ... 
doi:10.48415/2021/fhw5-x128 fatcat:u3fcq4x23jba7ic2a5ldcsdbna

Mapping (Dis-)Information Flow about the MH17 Plane Crash

Mareike Hartmann, Yevgeniy Golovchenko, Isabelle Augenstein
2019 Proceedings of the Second Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda   unpublished
We accepted a total of 24 papers: 10 for the regular track and 14 for the shared task.  ...  We are excited that the workshop includes a diverse set of topics: rumor and trolls detection, censorship and controversy, fake news vs. satire, uncovering propaganda and abusive language identification  ...  The corpus for the task was annotated by A Data Pro, 7 a company that performs high-quality manual annotations.  ... 
doi:10.18653/v1/d19-5006 fatcat:77l3dndrkvfmlhjt6qvnrassgi

Primary Encoder: Laura Weakly Designer: Karin Dalziel Encoders and Proofreaders: International Program Committee Local Organizing Committee Conference Volunteers Welcome to Digital Humanities 2013

Matt Bosley, Matthew Lavin, Elizabeth Lorang, Keith Nickum, Erin Pedigo, Hannah Vahle, Bethany Nowviskie, Craig Bellamy, John Bradley, Paul Caton, Carolyn Guertin, Ian Johnson (+61 others)
2013 unpublished
Welcome to the University of Nebraska-Lincoln and to Digital Humanities 2013. The theme we have chosen for this year's conference is "Freedom to Explore."  ...  For many years, Mexicans and Latinos from Central America have been migrating to Nebraska; and now Lincoln, Nebraska, is a refugee resettlement community with about 53 languages-of-origin spoken-languages  ...  unique opportunity to develop eResearch Tools that support the Collaborative Authoring and Management of Electronic Scholarly Editions.  ... 

Digital Technology and Extreme Speech: Approaches to Counter Online Hate

Sahana Udupa, United Nations Peace Keeping
To address the spread and severity of online hate and disinformation, and the mammoth challenge they have posed to human rights protection, this strategy paper calls for keen attention toward dynamic scenarios  ...  An institutionalized global structure to regularly convene social media companies to address repressive assaults on online speech will be a significant step towards addressing upheavals that unfold at  ...  She also thanks the reviewers and Naomi Miyashita at the UN Department of Peace Operations for initiating and supporting this paper through different stages of its development.  ... 
doi:10.5282/ubm/epub.77473 fatcat:tap6aasognabvn63dxsikjxp54