GDUF_DM at FakeDeS 2021: Spanish Fake News Detection with BERT and Sample Memory

Xixuan Huang, Jieying Xiong, Shengyi Jiang
2021 Annual Conference of the Spanish Society for Natural Language Processing  
Fake news widely spread on the Internet has had a negative impact on society. This article reports the solution of Spanish fake news detection purposed by our team GDUFS_DM in IberLEF 2021 shared task. Our purpose is to use BERT and Sample Memory with an attention mechanism to detect Spanish fake news. To capture richer semantic information in long news texts, we used BERT to encode the news headline and the news beginning and end part to keep more information instead of using a simple
more » ... n strategy. In addition, we also use a matrix parameter initialized by sample representation (we call it Sample Memory), combine with the attention mechanism, our model can capture the relationship information between samples which strengthens the model's robustness in the inference stage. Our submission result achieved the first place on the leaderboard, which fully reflects the advantages of our model.
dblp:conf/sepln/HuangXJ21 fatcat:ggduvrl6lrc5ngccnpqakgr2dq