Romanian Question Answering Using Transformer Based Neural Networks

Bogdan-Alexandru Diaconu, Faculty of Mathematics and Computer Science, Babes-Bolyai University, Cluj-Napoca, Romania., Beáta Lázár-Lőrincz, Faculty of Mathematics and Computer Science, Babes-Bolyai University, Cluj-Napoca, Romania. Email: beata.lorincz@ubbcluj.ro.
2022 Studia Universitatis Babes-Bolyai: Series Informatica  
"Question answering is the task of predicting answers for questions based on a context paragraph. It has become especially important, as the large amounts of textual data available online requires not only gathering information but also the task of findings specific answers to specific questions. In this work, we present experiments evaluated on the XQuAD-ro question answering dataset that has been recently published based on the translation of the SQuAD dataset into Romanian. Our
more » ... model, Romanian fine-tuned BERT, achieves an F1 score of 0.80 and an EM score of 0.73. We show that fine-tuning the model with the addition of the Romanian translation slightly increases the evaluation metrics. Keywords and phrases: question answering, deep learning, Transformer, Romanian. "
doi:10.24193/subbi.2022.1.03 fatcat:f7whld6ppjb77gm3asmwumg6l4