Team JUST at the MADAR Shared Task on Arabic Fine-Grained Dialect Identification

Bashar Talafha, Ali Fadel, Mahmoud Al-Ayyoub, Yaser Jararweh, Mohammad AL-Smadi, Patrick Juola
2019 Proceedings of the Fourth Arabic Natural Language Processing Workshop  
In this paper, we describe our team's effort on the MADAR Shared Task on Arabic Fine-Grained Dialect Identification. The task requires building a system capable of differentiating between 25 different Arabic dialects in addition to MSA. Our approach is simple. After preprocessing the data, we use Data Augmentation (DA) to enlarge the training data six times. We then build a language model and extract n-gram word-level and character-level TF-IDF features and feed them into an MNB classifier.
more » ... ite its simplicity, the resulting model performs really well producing the 4th highest F-measure and region-level accuracy and the 5th highest precision, recall, city-level accuracy and country-level accuracy among the participating teams.
doi:10.18653/v1/w19-4638 dblp:conf/wanlp/TalafhaFAJAJ19 fatcat:mtywlzelkfct3j2jqxtzlgqota