Exploring Model Consensus to Generate Translation Paraphrases

Zhenhao Li, Marina Fomicheva, Lucia Specia
2020 Proceedings of the Fourth Workshop on Neural Generation and Translation  
This paper describes our submission to the 2020 Duolingo Shared Task on Simultaneous Translation And Paraphrase for Language Education (STAPLE). This task focuses on improving the ability of neural MT systems to generate diverse translations. Our submission explores various methods, including Nbest translation, Monte Carlo dropout, Diverse Beam Search, Mixture of Experts, Ensembling, and Lexical Substitution. Our main submission is based on the integration of multiple translations from multiple
more » ... methods using Consensus Voting. Experiments show that the proposed approach achieves a considerable degree of diversity without introducing noisy translations. Our final submission 1 achieves 0.5510 weighted F1 score on the blind test set for the English-Portuguese track.
doi:10.18653/v1/2020.ngt-1.19 dblp:conf/aclnmt/LiFS20 fatcat:yvfn4bjkabg5ncaonzajxva7ki