Findings of the 2016 WMT Shared Task on Cross-lingual Pronoun Prediction

Liane Guillou, Christian Hardmeier, Preslav Nakov, Sara Stymne, Jörg Tiedemann, Yannick Versley, Mauro Cettolo, Bonnie Webber, Andrei Popescu-Belis
2016 Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers  
We describe the design, the evaluation setup, and the results of the 2016 WMT shared task on cross-lingual pronoun prediction. This is a classification task in which participants are asked to provide predictions on what pronoun class label should replace a placeholder value in the target-language text, provided in lemmatised and PoS-tagged form. We provided four subtasks, for the English-French and English-German language pairs, in both directions. Eleven teams participated in the shared task;
more » ... n the shared task; nine for the English-French subtask, five for French-English, nine for English-German, and six for German-English. Most of the submissions outperformed two strong language-modelbased baseline systems, with systems using deep recurrent neural networks outperforming those using other architectures for most language pairs.
doi:10.18653/v1/w16-2345 dblp:conf/wmt/GuillouHNSTVCWP16 fatcat:yxwlmivwmrgzxd6j6mxfnnf6hy