A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf
.
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation
[article]
2020
arXiv
pre-print
Evaluation of cross-lingual encoders is usually performed either via zero-shot cross-lingual transfer in supervised downstream tasks or via unsupervised cross-lingual textual similarity. In this paper, we concern ourselves with reference-free machine translation (MT) evaluation where we directly compare source texts to (sometimes low-quality) system translations, which represents a natural adversarial setup for multilingual encoders. Reference-free evaluation holds the promise of web-scale
arXiv:2005.01196v3
fatcat:w4qe2vwes5gpbdn2ipmkzr5mki