Automatic Metrics Can Outperform Crowd Workers in Machine Translation Evaluation
New Google research shows that automatic MT evaluation metrics trained by professional translators can outperform inexperienced (human) crowd workers, who favor “easy-to-rate” literal translations.