Focusing on BLEU Can Bias Machine Translation Output
Though beam search can boost BLEU scores, it can also lead to high rates of misgendered pronouns, even when translating between two gendered languages. Continue reading
Tag: BLEU
Here Are the Top 10 Most Influential Research Papers on Neural Machine Translation
The most-cited neural machine translation research papers show how NMT came to dominate the field — and how academia and industry’s interests have evolved. Continue reading
Google Explores New Way to Improve Google Translate: Paraphrasing by Humans
Google study shows human-paraphrased reference translations and new evaluation metric, BLEUP, produce better translations. Findings to be integrated into consumer-facing products. Continue reading
Facebook Ramps Up Open Source Drive Into Speech Translation
Facebook AI invites developers to improve a speech translation dataset and a open sources a toolkit that evaluates simultaneous speech and text translation. Continue reading
And the Winner Is…ACL 2020 Announces Best Paper Awards
Association for Computational Linguistics names Best Research Papers of 2020 from a field of more than 3,000 submissions; paper that argues for retiring BLEU is runner-up. Continue reading
Advertisement
BLEU Has Measured Machine Translation Quality Since 2002. It’s Fast Becoming Useless.
As machine translation quality improves, precision-based metrics struggle to identify the best systems. Why have newer metrics not ousted longtime standard BLEU? Continue reading
A Quick Primer on Edit-Distance, a Key Metric in Post-Editing Machine Translation
As the language industry transitions to an operating model where the first draft is mostly generated by machines, many are looking for ways to quantify linguists' value-add. Edit-distance can help. Continue reading
Researchers Propose New Way to Detect Machine Translation — Maybe Google Could Use It
Google has admitted machine translated content is a challenge to ranking algorithms. Researchers at the University of Tokyo may have found a solution: back-translation. Continue reading
NVIDIA Engineer on Machine Translation Research’s State-of-the Art and Future Direction
NVIDIA Senior Deep Learning Engineer Chip Huyen details progress on MT challenges, including data requirements, sentence-length limitations, and imperfect quality evaluation techniques. Continue reading
Facebook Patents Alternative to ‘Expensive’ BLEU
Facebook has been granted a patent for its machine translation quality evaluation system, which relies on user engagement data to decide which translation users prefer. Continue reading
Advertisement
As Neural Machine Translation’s Core Model Seems Settled, Focus Shifts to Products
At SlatorCon London 2019, Systran CEO Jean Senellart outlined the latest in NMT developments, called out some myths from vendors, and pointed out what’s missing from the industry. Continue reading
Google, Microsoft, Baidu Step Up NMT Research in Record August as BLEU Takes Heat
August 2018 became the busiest month ever for neural machine translation research as more papers call for improved evaluation methods and big tech companies step up the number of submissions. Continue reading
In Human vs. Machine Translation, Compare Documents, Not Sentences
Microsoft’s “human parity” claims drew skepticism from a team of neural machine translation researchers as they found that much of the research and industry community is looking at the problem... Continue reading
How BLEU Measures Translation and Why It Matters
When Google’s CEO goes on stage and measures translation accuracy to the third decimal place, it is as good a time as any to take a closer look at the yardstick he uses. A short introduction to BLEU Continue reading
Your information will never be shared with third parties. No Spam.