logo image
  • News
    • People Moves
    • Deal Wins
    • Demand Drivers
    • M&A and Funding
    • Financial Results
    • Technology
    • Academia
    • Industry News
    • Features
    • Machine Translation
    • — Divider —
    • Slator Pro
    • — Divider —
    • Press Releases
    • Sponsored Content
  • Data & Research
    • Research Reports & Pro Guides
    • Language Industry Investor Map
    • Real-Time Charts of Listed LSPs
    • Language Service Provider Index
  • Podcasts & Videos
  • Events
    • Design Thinking – February 2021
    • — Divider —
    • SlatorCon Coverage
    • Other Events
  • Directory
  • RFP Center
  • Jobs
MENU
  • News
    • People Moves
    • Deal Wins
    • Demand Drivers
    • M&A and Funding
    • Financial Results
    • Technology
    • Academia
    • Industry News
    • Features
    • Machine Translation
    • — Divider —
    • Slator Pro
    • — Divider —
    • Press Releases
    • Sponsored Content
  • Data & Research
    • Research Reports & Pro Guides
    • Language Industry Investor Map
    • Real-Time Charts of Listed LSPs
    • Language Service Provider Index
  • Podcasts & Videos
  • Events
    • Design Thinking – February 2021
    • — Divider —
    • SlatorCon Coverage
    • Other Events
  • Directory
  • RFP Center
  • Jobs

Advertise on Slator! Download the 2021 Online Media Kit Now

  • Slator Market Intelligence
  • Slator Advertising Services
  • Slator Advisory
  • Login
Search
Generic filters
Exact matches only
Advertisement
Machine Translation Researchers Set to Find Out Whose System Is Best

3 years ago

August 16, 2017

Machine Translation Researchers Set to Find Out Whose System Is Best

Academia ·

by Florian Faes

On August 16, 2017

3 years ago
Academia ·

by Florian Faes

On August 16, 2017

Machine Translation Researchers Set to Find Out Whose System Is Best

In early September 2017, hundreds of machine translation researchers will descend on the Danish capital of Copenhagen. They come to find out whose machine translation system is best at the Second Conference on Machine Translation (WMT17).

Competition is fierce. In 2016, nearly 200 MT systems from two dozen institutions were submitted and evaluated in 10 different so-called tasks.

WMT has been held annually since 2006, first in the form of annual workshops and, with the recent boom in MT research, the 2016 forum was upgraded to a conference.

Advertisement

WMT17 is piggybacking on the larger Conference on Empirical Methods in Natural Language Processing (EMNLP 2017), which is held from September 7-11, 2017, and is organized by the Association for Computational Linguistics.

The surge in interest in artificial intelligence and sub-domains such as natural language processing is proving to be a boon for the organizers, who say registrations are already 150% over their original estimate.

To find out whose system is best, WMT17 features eight shared tasks for researchers to work on, including tasks in news translation, biomedical translation, automatic post editing, and training of neural MT (NMT) systems. In fact, 2017 is the first year researchers submit an NMT task. In 2016, NMT was still only mentioned as a “topic of interest.”

Preliminary results of the news translation shared task are already available, both for manual evaluation and automatic evaluation. Results on automatic evaluations performed by some of the organizers have also been released. Furthermore, a draft version of the conference proceedings has been made available online. Final results for all shared tasks will be announced during the conference.

Among the lead organizers of WMT 2017 are Philipp Koehn, Professor at John Hopkins University’s Language & Speech Processing Group and Chief Scientist for Omniscien Technologies; and Barry Haddow, Senior Research Fellow at the University of Edinburgh.

Among the 21 organizers listed are representatives from Heidelberg University, the University of Edinburgh, and the Fondazione Bruno Kessler.

Roughly three-quarters of the 115 researchers on WMT’s program committee hail from academia with the University of Edinburgh sending seven, the University of Amsterdam sending six, and the Karlsruhe Institute of Technology four researchers.

University of Zurich’s Martin Volk, who recently secured a research grant for his NMT project, will be present, as will New York University’s Kyunghyun Cho, one of the speakers at the upcoming SlatorCon New York.

Big technology companies have participated at the WMT for years and in 2017 companies like IBM, Google, Amazon, Microsoft are well represented on the program committee. Conspicuously absent is Facebook, which in early August 2017 announced it had fully transitioned to neural MT.

The results published from WMT have become a crucial benchmark for academic researchers and research teams of large technology companies to evaluate their systems.

Commercial machine translation providers tend to stay away from competing in WMT, however, because it involves months of preparation and the outcome is uncertain. It would not make for good marketing if your system is ranked in the bottom half.

Still, commercial providers would use WMT to benchmark their systems and use the resulting BLEU scores to do a sanity check when developing a system for a new language combination, for example.

In the main EMNLP conference that follows the WMT, conference sessions on machine translation, especially neural machine translation will figure prominently. These sessions will run alongside discussions on machine learning, multilingual natural language processing (NLP), NLP applications, and linguistic theory, to name only a few.

Editor’s Note: This article has been updated to include preliminary results of the shared task on news translation. Hat tip to Tilde Researcher Mārcis Pinnis for bringing this to our attention.

TAGS

conferencemachine translationneural machine translationWMT
SHARE
Florian Faes

By Florian Faes

Co-Founder of Slator. Linguist, business developer, and mountain runner. Based in the beautiful lakeside city of Zurich, Switzerland.

Advertisement

SUBSCRIBE TO THE SLATOR WEEKLY

Language Industry Intelligence
In Your Inbox. Every Friday

SUBSCRIBE

SlatorSweepSlatorPro
ResearchRFP CENTER

PUBLISH

PRESS RELEASEDIRECTORY LISTING
JOB ADEVENT LISTING

Bespoke advisory including speaking, briefings and M&A

SLATOR ADVISORY
Advertisement

Featured Reports

See all
Slator 2020 Language Industry M&A and Funding Report

Slator 2020 Language Industry M&A and Funding Report

by Slator

Slator 2021 Data-for-AI Market Report

Slator 2021 Data-for-AI Market Report

by Slator

Slator 2020 Medtech Translation and Localization Report

Slator 2020 Medtech Translation and Localization Report

by Slator

Pro Guide: Sales and Marketing for Language Service Providers

Pro Guide: Sales and Marketing for Language Service Providers

by Slator

Press Releases

See all
Across Systems will be part of the Volaris Group

Across Systems will be part of the Volaris Group

by Across Systems GmbH

How Localex Made It Through the Pandemic

How Localex Made It Through the Pandemic

by Localex

Join Us for the First Virtual Together 2021 Next Month!

Join Us for the First Virtual Together 2021 Next Month!

by Elia

Upcoming Events

See All
  1. Handling Sensitive Information Webinar

    Handling Sensitive Calls with Limited English Proficient Consumers

    by Lionbridge

    · February 10

    Learn more about how Lionbridge Over-the-Phone Interpretation Services can help bridge communication gaps with limited...

    More info FREE

Featured Companies

See all
Text United

Text United

Memsource

Memsource

Wordbank

Wordbank

Protranslating

Protranslating

Seprotec

Seprotec

Versacom

Versacom

SDL

SDL

Smartling

Smartling

Lingotek

Lingotek

XTM International

XTM International

Smartcat

Smartcat

Translators without Borders

Translators without Borders

STAR Group

STAR Group

memoQ Translation Technologies

memoQ Translation Technologies

Advertisement

Popular articles

Why Netflix Shut Down Its Translation Portal Hermes

Why Netflix Shut Down Its Translation Portal Hermes

by Esther Bond

Top Language Industry Quotes of 2020

Top Language Industry Quotes of 2020

by Monica Jamieson

The Slator 2020 Language Service Provider Index

The Slator 2020 Language Service Provider Index

by Slator

SlatorPod: The Weekly Language Industry Podcast

connect with us

footer logo

Slator makes business sense of the language services and technology market.

Our Company

  • Support
  • About us
  • Terms & Conditions
  • Privacy Policy

Subscribe to the Slator Weekly

Language Industry Intelligence
In Your Inbox. Every Friday

© 2021 Slator. All rights reserved.

Sign up to the Slator Weekly

Join over 13,000 subscribers and get the latest language industry intelligence every Friday

Your information will never be shared with third parties. No Spam.