logo image
  • News
    • People Moves
    • Deal Wins
    • Demand Drivers
    • M&A and Funding
    • Financial Results
    • Technology
    • Academia
    • Industry News
    • Features
    • Machine Translation
    • — Divider —
    • Slator Pro
    • — Divider —
    • Press Releases
    • Sponsored Content
  • Data & Research
    • Research Reports & Pro Guides
    • Language Industry Investor Map
    • Real-Time Charts of Listed LSPs
    • Language Service Provider Index
  • Podcasts & Videos
  • Events
    • SlatorCon Remote May 2021
    • Localizing at Scale for International Growth
    • Design Thinking May 2021
    • — Divider —
    • SlatorCon Coverage
    • Other Events
  • Directory
  • RFP Center
  • Jobs
MENU
  • News
    • People Moves
    • Deal Wins
    • Demand Drivers
    • M&A and Funding
    • Financial Results
    • Technology
    • Academia
    • Industry News
    • Features
    • Machine Translation
    • — Divider —
    • Slator Pro
    • — Divider —
    • Press Releases
    • Sponsored Content
  • Data & Research
    • Research Reports & Pro Guides
    • Language Industry Investor Map
    • Real-Time Charts of Listed LSPs
    • Language Service Provider Index
  • Podcasts & Videos
  • Events
    • SlatorCon Remote May 2021
    • Localizing at Scale for International Growth
    • Design Thinking May 2021
    • — Divider —
    • SlatorCon Coverage
    • Other Events
  • Directory
  • RFP Center
  • Jobs

Register Before April 15th for SlatorCon Remote and Save 15%!

  • Slator Market Intelligence
  • Slator Advertising Services
  • Slator Advisory
  • Login
Search
Generic filters
Exact matches only
Advertisement
For Users, Fluency Trumps Adequacy in Machine Translation, Study Finds

3 years ago

February 28, 2018

For Users, Fluency Trumps Adequacy in Machine Translation, Study Finds

Academia ·

by Gino Diño

On February 28, 2018

3 years ago
Academia ·

by Gino Diño

On February 28, 2018

For Users, Fluency Trumps Adequacy in Machine Translation, Study Finds

New research submitted to Arxiv.org delved into how much users trust machine translation based on fluency and adequacy of output. The paper was written by University of Maryland’s Marianna J. Martindale, PhD Student, and Marine Carpuat, Assistant Professor in Computer Science.

Based on the number of papers published on Arxiv.org, Cornell University’s automated online distribution system for research papers, it looks like neural machine translation (NMT) research continues at a busy pace, though the bustle somewhat mellowed from an all-time high on November 2017.

This new study by the two University of Maryland researchers explored uncharted territory: user trust in MT. The research ascertained how much trust people put in MT engines based on fluency and adequacy of output, specifically, in terms of these three hypotheses:

Advertisement
  • Good translations maintain or improve user trust
  • Bad translations (either not fluent or not adequate) erode user trust
  • Misleading translations (not adequate) erode user trust more significantly compared to output that is simply not fluent

The researchers confirmed the first two hypotheses, but found that in their test set, fluency actually trumped adequacy.

The researchers found that there was a much bigger dip in user trust when translations were not fluent compared to when translations were not adequate. Furthermore, participants retained pretty much the same level of trust in MT output when provided fluent and adequate translations again despite the drop in trust due to mistranslations immediately prior.

“Users responded strongly to disfluent translations, but were, surprisingly, much less concerned with adequacy”

Of course, the participants were more or less laymen when it comes to MT and the language industry in general. “This unfamiliarity with both human translation and machine translation fits our expectations for typical users of MT for assimilation,” the paper reads. Among 89 participants, nearly 74.2% said they were “unfamiliar with human translation” (a concept not explained in more detail) while nearly 52.8% said they were unfamiliar with MT. So their degree of trust in MT output does not necessarily reflect the trust that linguists would give their MT providers.

However, the general concern over how much people trust MT naturally holds wider implications for language service providers (LSPs) and the overall development of MT. While translation quality can be a matter of life or death in areas like the life sciences, a recent study found that a significant portion of online consumers already rely on machine translation when making buying decisions.

The research team likewise tempered their findings by citing the inherent limitations of their pilot study—it used a relatively small sample size, the tests were limited in scale and scope, and there was a possible discrepancy in comprehension among participants, among others.

TAGS

machine translationneural machine translation
SHARE
Gino Diño

By Gino Diño

Content strategy expert and Online Editor for Slator; father, husband, gamer, writer―not necessarily in that order.

Advertisement

SUBSCRIBE TO THE SLATOR WEEKLY

Language Industry Intelligence
In Your Inbox. Every Friday

SUBSCRIBE

SlatorSweepSlatorPro
ResearchRFP CENTER

PUBLISH

PRESS RELEASEDIRECTORY LISTING
JOB ADEVENT LISTING

Bespoke advisory including speaking, briefings and M&A

SLATOR ADVISORY
Advertisement

Featured Reports

See all
Pro Guide: Translation Pricing and Procurement

Pro Guide: Translation Pricing and Procurement

by Slator

Slator 2020 Language Industry M&A and Funding Report

Slator 2020 Language Industry M&A and Funding Report

by Slator

Slator 2021 Data-for-AI Market Report

Slator 2021 Data-for-AI Market Report

by Slator

Slator 2020 Medtech Translation and Localization Report

Slator 2020 Medtech Translation and Localization Report

by Slator

Press Releases

See all
Smartling Announces Smartling+

Smartling Announces Smartling+

by Smartling

XTM Cloud 12.7 “Intelligent Connectivity” is Here

XTM Cloud 12.7 “Intelligent Connectivity” is Here

by XTM International

LocHub Announces QA Localization Solution For Multilingual Content Publishing Processes

LocHub Announces QA Localization Solution For Multilingual Content Publishing Processes

by Xillio

Upcoming Events

See All
  1. Smartling - Global Ready Conference 2021

    Global Ready Conference

    by Smartling

    · April 14

    When you can't traverse the world, let the world come to you. Join our annual global event from home.

    More info FREE

Featured Companies

See all
Sunyu Transphere

Sunyu Transphere

Text United

Text United

Memsource

Memsource

Wordbank

Wordbank

Protranslating

Protranslating

SeproTec

SeproTec

Versacom

Versacom

Smartling

Smartling

XTM International

XTM International

Translators without Borders

Translators without Borders

STAR Group

STAR Group

memoQ Translation Technologies

memoQ Translation Technologies

Advertisement

Popular articles

Google Translate Not Ready for Use in Medical Emergencies But Improving Fast — Study

Google Translate Not Ready for Use in Medical Emergencies But Improving Fast — Study

by Seyma Albarino

The Slator 2021 Language Service Provider Index

The Slator 2021 Language Service Provider Index

by Slator

DeepL Adds 13 European Languages as Traffic Continues to Surge

DeepL Adds 13 European Languages as Traffic Continues to Surge

by Marion Marking

SlatorPod: The Weekly Language Industry Podcast

connect with us

footer logo

Slator makes business sense of the language services and technology market.

Our Company

  • Support
  • About us
  • Terms & Conditions
  • Privacy Policy

Subscribe to the Slator Weekly

Language Industry Intelligence
In Your Inbox. Every Friday

© 2021 Slator. All rights reserved.

Sign up to the Slator Weekly

Join over 13,800 subscribers and get the latest language industry intelligence every Friday

Your information will never be shared with third parties. No Spam.