A pragmatic assessment of Google translate for emergency department instructions Journal Article


Authors: Taira, B. R.; Kreger, V.; Orue, A.; Diamond, L. C.
Article Title: A pragmatic assessment of Google translate for emergency department instructions
Abstract: Background: Because many hospitals have no mechanism for written translation, ED providers resort to the use of automated translation software, such as Google Translate (GT) for patient instructions. A recent study of discharge instructions in Spanish and Chinese suggested that accuracy rates of Google Translate (GT) were high. Study Objective: To perform a pragmatic assessment of GT for the written translation of commonly used ED discharge instructions in seven commonly spoken languages. Methods: A prospective assessment of the accuracy of GT for 20 commonly used ED discharge instruction phrases, as evaluated by a convenience sample of native speakers of seven commonly spoken languages (Spanish, Chinese, Vietnamese, Tagalog, Korean, Armenian, and Farsi). Translations were evaluated using a previously validated matrix for scoring machine translation, containing 5-point Likert scales for fluency, adequacy, meaning, and severity, in addition to a dichotomous assessment of retention of the overall meaning. Results: Twenty volunteers evaluated 400 google translated discharge statements. Volunteers were 50% female and spoke Spanish (5), Armenian (2), Chinese (3), Tagalog (4), Korean (2), and Farsi (2). The overall meaning was retained for 82.5% (330/400) of the translations. Spanish had the highest accuracy rate (94%), followed by Tagalog (90%), Korean (82.5%), Chinese (81.7%), Farsi (67.5%), and Armenian (55%). Mean Likert scores (on a 5-point scale) were high for fluency (4.2), adequacy (4.4), meaning (4.3), and severity (4.3) but also varied. Conclusion: GT for discharge instructions in the ED is inconsistent between languages and should not be relied on for patient instructions. © 2021, The Author(s).
Keywords: adult; clinical article; prospective study; emergency ward; translation; communication barriers; convenience sample; human; male; female; article; likert scale; communication barrier; language services; machine translation
Journal Title: Journal of General Internal Medicine
Volume: 36
Issue: 11
ISSN: 0884-8734
Publisher: Springer  
Date Published: 2021-11-01
Start Page: 3361
End Page: 3365
Language: English
DOI: 10.1007/s11606-021-06666-z
PUBMED: 33674922
PROVIDER: scopus
PMCID: PMC8606479
DOI/URL:
Notes: Article -- Export Date: 1 December 2021 -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Lisa Cari Diamond
    73 Diamond