Machine Translation in Patient-Centered Care: A Research Breakthrough
Research from the University of Texas MD Anderson Cancer Center has shed light on the potential of machine translation in patient-centered care. The study focuses on the ability to rapidly and inexpensively create accurate translations of English language patient-reported outcome measures (PROMs) to facilitate global uptake. The researchers explored the effectiveness of machine translation tools, including Generative Pretrained Transformer (GPT)-4, GPT-3.5, and Google Translate, in translating English versions of selected PROMs scales into various languages.
Key Takeaways:
- The study compared the translation quality of machine translation tools, including GPT-4, GPT-3.5, and Google Translate, in translating PROMs scales into six languages: Arabic, Vietnamese, Italian, Hungarian, Malay, and Dutch.
- The research found that machine translation tools can produce high-quality PROM translations, but substituting human translation with machine translation is not advisable at the current stage.
- The study used the Metrics for Evaluation of Translation with Explicit Ordering (METEOR) and Kruskal-Wallis test or analysis of variance to evaluate the translation quality.
- The findings suggest that large language models, such as GPT-4 and GPT-3.5, provide high-quality PROM translations to support human translations and reduce costs.
- The study emphasized the importance of human expertise in machine translation, especially in cases where high accuracy is crucial.
Statistics:
- The study translated PROMs scales into six languages: Arabic, Vietnamese, Italian, Hungarian, Malay, and Dutch.
- The research used Generative Pretrained Transformer (GPT)-4, GPT-3.5, and Google Translate as machine translation tools.
- The METEOR scores significantly varied depending on target languages for all MT tools (p-value < 0.01).
- The study compared the METEOR scores between different translation versions using the Kruskal-Wallis test or analysis of variance, as appropriate.
Sources:
- Can machine translation match human expertise? Quantifying the performance of large language models in the translation of patient-reported outcome measures (PROMs). Journal of Patient-Reported Outcomes, 2025, 9(1):1-11.
- University of Texas MD Anderson Cancer Center. Research by Sheng-Chieh Lu, Department of Symptom Research, University of Texas MD Anderson Cancer Center, and additional authors Cai Xu, Manraj Kaur, Maria Orlando Edelen, Andrea Pusic, Chris Gibbons.