Anay D Ravelo, Daniela G Carranza, Kaitlyn A Lutz, Wolfgang Heuwieser
{"title":"Evaluation of large language model performance in translating dairy-related content.","authors":"Anay D Ravelo, Daniela G Carranza, Kaitlyn A Lutz, Wolfgang Heuwieser","doi":"10.1093/tas/txag130","DOIUrl":null,"url":null,"abstract":"<p><p>Artificial intelligence's ability to translate dairy-related texts from English to Spanish has not been well described in agriculture. This study aimed to determine the accuracy and comprehensibility of dairy-related translated text generated with ChatGPT (GPT-4o) and to determine the text's appropriateness for a dairy employee. Eight dairy udder health and stockmanship-related English texts were gathered from extension and university websites for translation. Four texts were summaries of 260 words or less and the other four texts were procedure lists with 8 steps. The texts were translated with a large language model (ChatGPT-4o) and displayed in a side-by-side presentation. The presentations were sent to 23 reviewers with a rubric for evaluation of accuracy, comprehensibility, and perception of the translation. Additionally, the reviewers were asked to evaluate if the translations were suitable to be shared with dairy employees. Overall, reviewers \"Strongly agreed\" or \"Agreed\" that the texts were accurately translated, including technical terms, and that the main idea of the text was correctly reproduced. They also \"Strongly agreed\" or \"Agreed\" that the translation was easy to understand, flowed naturally, was clear and coherent, and there was consistent translation of phrases that were repeated. Additionally, reviewers believed that there were \"None\" or \"Few\" instances where the meaning of the text is unclear due to the translation. Finally, the reviewers mostly agreed that they would present the translations to dairy employees. Thus, ChatGPT (GPT-4o) can accurately and comprehensibly translate dairy-related text. However, it is important to still have oversight and review the output.</p>","PeriodicalId":23272,"journal":{"name":"Translational Animal Science","volume":"10 ","pages":"txag130"},"PeriodicalIF":1.9000,"publicationDate":"2026-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13553073/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Translational Animal Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/tas/txag130","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/1 0:00:00","PubModel":"eCollection","JCR":"Q3","JCRName":"AGRICULTURE, DAIRY & ANIMAL SCIENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Artificial intelligence's ability to translate dairy-related texts from English to Spanish has not been well described in agriculture. This study aimed to determine the accuracy and comprehensibility of dairy-related translated text generated with ChatGPT (GPT-4o) and to determine the text's appropriateness for a dairy employee. Eight dairy udder health and stockmanship-related English texts were gathered from extension and university websites for translation. Four texts were summaries of 260 words or less and the other four texts were procedure lists with 8 steps. The texts were translated with a large language model (ChatGPT-4o) and displayed in a side-by-side presentation. The presentations were sent to 23 reviewers with a rubric for evaluation of accuracy, comprehensibility, and perception of the translation. Additionally, the reviewers were asked to evaluate if the translations were suitable to be shared with dairy employees. Overall, reviewers "Strongly agreed" or "Agreed" that the texts were accurately translated, including technical terms, and that the main idea of the text was correctly reproduced. They also "Strongly agreed" or "Agreed" that the translation was easy to understand, flowed naturally, was clear and coherent, and there was consistent translation of phrases that were repeated. Additionally, reviewers believed that there were "None" or "Few" instances where the meaning of the text is unclear due to the translation. Finally, the reviewers mostly agreed that they would present the translations to dairy employees. Thus, ChatGPT (GPT-4o) can accurately and comprehensibly translate dairy-related text. However, it is important to still have oversight and review the output.
期刊介绍：
Translational Animal Science (TAS) is the first open access-open review animal science journal, encompassing a broad scope of research topics in animal science. TAS focuses on translating basic science to innovation, and validation of these innovations by various segments of the allied animal industry. Readers of TAS will typically represent education, industry, and government, including research, teaching, administration, extension, management, quality assurance, product development, and technical services. Those interested in TAS typically include animal breeders, economists, embryologists, engineers, food scientists, geneticists, microbiologists, nutritionists, veterinarians, physiologists, processors, public health professionals, and others with an interest in animal production and applied aspects of animal sciences.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
