通过大型语言模型提高 USFDA 患者通信的可读性:概念验证研究。

IF 3.6 3区 医学 Q2 PHARMACOLOGY & PHARMACY
Kannan Sridharan, Gowri Sivaramakrishnan
{"title":"通过大型语言模型提高 USFDA 患者通信的可读性:概念验证研究。","authors":"Kannan Sridharan, Gowri Sivaramakrishnan","doi":"10.1080/17512433.2024.2363840","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The US Food and Drug Administration (USFDA) communicates new drug safety concerns through drug safety communications (DSCs) and medication guides (MGs), which often challenge patients with average reading abilities due to their complexity. This study assesses whether large language models (LLMs) can enhance the readability of these materials.</p><p><strong>Methods: </strong>We analyzed the latest DSCs and MGs, using ChatGPT 4.0© and Gemini© to simplify them to a sixth-grade reading level. Outputs were evaluated for readability, technical accuracy, and content inclusiveness.</p><p><strong>Results: </strong>Original materials were difficult to read (DSCs grade level 13, MGs 22). LLMs significantly improved readability, reducing the grade levels to more accessible readings (Single prompt - DSCs: ChatGPT 4.0© 10.1, Gemini© 8; MGs: ChatGPT 4.0© 7.1, Gemini© 6.5. Multiple prompts - DSCs: ChatGPT 4.0© 10.3, Gemini© 7.5; MGs: ChatGPT 4.0© 8, Gemini© 6.8). LLM outputs retained technical accuracy and key messages.</p><p><strong>Conclusion: </strong>LLMs can significantly simplify complex health-related information, making it more accessible to patients. Future research should extend these findings to other languages and patient groups in real-world settings.</p>","PeriodicalId":12207,"journal":{"name":"Expert Review of Clinical Pharmacology","volume":" ","pages":"731-741"},"PeriodicalIF":3.6000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing readability of USFDA patient communications through large language models: a proof-of-concept study.\",\"authors\":\"Kannan Sridharan, Gowri Sivaramakrishnan\",\"doi\":\"10.1080/17512433.2024.2363840\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>The US Food and Drug Administration (USFDA) communicates new drug safety concerns through drug safety communications (DSCs) and medication guides (MGs), which often challenge patients with average reading abilities due to their complexity. This study assesses whether large language models (LLMs) can enhance the readability of these materials.</p><p><strong>Methods: </strong>We analyzed the latest DSCs and MGs, using ChatGPT 4.0© and Gemini© to simplify them to a sixth-grade reading level. Outputs were evaluated for readability, technical accuracy, and content inclusiveness.</p><p><strong>Results: </strong>Original materials were difficult to read (DSCs grade level 13, MGs 22). LLMs significantly improved readability, reducing the grade levels to more accessible readings (Single prompt - DSCs: ChatGPT 4.0© 10.1, Gemini© 8; MGs: ChatGPT 4.0© 7.1, Gemini© 6.5. Multiple prompts - DSCs: ChatGPT 4.0© 10.3, Gemini© 7.5; MGs: ChatGPT 4.0© 8, Gemini© 6.8). LLM outputs retained technical accuracy and key messages.</p><p><strong>Conclusion: </strong>LLMs can significantly simplify complex health-related information, making it more accessible to patients. Future research should extend these findings to other languages and patient groups in real-world settings.</p>\",\"PeriodicalId\":12207,\"journal\":{\"name\":\"Expert Review of Clinical Pharmacology\",\"volume\":\" \",\"pages\":\"731-741\"},\"PeriodicalIF\":3.6000,\"publicationDate\":\"2024-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Review of Clinical Pharmacology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/17512433.2024.2363840\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/6/4 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"PHARMACOLOGY & PHARMACY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Review of Clinical Pharmacology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/17512433.2024.2363840","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/4 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"PHARMACOLOGY & PHARMACY","Score":null,"Total":0}
引用次数: 0

摘要

背景:美国食品和药物管理局(USFDA)通过药物安全通讯(DSCs)和用药指南(MGs)来传达新药安全问题,由于其复杂性,这些材料往往对阅读能力一般的患者构成挑战。本研究评估了大语言模型(LLM)能否提高这些材料的可读性:我们使用 ChatGPT 4.0© 和 Gemini© 分析了最新的 DSC 和 MG,将其简化为六年级的阅读水平。对输出结果的可读性、技术准确性和内容包容性进行了评估:结果:原始材料难以阅读(DSCs 年级为 13 级,MGs 为 22 级)。LLMs 大大提高了可读性,将年级降到了更容易阅读的水平(单一提示 - DSCs:ChatGPT 4.0© 10.1,Gemini© 8;MGs:ChatGPT 4.0© 7.1,Gemini© 6.5。多重提示 - DSCs:ChatGPT 4.0© 10.3、Gemini© 7.5;MGs:ChatGPT 4.0© 8、Gemini© 6.8)。LLM 输出保留了技术准确性和关键信息:LLM 可以大大简化复杂的健康相关信息,使患者更容易获得这些信息。未来的研究应将这些发现推广到现实世界中的其他语言和患者群体。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Enhancing readability of USFDA patient communications through large language models: a proof-of-concept study.

Background: The US Food and Drug Administration (USFDA) communicates new drug safety concerns through drug safety communications (DSCs) and medication guides (MGs), which often challenge patients with average reading abilities due to their complexity. This study assesses whether large language models (LLMs) can enhance the readability of these materials.

Methods: We analyzed the latest DSCs and MGs, using ChatGPT 4.0© and Gemini© to simplify them to a sixth-grade reading level. Outputs were evaluated for readability, technical accuracy, and content inclusiveness.

Results: Original materials were difficult to read (DSCs grade level 13, MGs 22). LLMs significantly improved readability, reducing the grade levels to more accessible readings (Single prompt - DSCs: ChatGPT 4.0© 10.1, Gemini© 8; MGs: ChatGPT 4.0© 7.1, Gemini© 6.5. Multiple prompts - DSCs: ChatGPT 4.0© 10.3, Gemini© 7.5; MGs: ChatGPT 4.0© 8, Gemini© 6.8). LLM outputs retained technical accuracy and key messages.

Conclusion: LLMs can significantly simplify complex health-related information, making it more accessible to patients. Future research should extend these findings to other languages and patient groups in real-world settings.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Expert Review of Clinical Pharmacology
Expert Review of Clinical Pharmacology PHARMACOLOGY & PHARMACY-
CiteScore
7.30
自引率
2.30%
发文量
127
期刊介绍: Advances in drug development technologies are yielding innovative new therapies, from potentially lifesaving medicines to lifestyle products. In recent years, however, the cost of developing new drugs has soared, and concerns over drug resistance and pharmacoeconomics have come to the fore. Adverse reactions experienced at the clinical trial level serve as a constant reminder of the importance of rigorous safety and toxicity testing. Furthermore the advent of pharmacogenomics and ‘individualized’ approaches to therapy will demand a fresh approach to drug evaluation and healthcare delivery. Clinical Pharmacology provides an essential role in integrating the expertise of all of the specialists and players who are active in meeting such challenges in modern biomedical practice.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信