{"title":"Special Topic Burnout: An AI-Powered Strategy for Managing Patient Messaging Load and Reducing Burnout.","authors":"Stephon N Proctor, Greg Lawton, Shikha Sinha","doi":"10.1055/a-2576-0579","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study aims to evaluate the impact of using a large language model (LLM) for generating draft responses to patient messages in the electronic health record (EHR) system on clinicians and support staff workload and efficiency.</p><p><strong>Methods: </strong>We partnered with Epic Systems to implement OpenAI's ChatGPT 4.0 for responding to patient messages. A pilot study was conducted from August 2023 to July 2024 across 13 ambulatory specialties involving 323 participants, including clinicians and support staff. Data on draft utilization rates and message response times were collected and analyzed using statistical methods.</p><p><strong>Results: </strong>The overall mean generated draft utilization rate was 38%, with significant differences by role and specialty. Clinicians had a higher utilization rate (43%) than scheduling staff (33%). Draft message usage significantly reduced all users' message response time (13 seconds on average). Support staff experienced a more substantial and statistically significant time saving (23 seconds) compared to negligible time savings seen by clinicians (3 seconds). Variability in utilization rates and time savings was observed across different specialties.</p><p><strong>Conclusion: </strong>Implementing LLMs for drafting patient message replies can reduce response times and alleviate message burden. However, the effectiveness of AI-generated draft responses varies by clinical role and specialty, indicating the need for tailored implementations. Further development and personalization of AI (Artificial Intelligence) tools are recommended to maximize their utility and ensure safe and effective use in diverse clinical contexts.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2025-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Clinical Informatics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1055/a-2576-0579","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: This study aims to evaluate the impact of using a large language model (LLM) for generating draft responses to patient messages in the electronic health record (EHR) system on clinicians and support staff workload and efficiency.
Methods: We partnered with Epic Systems to implement OpenAI's ChatGPT 4.0 for responding to patient messages. A pilot study was conducted from August 2023 to July 2024 across 13 ambulatory specialties involving 323 participants, including clinicians and support staff. Data on draft utilization rates and message response times were collected and analyzed using statistical methods.
Results: The overall mean generated draft utilization rate was 38%, with significant differences by role and specialty. Clinicians had a higher utilization rate (43%) than scheduling staff (33%). Draft message usage significantly reduced all users' message response time (13 seconds on average). Support staff experienced a more substantial and statistically significant time saving (23 seconds) compared to negligible time savings seen by clinicians (3 seconds). Variability in utilization rates and time savings was observed across different specialties.
Conclusion: Implementing LLMs for drafting patient message replies can reduce response times and alleviate message burden. However, the effectiveness of AI-generated draft responses varies by clinical role and specialty, indicating the need for tailored implementations. Further development and personalization of AI (Artificial Intelligence) tools are recommended to maximize their utility and ensure safe and effective use in diverse clinical contexts.
期刊介绍:
ACI is the third Schattauer journal dealing with biomedical and health informatics. It perfectly complements our other journals Öffnet internen Link im aktuellen FensterMethods of Information in Medicine and the Öffnet internen Link im aktuellen FensterYearbook of Medical Informatics. The Yearbook of Medical Informatics being the “Milestone” or state-of-the-art journal and Methods of Information in Medicine being the “Science and Research” journal of IMIA, ACI intends to be the “Practical” journal of IMIA.