Impact of an Artificial Intelligence and Machine Learning Enhanced Electronic Health Record System on Quality Measures in Nursing Homes: A Difference-in-Differences Analysis
Meredith A. Barrett PhD , Angier Allen MA , Vy T. Vuong MPS , Daniel Zhu MSc , Allison J. Rainey MSN , Will M. McConnell PhD, JD , Abel N. Kho MD , Annette Salisbury BS , Dustin D. French PhD
{"title":"Impact of an Artificial Intelligence and Machine Learning Enhanced Electronic Health Record System on Quality Measures in Nursing Homes: A Difference-in-Differences Analysis","authors":"Meredith A. Barrett PhD , Angier Allen MA , Vy T. Vuong MPS , Daniel Zhu MSc , Allison J. Rainey MSN , Will M. McConnell PhD, JD , Abel N. Kho MD , Annette Salisbury BS , Dustin D. French PhD","doi":"10.1016/j.jamda.2025.105680","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><div>This study evaluated the impact of an electronic health record (EHR) system enhanced with artificial intelligence and machine learning (EHR+AI) on quality measures in nursing homes in the United States.</div></div><div><h3>Design</h3><div>A difference-in-differences (DiD) design was used to estimate the effect of the EHR+AI intervention on quality measures among nursing homes with and without the AI intervention. The intervention included a feature that analyzed 150 daily clinical data elements per patient, alerting staff to changes in conditions, acuity, fall risk, and medication monitoring.</div></div><div><h3>Setting and Participants</h3><div>The analysis included 218 nursing homes, with 94 using EHR+AI and 124 using EHR only. Baseline differences in organizational characteristics, acuity index, neighborhood affluence, and racial or ethnic composition were evaluated.</div></div><div><h3>Methods</h3><div>Eighteen quality measures from the Centers for Medicare and Medicaid Services (CMS) were analyzed over 6 quarters before and 5 quarters after EHR+AI implementation. A DiD approach with linear mixed effects models was used, adjusting for significantly different baseline characteristics.</div></div><div><h3>Results</h3><div>Statistically greater improvements were observed in 16 of 18 quality measures (89%) in EHR+AI sites, with 11 measures (61%) also meeting the parallel trends assumption. Notably, EHR+AI sites demonstrated larger improvements in functional status, including greater reductions in major falls (−9%, 95% CI –17, −1; <em>P</em> = .034) and residents needing help with daily activities (−22%, 95% CI –29, −15; <em>P</em> < .001), and a 5% larger increase in residents who made improvements in function (95% CI 2, 7; <em>P</em> = .001). Higher decline in depressive symptoms and the use of antipsychotic, antianxiety, or hypnotic medications were also noted. These results were observed among sites with higher patient acuity and neighborhood diversity.</div></div><div><h3>Conclusions and Implications</h3><div>These findings suggest that an EHR enhanced with AI can improve the quality and efficiency of care in nursing homes through real-time monitoring and response of resident assessment protocol triggers for clinical modification, but further research is needed.</div></div>","PeriodicalId":17180,"journal":{"name":"Journal of the American Medical Directors Association","volume":"26 7","pages":"Article 105680"},"PeriodicalIF":4.2000,"publicationDate":"2025-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Medical Directors Association","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1525861025001975","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives
This study evaluated the impact of an electronic health record (EHR) system enhanced with artificial intelligence and machine learning (EHR+AI) on quality measures in nursing homes in the United States.
Design
A difference-in-differences (DiD) design was used to estimate the effect of the EHR+AI intervention on quality measures among nursing homes with and without the AI intervention. The intervention included a feature that analyzed 150 daily clinical data elements per patient, alerting staff to changes in conditions, acuity, fall risk, and medication monitoring.
Setting and Participants
The analysis included 218 nursing homes, with 94 using EHR+AI and 124 using EHR only. Baseline differences in organizational characteristics, acuity index, neighborhood affluence, and racial or ethnic composition were evaluated.
Methods
Eighteen quality measures from the Centers for Medicare and Medicaid Services (CMS) were analyzed over 6 quarters before and 5 quarters after EHR+AI implementation. A DiD approach with linear mixed effects models was used, adjusting for significantly different baseline characteristics.
Results
Statistically greater improvements were observed in 16 of 18 quality measures (89%) in EHR+AI sites, with 11 measures (61%) also meeting the parallel trends assumption. Notably, EHR+AI sites demonstrated larger improvements in functional status, including greater reductions in major falls (−9%, 95% CI –17, −1; P = .034) and residents needing help with daily activities (−22%, 95% CI –29, −15; P < .001), and a 5% larger increase in residents who made improvements in function (95% CI 2, 7; P = .001). Higher decline in depressive symptoms and the use of antipsychotic, antianxiety, or hypnotic medications were also noted. These results were observed among sites with higher patient acuity and neighborhood diversity.
Conclusions and Implications
These findings suggest that an EHR enhanced with AI can improve the quality and efficiency of care in nursing homes through real-time monitoring and response of resident assessment protocol triggers for clinical modification, but further research is needed.
期刊介绍:
JAMDA, the official journal of AMDA - The Society for Post-Acute and Long-Term Care Medicine, is a leading peer-reviewed publication that offers practical information and research geared towards healthcare professionals in the post-acute and long-term care fields. It is also a valuable resource for policy-makers, organizational leaders, educators, and advocates.
The journal provides essential information for various healthcare professionals such as medical directors, attending physicians, nurses, consultant pharmacists, geriatric psychiatrists, nurse practitioners, physician assistants, physical and occupational therapists, social workers, and others involved in providing, overseeing, and promoting quality