Eesha Chakravartty, Jared Silberlust, Saul B Blecker, Yunan Zhao, Fariza Alendy, Heather Menzer, Aamina Ahmed, Simon Jones, Meg Ferrauiola, Jonathan Austrian
{"title":"Clinical Decision Support Leveraging Health Information Exchange Improves Concordance with Patients' Resuscitation Orders and End-of-Life Wishes.","authors":"Eesha Chakravartty, Jared Silberlust, Saul B Blecker, Yunan Zhao, Fariza Alendy, Heather Menzer, Aamina Ahmed, Simon Jones, Meg Ferrauiola, Jonathan Austrian","doi":"10.1055/a-2591-9040","DOIUrl":"10.1055/a-2591-9040","url":null,"abstract":"<p><p>This study aims to improve concordance between patient end-of-life preferences and code status orders by incorporating data from a state registry with clinical decision support (CDS) within the electronic health record (EHR) to preserve patient autonomy and ensure that patients receive care that aligns with their wishes.Leveraging a health information exchange (HIE) interface between the New York State Medical Orders for Life-Sustaining Treatment (eMOLST) registry and the EHR of our academic health system, we developed a bundled CDS intervention that displays eMOLST information at the time of code status ordering and provides an in-line alert when providers enter a resuscitation order discordant with wishes documented in the eMOLST registry. To evaluate this intervention, we performed a segmented regression analysis of an interrupted time series to compare the percentage of discordant orders before and after implementation among all hospitalizations for which an eMOLST was available.We identified a total of 3,648 visits that had an eMOLST filed prior to inpatient admission and a code status order placed during admission. There was a statistically significant decrease of discordant resuscitation orders of -5.95% after the intervention went live, with a relative risk reduction of 25% (95% CI: -9.95%, -1.94%; <i>p</i> = 0.009) in the pre- and post-intervention period. Logistic regression model after adjusting for covariates showed an average marginal effect of -5.12% after the intervention (CI: -9.75%, -0.50%; <i>p</i> = 0.03).Our intervention resulted in a decrease in discordant resuscitation orders. This study demonstrates that accessibility to eMOLST data within the provider workflow supported by CDS can reduce discrepancies between patient end-of-life wishes and hospital code status orders.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"943-950"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12396902/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144055133","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An AI-Powered Strategy for Managing Patient Messaging Load and Reducing Burnout.","authors":"Stephon Proctor, Greg Lawton, Shikha Sinha","doi":"10.1055/a-2576-0579","DOIUrl":"10.1055/a-2576-0579","url":null,"abstract":"<p><p>This study aims to evaluate the impact of using a large language model (LLM) for generating draft responses to patient messages in the electronic health record (EHR) system on clinicians and support staff workload and efficiency.We partnered with Epic Systems to implement OpenAI's ChatGPT 4.0 for responding to patient messages. A pilot study was conducted from August 2023 to July 2024 across 13 ambulatory specialties involving 323 participants, including clinicians and support staff. Data on draft utilization rates and message response times were collected and analyzed using statistical methods.The overall mean generated draft utilization rate was 38%, with significant differences by role and specialty. Clinicians had a higher utilization rate (43%) than scheduling staff (33%). Draft message usage significantly reduced all users' message response time (13 seconds on average). Support staff experienced a more substantial and statistically significant time saving (23 seconds) compared to negligible time savings seen by clinicians (3 seconds). Variability in utilization rates and time savings was observed across different specialties.Implementing LLMs for drafting patient message replies can reduce response times and alleviate message burden. However, the effectiveness of artificial intelligence (AI)-generated draft responses varies by clinical role and specialty, indicating the need for tailored implementations. Further investigation into this variability, and development and personalization of AI tools are recommended to maximize their utility and ensure safe and effective use in diverse clinical contexts.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"747-752"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12328029/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143812760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Real-World Challenges of Using Assisted Living Technologies across Different Australian Aged Care Settings: A Qualitative Study of User Experiences.","authors":"Nida Afzal, Amy D Nguyen, Annie Lau","doi":"10.1055/a-2591-4016","DOIUrl":"https://doi.org/10.1055/a-2591-4016","url":null,"abstract":"<p><p>Aging populations strain health care systems. Assisted Living Technologies (ALTs) emerge as a potential solution for promoting independent living among older adults. However, the real-world effect of ALTs remains unclear.This study explores benefits and challenges (anticipated and unanticipated) of ALTs for older adults and informal caregivers across three aged care settings (residential aged care facilities [RACFs], retirement villages [RVs], and home-dwelling communities [HDCs]) in Australia.Three ALTs (fall detection sensors, sleep monitors, and smartwatches) were deployed across three settings. NASSS framework (Non-adoption, Abandonment, Scale-up, Spread, and Sustainability), informed by sociotechnical theories, guided analysis of the interplay between technology, user needs, and caregiving context in ALTs implementation. Semistructured interviews with 14 older adults and 9 caregivers from 19 households explored user experiences. Benefits and challenges of using ALTs for older adults and informal caregivers were categorized using the consequences framework.Setting-specific challenges alongside common benefits and challenges across care settings were revealed. The NASSS framework analysis showed how technology limitations, user needs, and caregiving context influenced these outcomes. In RACFs, where residents receive constant nursing assistance, informal caregivers faced uncertainty regarding who was responsible for monitoring residents. In RVs, with a strong sense of community, informal caregivers (often neighbors) were more prone to overreacting to false alarms. Shared sleeping arrangements among HDCs made interpreting sleep data challenging.Implementing ALTs in elderly care settings requires a context-sensitive approach. In RACFs, clear role definitions for informal caregivers and staff are essential. For RVs, design should support help-seeking aligned with residents' social and geographical contexts. Home-dwelling settings may benefit from advanced sleep monitoring tailored to shared living arrangements. Future ALTs development should focus on real-world contexts to promote successful aging in place.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"930-942"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12396903/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144975501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bryan A Sisk, Alison Antes, Christine Bereitschaft, Fabienne Bourgeois, James M DuBois
{"title":"Parental Access to Adolescent Online Healthcare Portals: Benefits, Problems, and Barriers.","authors":"Bryan A Sisk, Alison Antes, Christine Bereitschaft, Fabienne Bourgeois, James M DuBois","doi":"10.1055/a-2605-4893","DOIUrl":"10.1055/a-2605-4893","url":null,"abstract":"<p><p>Online healthcare portals provide access to electronic health information and support clinical communication. Almost no studies have examined perspectives on parental portal access. We aimed to characterize parental and adolescent perspectives on parental portal access.Semi-structured interviews with 51 dyads of parents and adolescents (102 total interviews). We stratified sampling for equal proportions of adolescents with and without chronic illnesses. We analyzed interview transcripts using thematic analysis.Parents and adolescents identified several benefits of parental portal access: improving understanding and access to information; supporting parents in managing adolescents' health and logistics; and supporting parents in teaching adolescents about their health. Parents and adolescents identified the following problems: threatening the adolescent's privacy; creating or exacerbating tension within the family; struggling to understand medical information; and creating emotional distress for parents. Parents described the following barriers to portal use: difficulties with enrollment and maintaining access; interface challenges; lack of awareness; and lack of interest. Some parents preferred to maintain access after their child was legally an adult. Although the portal has the potential to support collaborative care management between parents and adolescents, few parents use this tool collaboratively with their adolescents. Parents and adolescents identified multiple benefits, problems, and barriers to parents accessing the adolescent portal. Parents need sufficient access to health-related information in the portal to help them manage their adolescent's health and illness, especially for adolescents with chronic illness. Future efforts could better leverage the portal as a way of supporting collaboration in care between parents and adolescents.Portals offer several potential benefits to parents and adolescents. However, these benefits are impeded by technological limitations and lack of engagement of the adolescent.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1208-1218"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473516/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144032795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eduardo R Osegueda, Ben Webber, Tanvi Mehta, Deborah L Pestka, Joseph S Koopmeiners, Ivana Ninkovic, Genevieve B Melton, Timothy J Beebe, Michael G Usher
{"title":"Lessons Learned from Sepsis Microlearning Intervention.","authors":"Eduardo R Osegueda, Ben Webber, Tanvi Mehta, Deborah L Pestka, Joseph S Koopmeiners, Ivana Ninkovic, Genevieve B Melton, Timothy J Beebe, Michael G Usher","doi":"10.1055/a-2677-6012","DOIUrl":"10.1055/a-2677-6012","url":null,"abstract":"<p><p>Improving early recognition and treatment of sepsis is key to decreasing patient mortality. A large academic health system implemented several quality improvement initiatives, yet monthly compliance with sepsis best practices remained low.Develop and evaluate an electronic health record (EHR)-embedded microlearning intervention to address suboptimal adherence to sepsis care best practices.We conducted a randomized stepped-wedge trial of our microlearning intervention with randomization done at the nursing block level. Antibiotic delay and secondary outcomes extracted from the EHR were analyzed using mixed models to account for intracluster correlation.The microlearning intervention did not reduce antibiotic delay (mean difference = 0.71 hours; <i>p</i> = 0.49). Despite the alert firing over 30,000 times during the study period, the microlearning intervention was viewed only a total of 30 times.Our microlearning intervention did not improve sepsis care outcomes. We believe that although the content addressed key knowledge gaps, delivering the intervention through disruptive EHR alerts was not an accessible delivery channel to the nursing staff we targeted.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"1165-1171"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473517/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145179792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Donald S Wright, Naga S Kanaparthy, Edward R Melnick, Deborah R Levy, Stephen J Huot, Allen Hsiao, Lee H Schwamm, Shawn Y Ong
{"title":"The Effect of Ambient Artificial Intelligence Scribes on Trainee Documentation Burden.","authors":"Donald S Wright, Naga S Kanaparthy, Edward R Melnick, Deborah R Levy, Stephen J Huot, Allen Hsiao, Lee H Schwamm, Shawn Y Ong","doi":"10.1055/a-2647-1142","DOIUrl":"10.1055/a-2647-1142","url":null,"abstract":"<p><p>Ambient artificial intelligence scribes have become widespread commercial products in the era of generative artificial intelligence. While studies have examined the effect of these tools on the experience of attending physicians, little evidence is available regarding their use by resident physician trainees.To assess trainee experience with an ambient artificial intelligence scribe using measures of usability, acceptability, and documentation burden.This prospective observational study enrolled 47 trainees in a 2-month pilot. Pre/postsurveys were conducted with the NASA Task Load Index (NASA-TLX, raw unweighted form, pre/post, for cognitive load during the documentation), the System Usability Scale (post; general usability), the Net Promoter Score (post; acceptability), and the AMIA TrendBurden Survey (pre/post; documentation burden). Electronic health record utilization metrics were obtained from Epic Signal for both the pilot period and a 6-month baseline.In total, 43/47 (91.5%) of participants adopted the intervention in practice. NASA-TLX scores improved from 56.3 to 43.3 (<i>p</i> < 0.001), and multiple items on the TrendBurden survey improved with high measures of acceptability. No significant difference in time spent on notes activity per note written was observed, with a median increase of 0.4 minutes (<i>p</i> = 0.568).Trainee use of an ambient artificial intelligence scribe was associated with improvements in documentation burden. Additional research on the effect of this technology on trainee learning and expertise development is needed.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"872-878"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12367366/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144555398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Elham H Othman, Wasem I Al Haj, Mohammad R Alosta, Yousef Qan'Ir, Mohannad Eid Aburuz, Wesam Taher Almagharbeh
{"title":"Better Attitudes toward Cybersecurity and Greater Self-Control Predict Lower Risky Online Behaviors among Nurses.","authors":"Elham H Othman, Wasem I Al Haj, Mohammad R Alosta, Yousef Qan'Ir, Mohannad Eid Aburuz, Wesam Taher Almagharbeh","doi":"10.1055/a-2699-9179","DOIUrl":"10.1055/a-2699-9179","url":null,"abstract":"<p><p>The current study examined the moderating effect of self-control on the relationship between attitudes toward cybersecurity and risky online behaviors among direct care nurses.A cross-sectional study collected data from 260 direct care nurses in Saudi Arabia using a self-reported questionnaire. Hierarchical multiple regression analysis and simple slope analysis examined the moderation effect of self-control on the relationship between attitudes toward cybersecurity and risky online behaviors.We found that a better attitude toward cybersecurity and greater self-control predicted lower risky online behaviors. Simple slope tests revealed a significant negative association between attitude toward cybersecurity and risky online behaviors at low levels of self-control, but this association disappears at high levels of self-control, meaning that high levels of self-control have a protective/moderating effect on the relationship between attitude toward cybersecurity and risky online behaviors.Self-control moderates the effect of attitudes on online practices. The negative attitudes' influence on risky online behaviors is stronger when self-control is low. On the other hand, at high levels of self-control, individuals may engage in safer practices regardless of their attitudes.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"1310-1318"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12507492/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145253306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Safa Elkefi, Tiffany R Martinez, Talia Nadel, Antoinette M Schoenthaler, Devin M Mann, Saul Blecker
{"title":"Lessons Learned from the Usability Assessment of an EHR-Based Tool to Support Adherence to Antihypertensive Medications.","authors":"Safa Elkefi, Tiffany R Martinez, Talia Nadel, Antoinette M Schoenthaler, Devin M Mann, Saul Blecker","doi":"10.1055/a-2576-1596","DOIUrl":"10.1055/a-2576-1596","url":null,"abstract":"<p><p>Uncontrolled hypertension is common and frequently related to inadequate adherence to prescribed medications, resulting in suboptimal blood pressure control and increased healthcare utilization. Although healthcare providers have the opportunity to improve medication adherence, they may lack the tools to address adherence at the point of care. This study aims to assess the usability of a digital tool designed to improve medication adherence and blood pressure control among patients with hypertension who are not adherent to therapy. By evaluating usability, the study seeks to refine the tool's design, underscore the role of technology in managing hypertension, and provide insights to inform clinical decisions.We performed qualitative usability testing of an electronic health record (EHR)-integrated intervention with medical assistants (MAs) and primary care providers (PCPs) from a large integrated health system. Usability was assessed with these end-users using the \"think aloud\" and \"near live\" approaches. This evaluation was guided by two frameworks: the End-User Computing Satisfaction Index (EUCSI) and the Technology Acceptance Model (TAM). Interviews were analyzed using a thematic analysis approach.Thematic saturation was reached after usability testing was performed with 10 participants, comprising 5 PCPs and 5 MAs. The study identified several strengths within the content, format, ease of use, timeliness, accuracy, and usefulness of the tool, including the user-friendly content presentation, the usefulness of adherence information, and timely alerts that fit into the workflow. Challenges centered around alert visibility and specificity of information.Leveraging the two conceptual frameworks (TAM and EUCSI) to test the usability of the medication adherence tool was helpful. The tool's several strengths and opportunities for improvement were found. The resulting suggestions will be used to support the enhancement of the design for optimal implementation in a clinical trial.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"760-768"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12352985/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144856732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jonathan M Beus, Mark Mai, Nikolay P Braykov, Swaminathan Kandaswamy, Edwin Ray, David B Cundiff, Paulette Djachechi, Sarah Thompson, Azade Tabaie, Ryan Birmingham, Rishi Kamaleswaran, Evan Orenstein
{"title":"Performance Degradation between Development and Deployment of a Predictive Model for Central Line-Associated Bloodstream Infections in Hospitalized Children.","authors":"Jonathan M Beus, Mark Mai, Nikolay P Braykov, Swaminathan Kandaswamy, Edwin Ray, David B Cundiff, Paulette Djachechi, Sarah Thompson, Azade Tabaie, Ryan Birmingham, Rishi Kamaleswaran, Evan Orenstein","doi":"10.1055/a-2605-1847","DOIUrl":"10.1055/a-2605-1847","url":null,"abstract":"<p><p>Central line-associated bloodstream infections (CLABSIs) are associated with substantial pediatric morbidity and mortality. The capacity to predict which children with central lines are at greatest risk of CLABSI could inform surveillance and prevention efforts. Our team previously published <i>in silico</i> predictive models for CLABSI.To prospectively implement a pediatric CLABSI predictive model and achieve adequate performance in offline validation for implementation in clinical practice.Most performant predictive models were deep learning models requiring substantial pre-processing of many features into 8-hour windows including the current day and up to 56 days prior for the current admission. To replicate this pre-processing, we created a novel infrastructure to (1) organize current-day data for all the relevant features and (2) create a staged historical data store for those same features with application programming interfaces to connect the two. We compared predictive performance of these scores for CLABSI in the next 48 hours with two labels, one based on manual review of positive blood cultures in children with central lines and another based on positive blood culture and receipt of at least 4 days of new IV antibiotics.The area under the receiver-operating characteristic (AUROC) fell from 0.97 from retrospective data to <0.60 despite multiple iterations of troubleshooting. Primary root causes included train/serve skew, feature leakage, and overfitting. Hypothesized secondary drivers were complex model specification, poor data governance, inadequate testing, challenging feature translation between real-time and historical data models, limited monitoring and logging infrastructure for troubleshooting, and suboptimal handoff between the model development and deployment teams.Bridging the gap from predictive model development to clinical deployment requires early and close coordination between data governance, data science, clinical informatics, and implementation engineers. Balancing predictive performance with implementation feasibility can accelerate the adoption of predictive clinical decision support systems.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1192-1199"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473521/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144035943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rachel Y Lee, Kenrick D Cato, Patricia C Dykes, Graham Lowenthal, Haomiao Jia, Temiloluwa Daramola, Sarah C Rossetti
{"title":"Evaluating Equity in Usage and Effectiveness of the CONCERN Early Warning System.","authors":"Rachel Y Lee, Kenrick D Cato, Patricia C Dykes, Graham Lowenthal, Haomiao Jia, Temiloluwa Daramola, Sarah C Rossetti","doi":"10.1055/a-2630-4192","DOIUrl":"10.1055/a-2630-4192","url":null,"abstract":"<p><p>The CONCERN Early Warning System (CONCERN EWS) is an artificial intelligence-based clinical decision support system (AI-CDSS) for the prediction of clinical deterioration, leveraging signals from nursing documentation patterns. While a recent multisite randomized controlled trial (RCT) demonstrated its effectiveness in reducing inpatient mortality and length of stay, evaluating implementation outcomes is essential to ensure equitable results across patient populations.This study aims to (1) assess whether clinicians' usage of the CONCERN EWS, as measured by CONCERN Detailed Prediction Screen launches, varied by patient demographic characteristics, including sex, race, ethnicity, and primary language; (2) evaluate whether CONCERN EWS's effectiveness in reducing the risk of in-hospital mortality varied across patient demographic groups.We conducted a retrospective observational analysis of electronic health record log files and clinical outcomes from a multisite, pragmatic, cluster-RCT involving four hospitals across two health care systems. Equity in usage was assessed by comparing CONCERN Detailed Prediction Screen launches across demographic groups, and effectiveness was examined by comparing the risk of in-hospital mortality between intervention and usual care groups using Cox proportional hazards models adjusted for patient characteristics.Clinicians' CONCERN Detailed Prediction Screen launches did not significantly differ by patients' demographic characteristics, suggesting equitable usage. The CONCERN EWS was significantly associated with reduced risk of in-hospital mortality overall (adjusted hazard ratio [HR] = 0.644, 95% CI: 0.532-0.778, <i>p</i> < 0.0001), with consistent effectiveness across most groups. Notably, patients whose primary language was not English experienced a greater reduction of mortality risk compared to patients whose primary language was English (adjusted HR = 0.419, 95% CI: 0.287-0.610, <i>p</i> = 0.0082).This study presents a case of evaluating equity in AI-CDSS usage and effectiveness, contributing to the limited literature. While findings suggest equitable engagement and effectiveness, ongoing evaluations are needed to understand the observed variability and ensure responsible implementation.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"838-847"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12349966/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144267694","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}