JAMIA Open最新文献

{"title":"Multi-modal prediction of extracorporeal support-a resource intensive therapy, utilizing a large national database.","authors":"Daoyi Zhu, Bing Xue, Neel Shah, Philip Richard Orrin Payne, Chenyang Lu, Ahmed Sameh Said","doi":"10.1093/jamiaopen/ooae158","DOIUrl":"10.1093/jamiaopen/ooae158","url":null,"abstract":"<p><strong>Objective: </strong>Extracorporeal membrane oxygenation (ECMO) is among the most resource-intensive therapies in critical care. The COVID-19 pandemic highlighted the lack of ECMO resource allocation tools. We aimed to develop a continuous ECMO risk prediction model to enhance patient triage and resource allocation.</p><p><strong>Material and methods: </strong>We leveraged multimodal data from the National COVID Cohort Collaborative (N3C) to develop a hierarchical deep learning model, labeled \"PreEMPT-ECMO\" (Prediction, Early Monitoring, and Proactive Triage for ECMO) which integrates static and multi-granularity time series features to generate continuous predictions of ECMO utilization. Model performance was assessed across time points ranging from 0 to 96 hours prior to ECMO initiation, using both accuracy and precision metrics.</p><p><strong>Results: </strong>Between January 2020 and May 2023, 101 400 patients were included, with 1298 (1.28%) supported on ECMO. PreEMPT-ECMO outperformed established predictive models, including Logistic Regression, Support Vector Machine, Random Forest, and Extreme Gradient Boosting Tree, in both accuracy and precision at all time points. Model interpretation analysis also highlighted variations in feature contributions through each patient's clinical course.</p><p><strong>Discussion and conclusions: </strong>We developed a hierarchical model for continuous ECMO use prediction, utilizing a large multicenter dataset incorporating both static and time series variables of various granularities. This novel approach reflects the nuanced decision-making process inherent in ECMO initiation and has the potential to be used as an early alert tool to guide patient triage and ECMO resource allocation. Future directions include prospective validation and generalizability on non-COVID-19 refractory respiratory failure, aiming to improve patient outcomes.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 1","pages":"ooae158"},"PeriodicalIF":2.5,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11702361/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143024995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Trustworthiness of a machine learning early warning model in medical and surgical inpatients.","authors":"Pedro J Caraballo, Anne M Meehan, Karen M Fischer, Parvez Rahman, Gyorgy J Simon, Genevieve B Melton, Hojjat Salehinejad, Bijan J Borah","doi":"10.1093/jamiaopen/ooae156","DOIUrl":"10.1093/jamiaopen/ooae156","url":null,"abstract":"<p><strong>Objectives: </strong>In the general hospital wards, machine learning (ML)-based early warning systems (EWSs) can identify patients at risk of deterioration to facilitate rescue interventions. We assess subpopulation performance of a ML-based EWS on medical and surgical adult patients admitted to general hospital wards.</p><p><strong>Materials and methods: </strong>We assessed the scores of an EWS integrated into the electronic health record and calculated every 15 minutes to predict a composite adverse event (AE): all-cause mortality, transfer to intensive care, cardiac arrest, or rapid response team evaluation. The distributions of the First Score 3 hours after admission, the Highest Score at any time during the hospitalization, and the Last Score just before an AE or dismissal without an AE were calculated. The Last Score was used to calculate the area under the receiver operating characteristic curve (ROC-AUC) and the precision-recall curve (PRC-AUC).</p><p><strong>Results: </strong>From August 23, 2021 to March 31, 2022, 35 937 medical admissions had 2173 (6.05%) AE compared to 25 214 surgical admissions with 4984 (19.77%) AE. Medical and surgical admissions had significant different (<i>P</i> <.001) distributions of the First Score, Highest Score, and Last Score among those with an AE and without an AE. The model performed better in the medical group when compared to the surgical group, ROC-AUC 0.869 versus 0.677, and RPC-AUC 0.988 versus 0.878, respectively.</p><p><strong>Discussion: </strong>Heterogeneity of medical and surgical patients can significantly impact the performance of a ML-based EWS, changing the model validity and clinical discernment.</p><p><strong>Conclusions: </strong>Characterization of the target patient subpopulations has clinical implications and should be considered when developing models to be used in general hospital wards.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 1","pages":"ooae156"},"PeriodicalIF":2.5,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11702360/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143025075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Guidelines and standard frameworks for artificial intelligence in medicine: a systematic review.","authors":"Kirubel Biruk Shiferaw, Moritz Roloff, Irina Balaur, Danielle Welter, Dagmar Waltemath, Atinkut Alamirrew Zeleke","doi":"10.1093/jamiaopen/ooae155","DOIUrl":"10.1093/jamiaopen/ooae155","url":null,"abstract":"<p><strong>Objectives: </strong>The continuous integration of artificial intelligence (AI) into clinical settings requires the development of up-to-date and robust guidelines and standard frameworks that consider the evolving challenges of AI implementation in medicine. This review evaluates the quality of these guideline and summarizes ethical frameworks, best practices, and recommendations.</p><p><strong>Materials and methods: </strong>The Appraisal of Guidelines, Research, and Evaluation II tool was used to assess the quality of guidelines based on 6 domains: scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence. The protocol of this review including the eligibility criteria, the search strategy data extraction sheet and methods, was published prior to the actual review with International Registered Report Identifier of DERR1-10.2196/47105.</p><p><strong>Results: </strong>The initial search resulted in 4975 studies from 2 databases and 7 studies from manual search. Eleven articles were selected for data extraction based on the eligibility criteria. We found that while guidelines generally excel in scope, purpose, and editorial independence, there is significant variability in applicability and the rigor of guideline development. Well-established initiatives such as TRIPOD+AI, DECIDE-AI, SPIRIT-AI, and CONSORT-AI have shown high quality, particularly in terms of stakeholder involvement. However, applicability remains a prominent challenge among the guidelines. The result also showed that the reproducibility, ethical, and environmental aspects of AI in medicine still need attention from both medical and AI communities.</p><p><strong>Discussion: </strong>Our work highlights the need for working toward the development of integrated and comprehensive reporting guidelines that adhere to the principles of Findability, Accessibility, Interoperability and Reusability. This alignment is essential for fostering a cultural shift toward transparency and open science, which are pivotal milestone for sustainable digital health research.</p><p><strong>Conclusion: </strong>This review evaluates the current reporting guidelines, discussing their advantages as well as challenges and limitations.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 1","pages":"ooae155"},"PeriodicalIF":2.5,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11700560/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142932887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Implementing an inclusive digital health ecosystem for healthy aging: a case study on project SingaporeWALK.","authors":"Edmund Wei Jian Lee, Huanyu Bao, Navrag B Singh, Sai G S Pai, Ben Tan Phat Pham, Siva Subramaniam Sowmiya Meena, Yin-Leng Theng","doi":"10.1093/jamiaopen/ooae148","DOIUrl":"10.1093/jamiaopen/ooae148","url":null,"abstract":"<p><strong>Objective: </strong>To pilot a digital health technologies ecosystem known as project SingaporeWALK (<b>W</b>earables and <b>A</b>pps for <b>C</b>ommunity <b>L</b>iving and <b>K</b>nowledge) that build capacity in older adults, senior center managers, health coaches, and caregivers in using health technologies (eg, wearables, apps, exergames) collaboratively in a gamified way for active aging.</p><p><strong>Materials and methods: </strong>The SingaporeWALK ecosystem was set up through 3 initiatives: (1) co-developing technologies with stakeholders; (2) raising digital literacy and capacity building; and (3) cultivating community and intergenerational bonding for active aging through gamified technology use.</p><p><strong>Results: </strong>Significant improvements in older adults' self-reported physical and mental health post-intervention were observed.</p><p><strong>Discussion: </strong>The SingaporeWALK project demonstrated that digital health technologies, when designed with inclusivity and community engagement, could significantly empower active aging.</p><p><strong>Conclusion: </strong>This project underscored the necessity of a collective and community-centered approach to maximize the efficacy of digital health technologies to support older adults in active aging globally.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 1","pages":"ooae148"},"PeriodicalIF":2.5,"publicationDate":"2024-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11687969/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142915705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Algorithmic individual fairness and healthcare: a scoping review.","authors":"Joshua W Anderson, Shyam Visweswaran","doi":"10.1093/jamiaopen/ooae149","DOIUrl":"10.1093/jamiaopen/ooae149","url":null,"abstract":"<p><strong>Objectives: </strong>Statistical and artificial intelligence algorithms are increasingly being developed for use in healthcare. These algorithms may reflect biases that magnify disparities in clinical care, and there is a growing need for understanding how algorithmic biases can be mitigated in pursuit of algorithmic fairness. We conducted a scoping review on algorithmic individual fairness (IF) to understand the current state of research in the metrics and methods developed to achieve IF and their applications in healthcare.</p><p><strong>Materials and methods: </strong>We searched four databases: PubMed, ACM Digital Library, IEEE Xplore, and medRxiv for algorithmic IF metrics, algorithmic bias mitigation, and healthcare applications. Our search was restricted to articles published between January 2013 and November 2024. We identified 2498 articles through database searches and seven additional articles, of which 32 articles were included in the review. Data from the selected articles were extracted, and the findings were synthesized.</p><p><strong>Results: </strong>Based on the 32 articles in the review, we identified several themes, including philosophical underpinnings of fairness, IF metrics, mitigation methods for achieving IF, implications of achieving IF on group fairness and vice versa, and applications of IF in healthcare.</p><p><strong>Discussion: </strong>We find that research of IF is still in their early stages, particularly in healthcare, as evidenced by the limited number of relevant articles published between 2013 and 2024. While healthcare applications of IF remain sparse, growth has been steady in number of publications since 2012. The limitations of group fairness further emphasize the need for alternative approaches like IF. However, IF itself is not without challenges, including subjective definitions of similarity and potential bias encoding from data-driven methods. These findings, coupled with the limitations of the review process, underscore the need for more comprehensive research on the evolution of IF metrics and definitions to advance this promising field.</p><p><strong>Conclusion: </strong>While significant work has been done on algorithmic IF in recent years, the definition, use, and study of IF remain in their infancy, especially in healthcare. Future research is needed to comprehensively apply and evaluate IF in healthcare.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 1","pages":"ooae149"},"PeriodicalIF":2.5,"publicationDate":"2024-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11684587/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142907645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"<i>pyBioPortal</i>: a Python package for simplifying cBioPortal data access in cancer research.","authors":"Matteo Valerio, Alessandro Inno, Stefania Gori","doi":"10.1093/jamiaopen/ooae146","DOIUrl":"10.1093/jamiaopen/ooae146","url":null,"abstract":"<p><strong>Objectives: </strong>In recent years, the rise of big data and artificial intelligence has led to an increasing expansion of databases and web services in biomedical research. cBioPortal is one of the most widely used platforms for accessing cancer genomic and clinical data. The primary objective of this study was to develop a tool that simplifies programmatic interaction with cBioPortal's web service.</p><p><strong>Materials and methods: </strong>We developed the <i>pyBioPortal</i> Python package, which leverages the cBioPortal REST API to access genomic and clinical data. The retrieved data is returned as a Pandas DataFrame, a format widely used for data analysis in Python.</p><p><strong>Results: </strong><i>pyBioPortal</i> offers an efficient interface between the user and the cBioPortal database. The data is provided in formats conducive to further analysis and visualization, promoting workflows and improving reproducibility.</p><p><strong>Discussion: </strong>The development of <i>pyBioPortal</i> addresses the challenge of accessing and processing large volumes of biomedical data. By simplifying the interaction with the cBioPortal API and providing data in Pandas DataFrame format, <i>pyBioPortal</i> allows users to focus more on the analytical aspects rather than data extraction.</p><p><strong>Conclusion: </strong>This tool facilitates the retrieval of heterogeneous biological and clinical data in a standardized format, making it more accessible for analysis and enhancing the reproducibility of results in cancer informatics. Distributed as an open-source project, <i>pyBioPortal</i> is available to the broader bioinformatics community, promoting collaboration and advancing research in cancer genomics.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 1","pages":"ooae146"},"PeriodicalIF":2.5,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11671144/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142903754","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"xMEN: a modular toolkit for cross-lingual medical entity normalization.","authors":"Florian Borchert, Ignacio Llorca, Roland Roller, Bert Arnrich, Matthieu-P Schapranow","doi":"10.1093/jamiaopen/ooae147","DOIUrl":"10.1093/jamiaopen/ooae147","url":null,"abstract":"<p><strong>Objective: </strong>To improve performance of medical entity normalization across many languages, especially when fewer language resources are available compared to English.</p><p><strong>Materials and methods: </strong>We propose xMEN, a modular system for cross-lingual (x) medical entity normalization (MEN), accommodating both low- and high-resource scenarios. To account for the scarcity of aliases for many target languages and terminologies, we leverage multilingual aliases via cross-lingual candidate generation. For candidate ranking, we incorporate a trainable cross-encoder (CE) model if annotations for the target task are available. To balance the output of general-purpose candidate generators with subsequent trainable re-rankers, we introduce a novel rank regularization term in the loss function for training CEs. For re-ranking without gold-standard annotations, we introduce multiple new weakly labeled datasets using machine translation and projection of annotations from a high-resource language.</p><p><strong>Results: </strong>xMEN improves the state-of-the-art performance across various benchmark datasets for several European languages. Weakly supervised CEs are effective when no training data is available for the target task.</p><p><strong>Discussion: </strong>We perform an analysis of normalization errors, revealing that complex entities are still challenging to normalize. New modules and benchmark datasets can be easily integrated in the future.</p><p><strong>Conclusion: </strong>xMEN exhibits strong performance for medical entity normalization in many languages, even when no labeled data and few terminology aliases for the target language are available. To enable reproducible benchmarks in the future, we make the system available as an open-source Python toolkit. The pre-trained models and source code are available online: https://github.com/hpi-dhc/xmen.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 1","pages":"ooae147"},"PeriodicalIF":2.5,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11671143/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142903763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Designing a blockchain technology platform for enhancing the pre-exposure prophylaxis care continuum.","authors":"Anjum Khurshid, Daniel Toshio Harrell, Dennis Li, Camden Hallmark, Ladd Hanson, Nishi Viswanathan, Michelle Carr, Armand Brown, Marlene McNeese, Kayo Fujimoto","doi":"10.1093/jamiaopen/ooae140","DOIUrl":"10.1093/jamiaopen/ooae140","url":null,"abstract":"<p><strong>Objectives: </strong>Pre-exposure prophylaxis (PrEP) is a key biomedical intervention for ending the HIV epidemic in the United States, but its uptake is impeded by systemic barriers, including fragmented workflows and ineffective data coordination. This study aims to design PrEPLinker, a blockchain-based, client-centered platform to enhance care to address these challenges by improving care coordination and enabling clients to securely manage their identity and PrEP-related data.</p><p><strong>Materials and methods: </strong>Using Houston, Texas, as a use case, we conducted a needs assessment with PrEP collaborators to evaluate existing workflows and identify barriers in the PrEP care continuum. Based on these findings, we designed PrEPinker, a blockchain-based identity framework and digital wallet using self-sovereign identity and verifiable credentials (VCs). These features enable clients to securirely control their identity data and facilitate efficient, privacy-serving data sharing across PrEP service points, such as community testing sites, clinics, and pharmacies.</p><p><strong>Results: </strong>The needs assessment identified significant gaps in data exchange for PrEP referrals and follow-up appointments. In response, PrEPLinker was designed to incorporate decentralized identifiers-unique, secure digital identifiers that are not linked to any centralized authority-and VCs for ensuring seamless transfer of digital medical records. Preliminary usability testing with 15 participants showed that over 70% rated the interactive design positively, finding it easy to use, learn, and navigate without technical support. Additionally, more than 80% expressed confidence in using the blockchain based platform to manage sensitive health information securely.</p><p><strong>Discussion and conclusion: </strong>Blockchain technology offers a promising, client-centered solution for addressing systemic barriers in PrEP care by improving data cordination, security, and client control over personal health information. The design of PrEPLinker demorates the potential to streamline PrEP referrals, follow-up processes, and data managent. These advancements in data coordination and secruity could improve PrEP uptake and adherence, supporting efforts to reduce HIV transmission in Houston and beyond.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"7 4","pages":"ooae140"},"PeriodicalIF":2.5,"publicationDate":"2024-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11658693/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142865579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The FAIR database: facilitating access to public health research literature.","authors":"Zhixue Zhao, James Thomas, Gregory Kell, Claire Stansfield, Mark Clowes, Sergio Graziosi, Jeff Brunton, Iain James Marshall, Mark Stevenson","doi":"10.1093/jamiaopen/ooae139","DOIUrl":"10.1093/jamiaopen/ooae139","url":null,"abstract":"<p><strong>Objectives: </strong>In public health, access to research literature is critical to informing decision-making and to identify knowledge gaps. However, identifying relevant research is not a straightforward task since public health interventions are often complex, can have positive and negative impacts on health inequalities and are applied in diverse and rapidly evolving settings. We developed a \"living\" database of public health research literature to facilitate access to this information using Natural Language Processing tools.</p><p><strong>Materials and methods: </strong>Classifiers were identified to identify the study design (eg, cohort study or clinical trial) and relationship to factors that may be relevant to inequalities using the PROGRESS-Plus classification scheme. Training data were obtained from existing MEDLINE labels and from a set of systematic reviews in which studies were annotated with PROGRESS-Plus categories.</p><p><strong>Results: </strong>Evaluation of the classifiers showed that the study type classifier achieved average precision and recall of 0.803 and 0.930, respectively. The PROGRESS-Plus classification proved more challenging with average precision and recall of 0.608 and 0.534. The FAIR database uses information provided by these classifiers to facilitate access to inequality-related public health literature.</p><p><strong>Discussion: </strong>Previous work on automation of evidence synthesis has focused on clinical areas rather than public health, despite the need being arguably greater.</p><p><strong>Conclusion: </strong>The development of the FAIR database demonstrates that it is possible to create a publicly accessible and regularly updated database of public health research literature focused on inequalities. The database is freely available from https://eppi.ioe.ac.uk/eppi-vis/Fair.</p><p><strong>Netscc id number: </strong>NIHR133603.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"7 4","pages":"ooae139"},"PeriodicalIF":2.5,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11641844/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142830099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A dynamic customized electronic health record rule based clinical decision support tool for standardized adult intensive care metrics.","authors":"Eric W Cucchi, Joseph Burzynski, Nicholas Marshall, Bruce Greenberg","doi":"10.1093/jamiaopen/ooae143","DOIUrl":"10.1093/jamiaopen/ooae143","url":null,"abstract":"<p><strong>Objectives: </strong>Many routine patient care items should be reviewed at least daily for intensive care unit (ICU) patients. These items are often incompletely performed, and dynamic clinical decision support tools (CDSTs) may improve attention to these daily items. We sought to evaluate the accuracy of institutionalized electronic health record (EHR) based custom dynamic CDST to support 22 ICU rounding quality metrics across 7 categories (hypoglycemia, venothromboembolism prophylaxis, stress ulcer prophylaxis, mechanical ventilation, sedation, nutrition, and catheter removal).</p><p><strong>Design: </strong>The dynamic CDST evaluates patient characteristics and patient orders, then identifies gaps between active interventions and conditions with recommendations of evidence based clinical practice guidelines across 22 areas of care for each patient. The results of the tool prompt clinicians to address any identified care gaps. We completed a confusion matrix to assess the sensitivity, specificity, accuracy, positive predictive value (PPV), and negative predictive value (NPV) of the dynamic CDST and the individual metrics.</p><p><strong>Setting: </strong>Tertiary academic medical center and community hospital ICUs.</p><p><strong>Subject: </strong>Customized Clinical Decision Support Tool.</p><p><strong>Measurements and main results: </strong>The metrics were evaluated 1421 times over 484 patients. The overall accuracy of the entire dynamic CDST is 0.979 with a sensitivity of 0.979, specificity of 0.978, PPV 0.969, and NPV 0.986.</p><p><strong>Conclusions: </strong>A customized, EHR based dynamic CDST can be highly accurate. Integrating a comprehensive dynamic CDST into existing workflows could improve attention and actions related to routine ICU quality metrics.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"7 4","pages":"ooae143"},"PeriodicalIF":2.5,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11633943/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142814357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}