Praveen Meka, Christine Tsien Silvers, Bharath Gunapati, Qing Liu
{"title":"Measuring Accuracy of ConsultBot, Hybrid AI Tool, in Interpreting Blood Gas Results.","authors":"Praveen Meka, Christine Tsien Silvers, Bharath Gunapati, Qing Liu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p><b>Importance:</b> Arterial and venous blood gases are complex tests used in inpatient settings. While interpretation of blood gas results is algorithmic, it is time consuming and error prone when done manually. Our study measures the accuracy of ConsultBot, in automated interpretation of blood gases. <b>Objective:</b> To determine proportional accuracy of ConsultBot, using rule-based logic combined with a large language model (LLM), in interpreting blood gases. <b>Design:</b> ConsultBot was tested in an IRB-approved single-arm trial using a dataset of 101 blood gas results and compared with a predetermined answer key. The tool's performance was assessed using proportional accuracy, sensitivity, and Cohen's Kappa. <b>Results:</b> ConsultBot achieved a 98% (99/101)[CI 93%-100%] proportional accuracy across the study dataset. Sensitivity was 98%[CI 93%-99%]. Cohen's Kappa of 0.97 suggests high degree of agreement between ConsultBot's interpretations and answer key. <b>Conclusions:</b> ConsultBot's evaluation yielded promising results, demonstrating potential in clinical-decision support for blood gas interpretations.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"881-888"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919590/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147272996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"No Black Box Anymore: Demystifying Clinical Predictive Modeling with Temporal-Feature Cross Attention Mechanism.","authors":"Yubo Li, Xinyu Yao, Rema Padman","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Despite the outstanding performance of deep learning models in clinical prediction tasks, explainability remains a significant challenge. Inspired by transformer architectures, we introduce the Temporal-Feature Cross Attention Mechanism (TFCAM), a novel deep learning framework designed to capture dynamic interactions among clinical features across time, enhancing both predictive accuracy and interpretability. In an experiment with 1,422 patients with Chronic Kidney Disease, predicting progression to End-Stage Renal Disease, TFCAM outperformed LSTM and RE-TAIN baselines, achieving an AUROC of 0.95 and an F1-score of 0.69. Beyond performance gains, TFCAM provides multi-level explainability by identifying critical temporal periods, ranking feature importance, and quantifying how features influence each other across time before affecting predictions. Our approach addresses the \"black box\" limitations of deep learning in healthcare, offering clinicians transparent insights into disease progression mechanisms while maintaining state-of-the-art predictive performance.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"764-773"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919459/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shijia Zhang, Xiyu Ding, Kai Ding, Jacob Zhang, Kevin Galinsky, Mengrui Wang, Ryan P Mayers, Zheyu Wang, Hadi Kharrazi
{"title":"ProtoBERT-LoRA: Parameter-Efficient Prototypical Finetuning for Immunotherapy Study Identification.","authors":"Shijia Zhang, Xiyu Ding, Kai Ding, Jacob Zhang, Kevin Galinsky, Mengrui Wang, Ryan P Mayers, Zheyu Wang, Hadi Kharrazi","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Identifying immune checkpoint inhibitor (ICI) studies in genomic repositories like Gene Expression Omnibus (GEO) is vital for cancer research yet remains challenging due to semantic ambiguity, extreme class imbalance, and limited labeled data in low-resource settings. We present ProtoBERT-LoRA, a hybrid framework that combines PubMedBERT with prototypical networks and Low-Rank Adaptation (LoRA) for efficient fine-tuning. The model enforces class-separable embeddings via episodic prototype training while preserving biomedical domain knowledge. Our dataset was divided as: Training (20 positive, 20 negative), Prototype Set (10 positive, 10 negative), Validation (20 positive, 200 negative), and Test (71 positive, 765 negative). Evaluated on test dataset, ProtoBERT-LoRA achieved F1-score of 0.624 (precision: 0.481, recall: 0.887), outperforming the rule-based system, machine learning baselines and finetuned PubMedBERT. Application to 44,287 unlabeled studies reduced manual review efforts by 82%. Ablation studies confirmed that combining prototypes with LoRA improved performance by 29% over stand-alone LoRA.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1539-1548"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919447/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Snigdha Peddireddy, Shifan Yan, Sangmi Kim, Ran Xiao
{"title":"Intimate Partner Homicide Among Women of Childbearing Age: Identifying Multilevel Risk Factors with Machine Learning.","authors":"Snigdha Peddireddy, Shifan Yan, Sangmi Kim, Ran Xiao","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Intimate partner homicide (IPH) remains a major yet understudied cause of maternal mortality among U.S. women of childbearing age (WCBA). We leveraged the National Violent Death Reporting System (NVDRS) and county-level Maternal Vulnerability Index (MVI) data from 2018-2022 to train three machine learning models-logistic regression, random forest, and XGBoost-to classify whether homicides were IPH. Among 11,498 homicides involving WCBA, 33% were IPH. XGBoost achieved the best performance (F1-score = 0.83, AUPRC = 0.87), prompting further examination of key predictors via model explainability. Results indicated that acute interpersonal conflicts (e.g., arguments, jealousy), prior IPV victimization, and structural vulnerabilities (e.g., reproductive healthcare access, physical environment) were influential predictors of IPH. By illustrating the interplay of individual, interpersonal, and broader community-level risk factors, our study shows how machine learning can inform multilevel strategies to prevent IPH and improve maternal health.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1003-1012"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919425/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Halley Ruppel, Amina Khan, Rose Mintor, Jessica Nguyen, Meghan McNamara, Brooke Luo, Michelle Kelly, Kenrick Cato, Elizabeth B Froh
{"title":"Re-designing inpatient nursing notes shared with families: an opportunity to enhance family-centered care delivery.","authors":"Halley Ruppel, Amina Khan, Rose Mintor, Jessica Nguyen, Meghan McNamara, Brooke Luo, Michelle Kelly, Kenrick Cato, Elizabeth B Froh","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>This modified explanatory sequential mixed methods study sought to inform redesign of nursing notes in the electronic health record. In the context of OpenNotes and patient and family access to nursing notes via the inpatient portal, redesigning nursing notes offers an opportunity to enhance family-centered care delivery and reduce nurses' documentation burden. We analyzed data on note views via the inpatient portal for 258,841 nursing notes; annotated the contents of 100 nursing notes; and conducted interviews with 18 families and 8 nurses. Our findings support recommendations for more specific care plans, eliminating redundancies, and emphasizing nursing care and expertise otherwise absent from the patient chart. The results of this descriptive study lay the groundwork for pilot testing new nursing note structures.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1249-1257"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919541/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xueqing Peng, Brian Ondov, Huan He, Yan Hu, Hua Xu
{"title":"An Information Extraction Approach to Detecting Novelty of Biomedical Publications.","authors":"Xueqing Peng, Brian Ondov, Huan He, Yan Hu, Hua Xu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Scientific novelty plays a critical role in shaping research impact, yet it remains inconsistently defined and difficult to quantify. Existing approaches often reduce novelty to a single measure, failing to distinguish the specific types of contributions (such as new concepts or relationships) that drive influence. In this study, we introduce a semantic measure of novelty based on the emergence of new biomedical entities and relationships within the conclusion sections of research articles. Leveraging transformer-based named entity recognition (NER) and relation extraction (RE) tools, we identify novel findings and classify articles into four categories: No Novelty, Entity-only Novelty, Relation-only Novelty, and Entity-Relation Novelty. We evaluate this framework using citation counts and Journal Impact Factors (JIF) as proxies for research influence. Our results show that Entity-Relation Novelty articles receive the highest citation impact, with relation novelty more closely aligned with high-impact journals. These findings offer a scalable framework for assessing novelty and guiding future research evaluation.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1013-1022"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919535/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pengfei Zhang, Mohbat Fnu, Yutong Song, Oshani Seneviratne, Zhongqi Yang, Iman Azimi, Amir M Rahmani
{"title":"Adaptive Constraint Relaxation in Personalized Nutrition Recommendations: An LLM-Driven Knowledge Graph Retrieval Approach.","authors":"Pengfei Zhang, Mohbat Fnu, Yutong Song, Oshani Seneviratne, Zhongqi Yang, Iman Azimi, Amir M Rahmani","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Personalized food recommendation systems must balance various constraints, including medical guidelines, nutritional needs, and individual preferences. However, existing methods often struggle with overly restrictive queries, frequently failing to generate recommendations when no exact match exists. To address this challenge, we propose an adaptive knowledge graph (KG) retrieval framework that integrates Large Language Models (LLMs) for intelligent constraint relaxation. Our approach dynamically prioritizes constraints, ensuring that critical dietary requirements remain intact while selectively relaxing less essential ones. By leveraging LLM-driven constraint analysis and structured relaxation strategies, our system significantly enhances recommendation coverage without compromising key dietary needs, while maintaining optimal recommendation performance. Experimental results on both the original and the extended-constraint dataset demonstrate that our method successfully retrieves recommendations in cases where previous approaches fail, achieving higher retrieval accuracy and a balanced tradeoff between flexibility and adherence to dietary constraints. The code is public available at https://github.com/zpf0117b2/adaptiveRetrieval.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"1529-1538"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919543/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
David Le, Ramon Correa-Medero, Amara Tariq, Bhavik Patel, Motoyo Yano, Imon Banerjee
{"title":"Opportunistic Screening for Pancreatic Cancer using Computed Tomography Imaging and Radiology Reports.","authors":"David Le, Ramon Correa-Medero, Amara Tariq, Bhavik Patel, Motoyo Yano, Imon Banerjee","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Pancreatic ductal adenocarcinoma (PDAC) is a highly aggressive cancer, with most cases diagnosed at stage IV and a five-year overall survival rate below 5%. Early detection and prognosis modeling are crucial for improving patient outcomes and guiding early intervention strategies. In this study, we implemented and evaluated deep learning fusion models that integrate radiology reports and CT imaging to predict PDAC risk. The DeepSurv model achieved a concordance index (C-index) of 0.6773 (95% CI: 0.6484, 0.7061) and 0.6596 (95% CI: 0.6260, 0.6937) on the internal and external dataset, respectively, for 5-year survival risk estimation. Kaplan-Meier analysis demonstrated significant separation (p<0.0001) between the low and high risk groups predicted by the fusion model. These findings highlight the potential of deep learning-based survival models in leveraging clinical and imaging data for pancreatic cancer.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"663-672"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919558/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Facilitating Clinical Information Extraction with Synthetic Data and Ontology using Large Language Models.","authors":"Yan Hu, Huan He, Qingyu Chen, Xiaoqian Jiang, Kirk Roberts, Hua Xu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The rapid growth of unstructured clinical text in electronic health records necessitates robust information extraction systems, yet their development is hindered by the scarcity of high-quality annotated data. This study explores the potential of large language models to generate synthetic data for clinical named entity recognition and examines its impact on model performance. We propose a novel framework that integrates self-verified synthetic data generation with domain-specific semantic mapping using SNOMED-CT. By leveraging GPT-4o-mini for synthetic data creation and refining its quality through iterative verification and anomaly detection, we systematically evaluate the influence of synthetic data quality and quantity on fine-tuning LLaMA-3-8B. Experimental results across four datasets (MTSamples, UTP, MIMIC-III, and i2b2) demonstrate that self-verification and semantic mapping significantly enhance synthetic data utility, improving model generalizability. Our findings highlight the importance of balancing human-annotated and synthetic data, with a 1:1 ratio emerging as the optimal configuration for performance gains. This study advances clinical NLP by providing a scalable approach to mitigating annotation challenges while improving model performance.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"500-505"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919538/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273139","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Prospective Validation of a Suicide Event Risk Model in Transgender Patients.","authors":"Robert A Becker, Colin G Walsh","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Suicide risk prediction models offer a promising avenue for early intervention, but their effectiveness in underrepresented populations remain uncertain. This study evaluated VSAIL's, a real-world, externally validated, and deployed suicide risk prediction model, performance in predicting suicide risk among transgender individuals. Transgender individuals were identified from electronic health record data and transgender status was verified via manual chart review. Results indicated modest discriminative ability (AUROC=0.777, AUPRC=0.115), however, a high rate of false negatives (77%), and significant miscalibration (Brier=0.023, Spiegelhalter's z-statistic p<0.001) reduced clinical utility. Findings underscore the importance of targeted subgroup validation and highlight limitations of general population-trained models in accurately identifying suicide risk among transgender patients. They also suggest the need for ongoing algorithm monitoring and subgroup-aware modeling strategies to improve predictive equity in marginalized populations.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"196-201"},"PeriodicalIF":0.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919586/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147273138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}