Computerized Medical Imaging and Graphics最新文献

筛选
英文 中文
Learning geometric and visual features for medical image segmentation with vision GNN 基于视觉GNN的医学图像分割的几何和视觉特征学习。
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-02-03 DOI: 10.1016/j.compmedimag.2026.102720
Xinhong Li , Geng Chen , Yuanfeng Wu , Haotian Jiang , Tao Zhou , Yi Zhou , Wentao Zhu
{"title":"Learning geometric and visual features for medical image segmentation with vision GNN","authors":"Xinhong Li ,&nbsp;Geng Chen ,&nbsp;Yuanfeng Wu ,&nbsp;Haotian Jiang ,&nbsp;Tao Zhou ,&nbsp;Yi Zhou ,&nbsp;Wentao Zhu","doi":"10.1016/j.compmedimag.2026.102720","DOIUrl":"10.1016/j.compmedimag.2026.102720","url":null,"abstract":"<div><div>As a fundamental task, medical image segmentation plays a crucial role in various clinical applications. In recent years, deep learning-based segmentation methods have achieved significant success. However, these methods typically represent the image and objects within it as grid-structural data, while insufficient attention is given to relationships between the objects to segment. To address this issue, we propose a novel model called MedSegViG, which consists of a hierarchical encoder based on Vision GNN (ViG) and a hybrid feature decoder. During the segmentation process, our model first represents the image as a graph and then utilizes the encoder to extract multi-level graph features and image features. Finally, our hybrid feature decoder fuses these features to generate the final segmentation map. To validate the effectiveness of the proposed model, we conducted extensive experiments on six datasets across three types of lesions: polyps, skin lesions, and retinal vessels. The results demonstrate that MedSegViG achieves superior segmentation accuracy, robustness, and generalizability.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102720"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146144542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A deep learning-based automated pipeline for colorectal cancer detection in contrast-enhanced CT images 一种基于深度学习的自动管道,用于对比增强CT图像中的结直肠癌检测。
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-01-26 DOI: 10.1016/j.compmedimag.2026.102717
Chenhui Qiu , Sarah Miller , Barathi Subramanian , Angela Ryu , Haiyu Zhang , George A. Fisher , Nigam H. Shah , John Mongan , Curtis Langlotz , Peter Poullos , Jeanne Shen
{"title":"A deep learning-based automated pipeline for colorectal cancer detection in contrast-enhanced CT images","authors":"Chenhui Qiu ,&nbsp;Sarah Miller ,&nbsp;Barathi Subramanian ,&nbsp;Angela Ryu ,&nbsp;Haiyu Zhang ,&nbsp;George A. Fisher ,&nbsp;Nigam H. Shah ,&nbsp;John Mongan ,&nbsp;Curtis Langlotz ,&nbsp;Peter Poullos ,&nbsp;Jeanne Shen","doi":"10.1016/j.compmedimag.2026.102717","DOIUrl":"10.1016/j.compmedimag.2026.102717","url":null,"abstract":"<div><div>Colorectal cancer (CRC) is the third most commonly diagnosed malignancy worldwide and a leading cause of cancer-related mortality. This study aims to investigate an automatic detection pipeline for identification and localization of the primary CRC in portal venous phase contrast-enhanced CT scans, which is a crucial first step for downstream CRC staging, prognostication, and treatment planning. We propose a deep learning-based automated detection pipeline using YOLOv11 as the baseline architecture. A ResNet50 module was incorporated into the YOLOv11 backbone to enhance image feature extraction. Additionally, a scale-adaptive loss function, which introduces an adaptive coefficient and a scaling factor to adaptively measure the Intersection over Union (IoU) and center point distance for improving box regression performance, was designed to further improve detection performance. The proposed pipeline achieved a recall of 0.8092, precision of 0.8187, and F-1 score of 0.8139 for CRC detection on our in-house dataset at the patient level (inter-patient evaluation) and a recall of 0.9949, precision of 0.9894, and F-1 score of 0.9921 at the slice level (intra-patient evaluation). Validation on an external public dataset demonstrated that our pipeline, when trained on a patient-level in-house dataset, obtained a recall of 0.8283, precision of 0.8414, and F-1 score of 0.8348 and, when trained on a slice-level in-house dataset, achieved a recall of 0.6897, precision of 0.7888, and F-1 score of 0.7358, outperforming existing representative detection methods. The superior CRC detection performance on the in-house CT dataset and state-of-the-art generalization performance on the public dataset (with a 31.97 %age point improvement in detection sensitivity (recall) over the next closest state-of-the-art method), highlight the potential translational value of our pipeline for CRC clinical decision support, conditional upon validation in larger cohorts.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102717"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146114709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
XGeM: A multi-prompt foundation model for multimodal medical data generation XGeM:用于多模式医疗数据生成的多提示基础模型。
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-01-30 DOI: 10.1016/j.compmedimag.2026.102718
Daniele Molino , Francesco Di Feola , Eliodoro Faiella , Deborah Fazzini , Domiziana Santucci , Linlin Shen , Valerio Guarrasi , Paolo Soda
{"title":"XGeM: A multi-prompt foundation model for multimodal medical data generation","authors":"Daniele Molino ,&nbsp;Francesco Di Feola ,&nbsp;Eliodoro Faiella ,&nbsp;Deborah Fazzini ,&nbsp;Domiziana Santucci ,&nbsp;Linlin Shen ,&nbsp;Valerio Guarrasi ,&nbsp;Paolo Soda","doi":"10.1016/j.compmedimag.2026.102718","DOIUrl":"10.1016/j.compmedimag.2026.102718","url":null,"abstract":"<div><div>The adoption of Artificial Intelligence in medical imaging holds great promise, yet it remains hindered by challenges such as data scarcity, privacy concerns, and the need for robust multimodal integration. While recent advances in generative modeling have enabled high-quality synthetic data generation, existing approaches are often limited to unimodal, unidirectional synthesis and therefore lack the ability to jointly synthesize multiple modalities while preserving clinical consistency. To address this challenge, we introduce XGeM, a 6.77-billion-parameter multimodal generative model designed to support flexible, any-to-any synthesis between medical data modalities. XGeM constructs a shared latent space via contrastive learning and introduces a novel Multi-Prompt Training strategy, enabling conditioning on arbitrary subsets of input modalities. This design allows the model to adapt to heterogeneous clinical inputs and generate multiple outputs jointly, preserving both semantic and structural coherence. We extensively validate XGeM by first benchmarking it against five competitors on the MIMIC-CXR dataset, a state-of-the-art dataset for multi-view Chest X-ray and radiological report generation. Secondly, we perform a Visual Turing Test with expert radiologists to assess the realism and clinical relevance of the generated data, ensuring alignment with real-world scenarios. Finally, we demonstrate how XGeM can support key medical data challenges such as anonymization, class imbalance, and data scarcity, underscoring its utility as a foundation model for medical data synthesis. Project page is at <span><span>https://cosbidev.github.io/XGeM/</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102718"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146120948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MRI-based deep learning model predicts recurrent nasopharyngeal carcinoma in post-radiation nasopharyngeal necrosis 基于mri的深度学习模型预测鼻咽癌放疗后鼻咽癌坏死复发。
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-01-29 DOI: 10.1016/j.compmedimag.2026.102711
Chao Lin , Jiong-Lin Liang , Jia Guo , Yu-Long Xie , Weidong Cheng , Guo-Heng Huang , Qing-Wen Lin , Jian-Wu Chen , Tong Xiang , Hai-Qiang Mai , Qi Yang
{"title":"MRI-based deep learning model predicts recurrent nasopharyngeal carcinoma in post-radiation nasopharyngeal necrosis","authors":"Chao Lin ,&nbsp;Jiong-Lin Liang ,&nbsp;Jia Guo ,&nbsp;Yu-Long Xie ,&nbsp;Weidong Cheng ,&nbsp;Guo-Heng Huang ,&nbsp;Qing-Wen Lin ,&nbsp;Jian-Wu Chen ,&nbsp;Tong Xiang ,&nbsp;Hai-Qiang Mai ,&nbsp;Qi Yang","doi":"10.1016/j.compmedimag.2026.102711","DOIUrl":"10.1016/j.compmedimag.2026.102711","url":null,"abstract":"<div><h3>Background</h3><div>The pretreatment identification of post-radiation nasopharyngeal necrosis (PRNN) combined with recurrent nasopharyngeal carcinoma (referred to as cancer-infiltrative PRNN) is crucial for the diagnosis and treatment of PRNN. As the first study to identify recurrent nasopharyngeal carcinoma in patients with PRNN, we aimed to develop a deep learning (DL)-based predictive model using routine MRI to distinguish cancer-infiltrative PRNN from cancer-free PRNN.</div></div><div><h3>Methods</h3><div>MRIs of 437 patients with PRNN were manually labeled and randomly divided into training and validation cohorts. Video Swin Transformer and Multilayer Perceptron were employed to construct the DL model. The integrated DL and clinical model (DC<sub>combined</sub> model) and the integrated radiomics and clinical model (RC<sub>combined</sub> model) were constructed using linear weighted fusion of the prediction results from the two models. The predictive value of each model was evaluated using the area under the curve (AUC), accuracy, sensitivity, and specificity.</div></div><div><h3>Results</h3><div>The DC<sub>combined</sub> model significantly outperformed the radiologists in terms of AUC (0.83 vs. 0.60, p &lt; 0.001), accuracy (0.78 vs. 0.60, p = 0.002), and sensitivity (0.86 vs. 0.62, p = 0.002) in the validation cohort. The DC<sub>combined</sub> model showed the highest validation sensitivity of 0.86 (95 % CI 0.77–0.94), whereas the RC<sub>combined</sub> model demonstrated the highest specificity of 0.88 (95 % CI 0.81–0.96).</div></div><div><h3>Conclusions</h3><div>Our DC<sub>combined</sub> model based on DL can noninvasively distinguish cancer-infiltrative PRNN from cancer-free PRNN with higher AUC, accuracy, and sensitivity than those of radiologists and better sensitivity than that of the RC<sub>combined</sub> model based on radiomics.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102711"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146100664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A knowledge-guided and uncertainty-calibrated multimodal framework for fracture diagnosis and radiology report generation 一个知识指导和不确定性校准的多模态框架,用于骨折诊断和放射学报告生成
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-01-27 DOI: 10.1016/j.compmedimag.2026.102709
Riadh Bouslimi
{"title":"A knowledge-guided and uncertainty-calibrated multimodal framework for fracture diagnosis and radiology report generation","authors":"Riadh Bouslimi","doi":"10.1016/j.compmedimag.2026.102709","DOIUrl":"10.1016/j.compmedimag.2026.102709","url":null,"abstract":"<div><div>Fracture diagnosis from radiographic imaging remains challenging, particularly in clinical settings with limited access to expert radiologists or standardized reporting practices. This work introduces <em>UG-GraphT5</em> (<em>Uncertainty-Guided Graph Transformer for Radiology Report Generation</em>), a unified multimodal framework for joint fracture classification and uncertainty-aware radiology report generation that explicitly treats diagnostic uncertainty as a central component guiding both reasoning and clinical communication. The proposed approach integrates visual representations, structured clinical knowledge derived from SNOMED CT, Bayesian uncertainty estimation, and guided natural language generation based on ClinicalT5, enabling adaptive multimodal fusion and calibrated language output. Evaluated on three radiological datasets comprising over 80,000 expert-annotated images and reports, UG-GraphT5 achieves improved fracture classification performance (F1-score of 82.6%), strong uncertainty calibration (ECE of 2.7%), and high-quality report generation (BLEU-4 of 0.356). Qualitative analysis and a reader study involving radiology trainees and experts further confirm that generated reports appropriately reflect diagnostic confidence through uncertainty-aware lexical modulation. An optimized clinical inference profile reduces inference latency by more than 40% without compromising diagnostic accuracy, highlighting the framework’s potential for interpretable, trustworthy, and deployment-aware AI-assisted radiology in resource-constrained clinical environments.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102709"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146078446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Differentiable Neural Architecture Search for medical image segmentation: A systematic review and field audit 医学图像分割的可微分神经结构搜索:系统回顾和现场审计
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-01-20 DOI: 10.1016/j.compmedimag.2026.102713
Emil Benedykciuk, Marcin Denkowski, Grzegorz M. Wójcik
{"title":"Differentiable Neural Architecture Search for medical image segmentation: A systematic review and field audit","authors":"Emil Benedykciuk,&nbsp;Marcin Denkowski,&nbsp;Grzegorz M. Wójcik","doi":"10.1016/j.compmedimag.2026.102713","DOIUrl":"10.1016/j.compmedimag.2026.102713","url":null,"abstract":"<div><div>Medical image segmentation is critical for diagnosis, treatment planning, and disease monitoring, yet differs from generic semantic segmentation due to volumetric data, modality-specific artifacts, costly and uncertain expert annotations, and domain shift across scanners and institutions. Neural Architecture Search (NAS) can automate model design, but many NAS paradigms become impractical for 3D segmentation because evaluating large numbers of candidate architectures is computationally prohibitive. Differentiable NAS (DNAS) alleviates this barrier by optimizing relaxed architectural choices with gradients in a weight-sharing supernet, making search feasible under realistic compute and memory budgets. However, DNAS introduces distinct methodological risks (e.g., optimization instability and discretization gap) and raises challenges in reproducibility and clinical deployability. We conduct a PRISMA-inspired systematic review of DNAS for medical image segmentation (multi-database screening, 2018-2025), retaining 33 papers representing 31 unique methods for quantitative analysis. Across the included studies, external validation on independent-site data is rare (<span><math><mo>∼</mo></math></span>10%), full code release (including search procedures) is limited (<span><math><mo>∼</mo></math></span>26%), and only a minority substantively addresses search stability (<span><math><mo>∼</mo></math></span>23%). Despite clear clinical relevance, multi-objective search that explicitly optimizes latency or memory is also uncommon (<span><math><mo>∼</mo></math></span>23%). We position DNAS within the broader NAS landscape, introduce a segmentation-focused taxonomy, and propose a NAS Reporting Card tailored to medical segmentation to improve transparency, comparability, and reproducibility.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102713"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146023421","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
C3MT: Confidence-Calibrated Contrastive Mean Teacher for semi-supervised medical image segmentation C3MT:半监督医学图像分割的置信度校准对比均值教师。
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-02-06 DOI: 10.1016/j.compmedimag.2026.102721
Xianmin Wang , Mingfeng Lin , Jing Li
{"title":"C3MT: Confidence-Calibrated Contrastive Mean Teacher for semi-supervised medical image segmentation","authors":"Xianmin Wang ,&nbsp;Mingfeng Lin ,&nbsp;Jing Li","doi":"10.1016/j.compmedimag.2026.102721","DOIUrl":"10.1016/j.compmedimag.2026.102721","url":null,"abstract":"<div><div>Semi-supervised learning is crucial for medical image segmentation due to the scarcity of labeled data. However, existing methods that combine consistency regularization and pseudo-labeling often suffer from inadequate feature representation, suboptimal subnetwork disagreement, and noisy pseudo-labels. To address these limitations, this paper proposed a novel <strong>C</strong>onfidence-<strong>C</strong>alibrated <strong>C</strong>ontrastive <strong>M</strong>ean <strong>T</strong>eacher (C3MT) framework. First, C3MT introduces a Contrastive Learning-based co-training strategy, where an adaptive disagreement adjustment mechanism dynamically regulates the divergence between student models. This not only preserves representation diversity but also stabilizes the training process. Second, C3MT introduces a Confidence-Calibrated and Category-Aligned uncertainty-guided region mixing strategy. The confidence-calibrated mechanism filters out unreliable pseudo-labels, whereas the category-aligned design restricts region swapping to patches of the same semantic category, preserving anatomical coherence and preventing semantic inconsistency in the mixed samples. Together, these components significantly enhance feature representation, training stability, and segmentation quality, especially in challenging low-annotation scenarios. Extensive experiments on ACDC, Synapse, and LA datasets show that C3MT consistently outperforms recent state-of-the-art methods. For example, on the ACDC dataset with 20% labeled data, C3MT achieves up to a 4.3% improvement in average Dice score and a reduction in HD95 of more than 1.0 mm compared with strong baselines. The implementation is publicly available at <span><span>https://github.com/l1654485/C3MT</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102721"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146138058","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Research on X-ray coronary artery branches instance segmentation and matching task x射线冠状动脉分支实例分割与匹配任务研究
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2025-12-26 DOI: 10.1016/j.compmedimag.2025.102681
Xiaodong Zhou , Huibin Wang
{"title":"Research on X-ray coronary artery branches instance segmentation and matching task","authors":"Xiaodong Zhou ,&nbsp;Huibin Wang","doi":"10.1016/j.compmedimag.2025.102681","DOIUrl":"10.1016/j.compmedimag.2025.102681","url":null,"abstract":"<div><div>In the task of 3D reconstruction of X-ray coronary artery, matching vessel branches in different viewpoints is a challenging task. In this study, this task is transformed into the process of vessel branches instance segmentation and then matching branches of the same color, and an instance segmentation network (YOLO-CAVBIS) is proposed specifically for deformed and dynamic vessels. Firstly, since the left and right coronary artery branches are not easy to distinguish, a coronary artery classification dataset is produced and the left and right coronary artery arteries are classified using the YOLOv8-cls classification model, and then the classified images are fed into two parallel YOLO-CAVBIS networks for coronary artery branches instance segmentation. Finally, the branches with the same color of branches in different viewpoints are matched. The experimental results show that the accuracy of the coronary artery classification model can reach 100%, and the mAP50 of the proposed left coronary branches instance segmentation model reaches 98.4%, and the mAP50 of the proposed right coronary branches instance segmentation model reaches 99.4%. In terms of extracting deformation and dynamic vascular features, our proposed YOLO-CAVBIS network demonstrates greater specificity and superiority compared to other instance segmentation networks, and can be used as a baseline model for the task of coronary artery branches instance segmentation. Code repository: <span><span>https://gitee.com/zaleman/ca_instance_segmentation</span><svg><path></path></svg></span>, <span><span>https://github.com/zaleman/ca_instance_segmentation</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102681"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145928056","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A multi-expert deep learning framework with LLM-guided arbitration for multimodal histopathology prediction 一个多专家深度学习框架与法学硕士指导仲裁多模态组织病理学预测
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-01-08 DOI: 10.1016/j.compmedimag.2026.102704
Shyam Sundar Debsarkar , V.B. Surya Prasath
{"title":"A multi-expert deep learning framework with LLM-guided arbitration for multimodal histopathology prediction","authors":"Shyam Sundar Debsarkar ,&nbsp;V.B. Surya Prasath","doi":"10.1016/j.compmedimag.2026.102704","DOIUrl":"10.1016/j.compmedimag.2026.102704","url":null,"abstract":"<div><div>Recent advances in deep learning have significantly improved the accuracy of computational pathology; however conventional model ensembling strategies often lack adaptability and interpretability hindering the clinical adaptability. While multiple artificial intelligence (AI) expert models can provide complementary perspectives, simply aggregating their outputs is often insufficient for handling inter-model disagreement and delivering interpretable decisions. To address these challenges, we propose a novel multi-expert framework that integrates diverse vision-based predictors and a clinical feature-based model, with a large language model (LLM) acting as an intelligent arbitrator. By leveraging the contextual reasoning and explanation capabilities of LLMs, our architecture dynamically synthesizes insights from both imaging and clinical data, resolving model conflicts, and providing transparent, rational decisions. We validate our approach on two cancer histopathology datasets, namely the HMU-GC-HE-30K which is a gastric cancer dataset containing pathology images only, and the BCNB which is a breast cancer biopsy dataset that is multimodal — contains pathology imaging and clinical information. Our proposed multi-expert, LLM arbitrated framework (MELLMA) outperforms convolutional neural networks (CNNs), and transformers, which are currently the de facto and state-of-the-art classification ensemble models, with better overall results. We test different LLMs as arbitrators, namely LLaMA, GPT variants, and Mistral. Further, our proposed framework outperforms strong single-agent CNN/ViT baselines on the datasets, and ablations show that learned per-agent trust materially improves the arbitrator’s decisions without altering prompts or data. These experimental results demonstrate that LLM-guided arbitration consistently provides more robust and explainable performance than individual models, conventional ensembling with majority vote, uniform average, and meta-learners. The results obtained highlight the promise of LLM-driven arbitration for building transparent and extensible AI systems in digital pathology.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102704"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145928059","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The 4D Human Embryonic Brain Atlas: Spatiotemporal atlas generation for rapid anatomical changes 4D人类胚胎脑图谱:快速解剖变化的时空图谱生成
IF 4.9 2区 医学
Computerized Medical Imaging and Graphics Pub Date : 2026-02-01 Epub Date: 2026-01-13 DOI: 10.1016/j.compmedimag.2026.102702
Wietske A.P. Bastiaansen , Melek Rousian , Anton H.J. Koning , Wiro J. Niessen , Bernadette S. de Bakker , Régine P.M. Steegers-Theunissen , Stefan Klein
{"title":"The 4D Human Embryonic Brain Atlas: Spatiotemporal atlas generation for rapid anatomical changes","authors":"Wietske A.P. Bastiaansen ,&nbsp;Melek Rousian ,&nbsp;Anton H.J. Koning ,&nbsp;Wiro J. Niessen ,&nbsp;Bernadette S. de Bakker ,&nbsp;Régine P.M. Steegers-Theunissen ,&nbsp;Stefan Klein","doi":"10.1016/j.compmedimag.2026.102702","DOIUrl":"10.1016/j.compmedimag.2026.102702","url":null,"abstract":"<div><div>Early brain development is crucial for lifelong neurodevelopmental health. However, current clinical practice offers limited knowledge of normal embryonic brain anatomy on ultrasound, despite the brain undergoing rapid changes within the time-span of days. To provide detailed insights into normal brain development and identify deviations, we created the 4D Human Embryonic Brain Atlas using a deep learning-based approach for groupwise registration and spatiotemporal atlas generation. Our method introduced a time-dependent initial atlas and penalized deviations from it, ensuring age-specific anatomy was maintained throughout rapid development. The atlas was generated and validated using 831 3D ultrasound images from 402 subjects in the Rotterdam Periconceptional Cohort, acquired between gestational weeks 8 and 12. We evaluated the effectiveness of our approach with an ablation study, which demonstrated that incorporating a time-dependent initial atlas and penalization produced anatomically accurate results. In contrast, omitting these adaptations led to an anatomically incorrect atlas. Visual comparisons with an existing ex-vivo embryo atlas further confirmed the anatomical accuracy of our atlas. In conclusion, the proposed method successfully captures the rapid anatomical development of the embryonic brain. The resulting 4D Human Embryonic Brain Atlas provides a unique insights into this crucial early life period and holds the potential for improving the detection, prevention, and treatment of prenatal neurodevelopmental disorders.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"128 ","pages":"Article 102702"},"PeriodicalIF":4.9,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145979292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书