用混合图卷积和变压器网络整合多模态数据诊断肺动脉高压。

Fubao Zhu, Yang Zhang, Gengmin Liang, Jiaofen Nan, Yanting Li, Chuang Han, Danyang Sun, Zhiguo Wang, Chen Zhao, Wenxuan Zhou, Jian He, Yi Xu, Iokfai Cheang, Xu Zhu, Yanli Zhou, Weihua Zhou
{"title":"用混合图卷积和变压器网络整合多模态数据诊断肺动脉高压。","authors":"Fubao Zhu, Yang Zhang, Gengmin Liang, Jiaofen Nan, Yanting Li, Chuang Han, Danyang Sun, Zhiguo Wang, Chen Zhao, Wenxuan Zhou, Jian He, Yi Xu, Iokfai Cheang, Xu Zhu, Yanli Zhou, Weihua Zhou","doi":"10.1007/s10278-025-01705-1","DOIUrl":null,"url":null,"abstract":"<p><p>Early and accurate diagnosis of pulmonary hypertension (PH), including differentiating pre-capillary from post-capillary PH, is crucial for guiding effective clinical management. This study developed and validated a deep learning-based diagnostic model to classify patients into non-PH, pre-capillary PH, or post-capillary PH categories. A retrospective dataset from 204 patients (112 pre-capillary PH, 32 post-capillary PH, and 60 non-PH controls) was collected at the First Affiliated Hospital of Nanjing Medical University, with diagnoses confirmed by right heart catheterization (RHC). Patients were randomly divided into training (186 patients, 90%) and testing sets (18 patients, 10%) stratified by diagnostic category. We trained and evaluated the model using 35 repeated random splits. The proposed deep learning model combined graph convolutional networks (GCN), convolutional neural networks (CNN), and Transformers to analyze multimodal data, including cine short-axis (SAX) sequences, four-chamber (4CH) sequences, and clinical parameters. Across test splits, the model achieved an overall area under the receiver operating characteristic curve (AUC) of 0.814 ± 0.06 and accuracy (ACC) of 0.734 ± 0.06 (mean ± SD). Class-specific AUCs were 0.745 ± 0.11 for non-PH, 0.863 ± 0.06 for pre-capillary PH, and 0.834 ± 0.10 for post-capillary PH, indicating good discriminative ability. This study demonstrated three-class PH classification using multimodal inputs. By fusing imaging and clinical data, the model may support accurate and timely clinical decision-making in PH.</p>","PeriodicalId":516858,"journal":{"name":"Journal of imaging informatics in medicine","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Diagnosis of Pulmonary Hypertension by Integrating Multimodal Data with a Hybrid Graph Convolutional and Transformer Network.\",\"authors\":\"Fubao Zhu, Yang Zhang, Gengmin Liang, Jiaofen Nan, Yanting Li, Chuang Han, Danyang Sun, Zhiguo Wang, Chen Zhao, Wenxuan Zhou, Jian He, Yi Xu, Iokfai Cheang, Xu Zhu, Yanli Zhou, Weihua Zhou\",\"doi\":\"10.1007/s10278-025-01705-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Early and accurate diagnosis of pulmonary hypertension (PH), including differentiating pre-capillary from post-capillary PH, is crucial for guiding effective clinical management. This study developed and validated a deep learning-based diagnostic model to classify patients into non-PH, pre-capillary PH, or post-capillary PH categories. A retrospective dataset from 204 patients (112 pre-capillary PH, 32 post-capillary PH, and 60 non-PH controls) was collected at the First Affiliated Hospital of Nanjing Medical University, with diagnoses confirmed by right heart catheterization (RHC). Patients were randomly divided into training (186 patients, 90%) and testing sets (18 patients, 10%) stratified by diagnostic category. We trained and evaluated the model using 35 repeated random splits. The proposed deep learning model combined graph convolutional networks (GCN), convolutional neural networks (CNN), and Transformers to analyze multimodal data, including cine short-axis (SAX) sequences, four-chamber (4CH) sequences, and clinical parameters. Across test splits, the model achieved an overall area under the receiver operating characteristic curve (AUC) of 0.814 ± 0.06 and accuracy (ACC) of 0.734 ± 0.06 (mean ± SD). Class-specific AUCs were 0.745 ± 0.11 for non-PH, 0.863 ± 0.06 for pre-capillary PH, and 0.834 ± 0.10 for post-capillary PH, indicating good discriminative ability. This study demonstrated three-class PH classification using multimodal inputs. By fusing imaging and clinical data, the model may support accurate and timely clinical decision-making in PH.</p>\",\"PeriodicalId\":516858,\"journal\":{\"name\":\"Journal of imaging informatics in medicine\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-10-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of imaging informatics in medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/s10278-025-01705-1\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of imaging informatics in medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s10278-025-01705-1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

早期准确诊断肺动脉高压(pulmonary hypertension, PH),包括鉴别毛细血管前和毛细血管后的PH值,对指导有效的临床治疗至关重要。本研究开发并验证了一种基于深度学习的诊断模型,将患者分为非PH、毛细管前PH或毛细管后PH三类。回顾性收集南京医科大学第一附属医院204例患者(112例毛细血管前PH值,32例毛细血管后PH值,60例非PH值对照),诊断为右心导管(RHC)。患者按诊断类别随机分为训练组(186例,占90%)和测试组(18例,占10%)。我们使用35次重复的随机分割来训练和评估模型。提出的深度学习模型结合了图卷积网络(GCN)、卷积神经网络(CNN)和transformer来分析多模态数据,包括电影短轴(SAX)序列、四室(4CH)序列和临床参数。在不同的测试区间,该模型在受试者工作特征曲线下的总体面积(AUC)为0.814±0.06,准确度(ACC)为0.734±0.06 (mean±SD)。非PH、毛细管前PH和毛细管后PH的分类auc分别为0.745±0.11、0.863±0.06和0.834±0.10,具有较好的区分能力。本研究展示了使用多模态输入的三类PH分类。通过融合影像学和临床数据,该模型可以支持PH准确、及时的临床决策。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Diagnosis of Pulmonary Hypertension by Integrating Multimodal Data with a Hybrid Graph Convolutional and Transformer Network.

Early and accurate diagnosis of pulmonary hypertension (PH), including differentiating pre-capillary from post-capillary PH, is crucial for guiding effective clinical management. This study developed and validated a deep learning-based diagnostic model to classify patients into non-PH, pre-capillary PH, or post-capillary PH categories. A retrospective dataset from 204 patients (112 pre-capillary PH, 32 post-capillary PH, and 60 non-PH controls) was collected at the First Affiliated Hospital of Nanjing Medical University, with diagnoses confirmed by right heart catheterization (RHC). Patients were randomly divided into training (186 patients, 90%) and testing sets (18 patients, 10%) stratified by diagnostic category. We trained and evaluated the model using 35 repeated random splits. The proposed deep learning model combined graph convolutional networks (GCN), convolutional neural networks (CNN), and Transformers to analyze multimodal data, including cine short-axis (SAX) sequences, four-chamber (4CH) sequences, and clinical parameters. Across test splits, the model achieved an overall area under the receiver operating characteristic curve (AUC) of 0.814 ± 0.06 and accuracy (ACC) of 0.734 ± 0.06 (mean ± SD). Class-specific AUCs were 0.745 ± 0.11 for non-PH, 0.863 ± 0.06 for pre-capillary PH, and 0.834 ± 0.10 for post-capillary PH, indicating good discriminative ability. This study demonstrated three-class PH classification using multimodal inputs. By fusing imaging and clinical data, the model may support accurate and timely clinical decision-making in PH.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信