MVTT-GMamba: A Multimodal Graph Reasoning Framework for Anti-VEGF Efficacy Prediction in Diabetic Macular Edema

IF 7.7 2区 医学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Shijing Wu;Yifan Zheng;Tianyu Chen;Gang Wu;Qinkun Zhi;Ailing Sui;Haixia Bai;Junhui Shen;Li Zhang;Yao Wang;Jian Ma;Xiaoyun Fang;Yanming Zhu;Feiwei Qin;Zhiqing Chen
{"title":"MVTT-GMamba: A Multimodal Graph Reasoning Framework for Anti-VEGF Efficacy Prediction in Diabetic Macular Edema","authors":"Shijing Wu;Yifan Zheng;Tianyu Chen;Gang Wu;Qinkun Zhi;Ailing Sui;Haixia Bai;Junhui Shen;Li Zhang;Yao Wang;Jian Ma;Xiaoyun Fang;Yanming Zhu;Feiwei Qin;Zhiqing Chen","doi":"10.1109/JBHI.2026.3670360","DOIUrl":null,"url":null,"abstract":"Accurately predicting individual responses to Anti-Vascular Endothelial Growth Factor (Anti-VEGF) efficacy in diabetic macular edema (DME) remains a critical challenge in personalized ophthalmic care. Existing methods often rely on unimodal data or suffer from ineffective multimodal feature extraction and fusion, leading to modality redundancy and performance degradation. To address these limitations, we propose MVTT-GMamba, a novel multimodal learning framework that integrates optical coherence tomography (OCT) images and structured clinical indicators for early and accurate Anti-VEGF efficacy prediction. At the core of MVTT-GMamba is a feature-wise heterogeneous graph reasoning paradigm that explicitly models inter-patient and inter-feature relations, together with an adaptive, graph-guided prediction head that progressively anneals structural priors into the classifier. Building on this core, we adopt domain-tailored MambaVision and TabTransformer encoders and an early cross-attention fusion module to realize fine-grained multimodal representation learning. Extensive experiments on both a private clinical dataset (DMETHERA-ECSAHZU) and the public APTOS2021 benchmark demonstrate that MVTT-GMamba consistently outperforms state-of-the-art methods across all evaluation metrics. In addition, Grad-CAM visualizations reveal that the model attends to clinically relevant retinal regions, providing enhanced interpretability.","PeriodicalId":13073,"journal":{"name":"IEEE Journal of Biomedical and Health Informatics","volume":"30 10","pages":"8723-8736"},"PeriodicalIF":7.7000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Biomedical and Health Informatics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11420999/","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/4 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Accurately predicting individual responses to Anti-Vascular Endothelial Growth Factor (Anti-VEGF) efficacy in diabetic macular edema (DME) remains a critical challenge in personalized ophthalmic care. Existing methods often rely on unimodal data or suffer from ineffective multimodal feature extraction and fusion, leading to modality redundancy and performance degradation. To address these limitations, we propose MVTT-GMamba, a novel multimodal learning framework that integrates optical coherence tomography (OCT) images and structured clinical indicators for early and accurate Anti-VEGF efficacy prediction. At the core of MVTT-GMamba is a feature-wise heterogeneous graph reasoning paradigm that explicitly models inter-patient and inter-feature relations, together with an adaptive, graph-guided prediction head that progressively anneals structural priors into the classifier. Building on this core, we adopt domain-tailored MambaVision and TabTransformer encoders and an early cross-attention fusion module to realize fine-grained multimodal representation learning. Extensive experiments on both a private clinical dataset (DMETHERA-ECSAHZU) and the public APTOS2021 benchmark demonstrate that MVTT-GMamba consistently outperforms state-of-the-art methods across all evaluation metrics. In addition, Grad-CAM visualizations reveal that the model attends to clinically relevant retinal regions, providing enhanced interpretability.
mvtt - gamba:糖尿病黄斑水肿抗vegf疗效预测的多模态图推理框架。
准确预测糖尿病黄斑水肿(DME)患者对抗血管内皮生长因子(Anti-VEGF)疗效的个体反应仍然是个性化眼科护理的关键挑战。现有方法往往依赖于单模态数据,或多模态特征提取和融合效果不佳,导致模态冗余和性能下降。为了解决这些限制,我们提出了mvtt - gamba,这是一个新的多模式学习框架,集成了光学相干断层扫描(OCT)图像和结构化临床指标,用于早期和准确的抗vegf疗效预测。mvtt - gamba的核心是一个具有特征的异构图推理范式,它明确地为患者之间和特征之间的关系建模,以及一个自适应的、图引导的预测头,它逐步将结构先验退火到分类器中。在此基础上,我们采用了领域定制的MambaVision和TabTransformer编码器以及早期的交叉注意融合模块来实现细粒度的多模态表示学习。在私人临床数据集(DMETHERA-ECSAHZU)和公共APTOS2021基准上进行的广泛实验表明,mvtt - gamba在所有评估指标上始终优于最先进的方法。此外,Grad-CAM可视化显示该模型关注临床相关的视网膜区域,提供了增强的可解释性。代码可从https://github.com/DME666/DME获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Journal of Biomedical and Health Informatics
IEEE Journal of Biomedical and Health Informatics COMPUTER SCIENCE, INFORMATION SYSTEMS-COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
CiteScore
13.60
自引率
6.50%
发文量
1151
期刊介绍: IEEE Journal of Biomedical and Health Informatics publishes original papers presenting recent advances where information and communication technologies intersect with health, healthcare, life sciences, and biomedicine. Topics include acquisition, transmission, storage, retrieval, management, and analysis of biomedical and health information. The journal covers applications of information technologies in healthcare, patient monitoring, preventive care, early disease diagnosis, therapy discovery, and personalized treatment protocols. It explores electronic medical and health records, clinical information systems, decision support systems, medical and biological imaging informatics, wearable systems, body area/sensor networks, and more. Integration-related topics like interoperability, evidence-based medicine, and secure patient data are also addressed.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书