Radiogenomic explainable AI with neural ordinary differential equation for identifying post-SRS brain metastasis radionecrosis

IF 3.2 2区 医学 Q1 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
Medical physics Pub Date : 2025-01-29 DOI:10.1002/mp.17635
Jingtong Zhao, Eugene Vaios, Zhenyu Yang, Ke Lu, Scott Floyd, Deshan Yang, Hangjie Ji, Zachary J. Reitman, Kyle J. Lafata, Peter Fecci, John P. Kirkpatrick, Chunhao Wang
{"title":"Radiogenomic explainable AI with neural ordinary differential equation for identifying post-SRS brain metastasis radionecrosis","authors":"Jingtong Zhao,&nbsp;Eugene Vaios,&nbsp;Zhenyu Yang,&nbsp;Ke Lu,&nbsp;Scott Floyd,&nbsp;Deshan Yang,&nbsp;Hangjie Ji,&nbsp;Zachary J. Reitman,&nbsp;Kyle J. Lafata,&nbsp;Peter Fecci,&nbsp;John P. Kirkpatrick,&nbsp;Chunhao Wang","doi":"10.1002/mp.17635","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Stereotactic radiosurgery (SRS) is widely used for managing brain metastases (BMs), but an adverse effect, radionecrosis, complicates post-SRS management. Differentiating radionecrosis from tumor recurrence non-invasively remains a major clinical challenge, as conventional imaging techniques often necessitate surgical biopsy for accurate diagnosis. Machine learning and deep learning models have shown potential in distinguishing radionecrosis from tumor recurrence. However, their clinical adoption is hindered by a lack of explainability, limiting understanding and trust in their diagnostic decisions.</p>\n </section>\n \n <section>\n \n <h3> Purpose</h3>\n \n <p>To utilize a novel neural ordinary differential equation (NODE) model for discerning BM post-SRS radionecrosis from recurrence. This approach integrates image-deep features, genomic biomarkers, and non-image clinical parameters within a synthesized latent feature space. The trajectory of each data sample towards the diagnosis decision can be visualized within this feature space, offering a new angle on radiogenomic data analysis foundational for AI explainability.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>By hypothesizing that deep feature extraction can be modeled as a spatiotemporally continuous process, we designed a novel model based on heavy ball NODE (HBNODE) in which deep feature extraction was governed by a second-order ODE. This approach enabled tracking of deep neural network (DNN) behavior by solving the HBNODE and observing the stepwise derivative evolution. Consequently, the trajectory of each sample within the Image-Genomic-Clinical (I-G-C) space became traceable. A decision-making field (<b><i>F</i></b>) was reconstructed within the feature space, with its gradient vectors directing the data samples’ trajectories and intensities showing the potential. The evolution of <b><i>F</i></b> reflected the cumulative feature contributions at intermediate states to the final diagnosis, enabling quantitative and dynamic comparisons of the relative contribution of each feature category over time. A velocity curve was designed to determine key intermediate states (locoregional ∇<b><i>F </i></b>=<b> </b>0) that are most predictive. Subsequently, a non-parametric model aggregated the optimal solutions from these key states to predict outcomes.</p>\n \n <p>Our dataset included 90 BMs from 62 NSCLC patients, and 3-month post-SRS T1+c MR image features, seven NSCLC genomic features, and seven clinical features were analyzed. An 8:2 train/test assignment was employed, and five independent models were trained to ensure robustness. Performance was benchmarked in sensitivity, specificity, accuracy, and ROC<sub>AUC</sub>, and results were compared against (1) a DNN using only image-based features, and (2) a combined “I+G+C” features without the HBNODE model.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>The temporal evolution of gradient vectors and potential fields in <b><i>F</i></b> suggested that clinical features contribute the most during the initial stages of the HBNODE implementation, followed by imagery features taking dominance in the latter ones, while genomic features contribute the least throughout the process. The HBNODE model successfully identified and assembled key intermediate states, exhibiting competitive performance with an ROC<sub>AUC</sub> of 0.88 ± 0.04, sensitivity of 0.79 ± 0.02, specificity of 0.86 ± 0.01, and accuracy of 0.84 ± 0.01, where the uncertainties represent standard deviations. For comparison, the image-only DNN model achieved an ROC<sub>AUC</sub> of 0.71 ± 0.05 and sensitivity of 0.66 ± 0.32 (<i>p</i><b> </b><i>=</i> 0.086), while the “I+G+C” model without HBNODE reported an ROC<sub>AUC</sub> of 0.81 ± 0.02 and sensitivity of 0.58 ± 0.11 (<i>p</i><b> </b><i>=</i> 0.091).</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>The HBNODE model effectively identifies BM radionecrosis from recurrence, enhancing explainability within XAI frameworks. Its performance encourages further exploration in clinical settings and suggests potential applicability across various XAI domains.</p>\n </section>\n </div>","PeriodicalId":18384,"journal":{"name":"Medical physics","volume":"52 4","pages":"2661-2674"},"PeriodicalIF":3.2000,"publicationDate":"2025-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical physics","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/mp.17635","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Background

Stereotactic radiosurgery (SRS) is widely used for managing brain metastases (BMs), but an adverse effect, radionecrosis, complicates post-SRS management. Differentiating radionecrosis from tumor recurrence non-invasively remains a major clinical challenge, as conventional imaging techniques often necessitate surgical biopsy for accurate diagnosis. Machine learning and deep learning models have shown potential in distinguishing radionecrosis from tumor recurrence. However, their clinical adoption is hindered by a lack of explainability, limiting understanding and trust in their diagnostic decisions.

Purpose

To utilize a novel neural ordinary differential equation (NODE) model for discerning BM post-SRS radionecrosis from recurrence. This approach integrates image-deep features, genomic biomarkers, and non-image clinical parameters within a synthesized latent feature space. The trajectory of each data sample towards the diagnosis decision can be visualized within this feature space, offering a new angle on radiogenomic data analysis foundational for AI explainability.

Methods

By hypothesizing that deep feature extraction can be modeled as a spatiotemporally continuous process, we designed a novel model based on heavy ball NODE (HBNODE) in which deep feature extraction was governed by a second-order ODE. This approach enabled tracking of deep neural network (DNN) behavior by solving the HBNODE and observing the stepwise derivative evolution. Consequently, the trajectory of each sample within the Image-Genomic-Clinical (I-G-C) space became traceable. A decision-making field (F) was reconstructed within the feature space, with its gradient vectors directing the data samples’ trajectories and intensities showing the potential. The evolution of F reflected the cumulative feature contributions at intermediate states to the final diagnosis, enabling quantitative and dynamic comparisons of the relative contribution of each feature category over time. A velocity curve was designed to determine key intermediate states (locoregional ∇= 0) that are most predictive. Subsequently, a non-parametric model aggregated the optimal solutions from these key states to predict outcomes.

Our dataset included 90 BMs from 62 NSCLC patients, and 3-month post-SRS T1+c MR image features, seven NSCLC genomic features, and seven clinical features were analyzed. An 8:2 train/test assignment was employed, and five independent models were trained to ensure robustness. Performance was benchmarked in sensitivity, specificity, accuracy, and ROCAUC, and results were compared against (1) a DNN using only image-based features, and (2) a combined “I+G+C” features without the HBNODE model.

Results

The temporal evolution of gradient vectors and potential fields in F suggested that clinical features contribute the most during the initial stages of the HBNODE implementation, followed by imagery features taking dominance in the latter ones, while genomic features contribute the least throughout the process. The HBNODE model successfully identified and assembled key intermediate states, exhibiting competitive performance with an ROCAUC of 0.88 ± 0.04, sensitivity of 0.79 ± 0.02, specificity of 0.86 ± 0.01, and accuracy of 0.84 ± 0.01, where the uncertainties represent standard deviations. For comparison, the image-only DNN model achieved an ROCAUC of 0.71 ± 0.05 and sensitivity of 0.66 ± 0.32 (p = 0.086), while the “I+G+C” model without HBNODE reported an ROCAUC of 0.81 ± 0.02 and sensitivity of 0.58 ± 0.11 (p = 0.091).

Conclusion

The HBNODE model effectively identifies BM radionecrosis from recurrence, enhancing explainability within XAI frameworks. Its performance encourages further exploration in clinical settings and suggests potential applicability across various XAI domains.

基于神经常微分方程的放射基因组学可解释人工智能识别srs后脑转移性放射性坏死。
背景:立体定向放射手术(SRS)被广泛用于脑转移(BMs)的治疗,但其副作用,放射性坏死,使SRS后的治疗复杂化。鉴别放射性坏死与肿瘤复发的非侵袭性仍然是一个主要的临床挑战,因为传统的成像技术通常需要手术活检才能准确诊断。机器学习和深度学习模型在区分放射性坏死和肿瘤复发方面显示出潜力。然而,由于缺乏可解释性,它们的临床应用受到阻碍,限制了对其诊断决定的理解和信任。目的:利用一种新的神经常微分方程(NODE)模型来识别脑卒中后放射性坏死和复发。该方法将图像深度特征、基因组生物标志物和非图像临床参数集成在一个合成的潜在特征空间中。每个数据样本对诊断决策的轨迹可以在这个特征空间内可视化,为人工智能的可解释性提供了一个新的角度来分析放射基因组数据。方法:假设深度特征提取可以建模为一个时空连续过程,设计了一种基于重球节点(HBNODE)的新模型,其中深度特征提取由二阶ODE控制。该方法通过求解HBNODE和观察逐步导数演化,实现了深度神经网络(DNN)行为的跟踪。因此,在图像-基因组-临床(I-G-C)空间内的每个样本的轨迹变得可追溯。在特征空间内重建决策场(F),其梯度向量指导数据样本的轨迹,强度表示潜力。F的演变反映了中间状态对最终诊断的累积特征贡献,从而可以定量和动态地比较每个特征类别随时间的相对贡献。设计了速度曲线来确定最具预测性的关键中间状态(局部区域∇F = 0)。随后,一个非参数模型从这些关键状态汇总最优解来预测结果。我们的数据集包括来自62例NSCLC患者的90例脑转移,并分析了srs后3个月的T1+c MR图像特征、7个NSCLC基因组特征和7个临床特征。采用8:2训练/测试分配,并训练5个独立模型以确保鲁棒性。在灵敏度、特异性、准确性和ROCAUC方面对性能进行基准测试,并将结果与(1)仅使用基于图像的特征的DNN和(2)不使用HBNODE模型的组合“I+G+C”特征进行比较。结果:F中梯度向量和势场的时间演化表明,临床特征在HBNODE实施的初始阶段贡献最大,其次是图像特征,而基因组特征在整个过程中贡献最小。HBNODE模型成功识别并组装了关键的中间状态,ROCAUC为0.88±0.04,灵敏度为0.79±0.02,特异性为0.86±0.01,准确度为0.84±0.01,其中不确定度代表标准差。相比之下,仅图像DNN模型的ROCAUC为0.71±0.05,灵敏度为0.66±0.32 (p = 0.086),而未HBNODE的“I+G+C”模型的ROCAUC为0.81±0.02,灵敏度为0.58±0.11 (p = 0.091)。结论:HBNODE模型有效地识别了BM放射性坏死和复发,增强了XAI框架的可解释性。它的表现鼓励了临床环境的进一步探索,并表明了在各种XAI领域的潜在适用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Medical physics
Medical physics 医学-核医学
CiteScore
6.80
自引率
15.80%
发文量
660
审稿时长
1.7 months
期刊介绍: Medical Physics publishes original, high impact physics, imaging science, and engineering research that advances patient diagnosis and therapy through contributions in 1) Basic science developments with high potential for clinical translation 2) Clinical applications of cutting edge engineering and physics innovations 3) Broadly applicable and innovative clinical physics developments Medical Physics is a journal of global scope and reach. By publishing in Medical Physics your research will reach an international, multidisciplinary audience including practicing medical physicists as well as physics- and engineering based translational scientists. We work closely with authors of promising articles to improve their quality.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信