Counterfactual MRI Generation with Denoising Diffusion Models for Interpretable Alzheimer's Disease Effect Detection.

Nikhil J Dhinagar, Sophia I Thomopoulos, Emily Laltoo, Paul M Thompson
{"title":"Counterfactual MRI Generation with Denoising Diffusion Models for Interpretable Alzheimer's Disease Effect Detection.","authors":"Nikhil J Dhinagar, Sophia I Thomopoulos, Emily Laltoo, Paul M Thompson","doi":"10.1109/EMBC53108.2024.10782737","DOIUrl":null,"url":null,"abstract":"<p><p>Generative AI models have recently achieved mainstream attention with the advent of powerful approaches such as SORA, DALL-E and stable diffusion. The underlying breakthrough generative mechanism of denoising diffusion modeling can generate high quality synthetic images and can learn the underlying distribution of complex, high-dimensional data. In our paper, we train conditional latent diffusion models (LDM) and denoising diffusion probabilistic models (DDPM) to provide insight into Alzheimer's disease (AD) effects on the brain's anatomy at the individual level. We first created diffusion models that could generate synthetic MRIs, by training them on real 3D T1-weighted MRI scans, and conditioning the generative process on the clinical diagnosis as a context variable. We conducted experiments to overcome limitations in training dataset size, compute time and memory resources by testing different models, effects of pretraining, training duration. We tested the sampling quality of the disease-conditioned diffusion using metrics to assess realism and diversity of the generated synthetic MRIs. We also evaluated the ability of diffusion models to conditionally sample MRI brains using a 3D CNN-based disease classifier relative to real MRIs. In our experiments, the diffusion models generated synthetic data that helped to train an AD classifier (using only 500 real MRI scans) - and boosted its performance by over 3% when tested on real MRI scans. Further, we used classifier-free guidance to alter the conditioning of an encoded individual scan to its counterfactual (representing a healthy subject of the same age and sex) while preserving subject-specific image details. From this counterfactual image (where the same person appears healthy), a personalized disease map was generated to identify possible disease effects on the brain. Our approach efficiently generates realistic and diverse synthetic data, and may create interpretable AI-based maps for neuroscience research and clinical diagnostic applications.</p>","PeriodicalId":72237,"journal":{"name":"Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference","volume":"2024 ","pages":"1-6"},"PeriodicalIF":0.0000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/EMBC53108.2024.10782737","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Generative AI models have recently achieved mainstream attention with the advent of powerful approaches such as SORA, DALL-E and stable diffusion. The underlying breakthrough generative mechanism of denoising diffusion modeling can generate high quality synthetic images and can learn the underlying distribution of complex, high-dimensional data. In our paper, we train conditional latent diffusion models (LDM) and denoising diffusion probabilistic models (DDPM) to provide insight into Alzheimer's disease (AD) effects on the brain's anatomy at the individual level. We first created diffusion models that could generate synthetic MRIs, by training them on real 3D T1-weighted MRI scans, and conditioning the generative process on the clinical diagnosis as a context variable. We conducted experiments to overcome limitations in training dataset size, compute time and memory resources by testing different models, effects of pretraining, training duration. We tested the sampling quality of the disease-conditioned diffusion using metrics to assess realism and diversity of the generated synthetic MRIs. We also evaluated the ability of diffusion models to conditionally sample MRI brains using a 3D CNN-based disease classifier relative to real MRIs. In our experiments, the diffusion models generated synthetic data that helped to train an AD classifier (using only 500 real MRI scans) - and boosted its performance by over 3% when tested on real MRI scans. Further, we used classifier-free guidance to alter the conditioning of an encoded individual scan to its counterfactual (representing a healthy subject of the same age and sex) while preserving subject-specific image details. From this counterfactual image (where the same person appears healthy), a personalized disease map was generated to identify possible disease effects on the brain. Our approach efficiently generates realistic and diverse synthetic data, and may create interpretable AI-based maps for neuroscience research and clinical diagnostic applications.

基于去噪扩散模型的反事实MRI生成用于可解释的阿尔茨海默病效应检测。
随着SORA、DALL-E和稳定扩散等强大方法的出现,生成式人工智能模型最近得到了主流的关注。底层突破性的去噪扩散建模生成机制可以生成高质量的合成图像,可以学习复杂高维数据的底层分布。在我们的论文中,我们训练条件潜在扩散模型(LDM)和去噪扩散概率模型(DDPM),以在个体水平上深入了解阿尔茨海默病(AD)对大脑解剖的影响。我们首先创建了可以生成合成MRI的扩散模型,通过在真实的3D t1加权MRI扫描上训练它们,并将临床诊断的生成过程作为上下文变量进行调节。我们通过测试不同的模型、预训练的效果、训练持续时间来克服训练数据集大小、计算时间和内存资源的限制。我们使用度量来评估生成的合成核磁共振成像的真实性和多样性,测试了疾病条件扩散的采样质量。我们还评估了扩散模型使用基于3D cnn的疾病分类器相对于真实MRI有条件地采样MRI大脑的能力。在我们的实验中,扩散模型生成的合成数据有助于训练AD分类器(仅使用500次真实的MRI扫描),并在真实的MRI扫描上测试时将其性能提高了3%以上。此外,我们使用无分类器指导来改变对编码个体扫描的条件反射,使其符合反事实(代表相同年龄和性别的健康受试者),同时保留受试者特定的图像细节。从这个反事实的图像(同一个人看起来很健康)中,生成了一个个性化的疾病地图,以识别可能的疾病对大脑的影响。我们的方法有效地生成真实和多样化的合成数据,并可能为神经科学研究和临床诊断应用创建可解释的基于人工智能的地图。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
0.80
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信