Erik Y Ohara, Vibujithan Vigneshwaran, Raissa Souza, Finn G Vamosi, Matthias Wilms, Nils D Forkert
{"title":"神经图像生成的三维因果深度学习的降维:一项评估研究。","authors":"Erik Y Ohara, Vibujithan Vigneshwaran, Raissa Souza, Finn G Vamosi, Matthias Wilms, Nils D Forkert","doi":"10.1117/1.JMI.12.2.024506","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Causal deep learning (DL) using normalizing flows allows the generation of true counterfactual images, which is relevant for many medical applications such as explainability of decisions, image harmonization, and in-silico studies. However, such models are computationally expensive when applied directly to high-resolution 3D images and, therefore, require image dimensionality reduction (DR) to efficiently process the data. The goal of this work was to compare how different DR methods affect counterfactual neuroimage generation.</p><p><strong>Approach: </strong>Five DR techniques [2D principal component analysis (PCA), 2.5D PCA, 3D PCA, autoencoder, and Vector Quantised-Variational AutoEncoder] were applied to 23,692 3D brain images to create low-dimensional representations for causal DL model training. Convolutional neural networks were used to quantitatively evaluate age and sex changes on the counterfactual neuroimages. Age alterations were measured using the mean absolute error (MAE), whereas sex changes were assessed via classification accuracy.</p><p><strong>Results: </strong>The 2.5D PCA technique achieved the lowest MAE of 4.16 when changing the age variable of an original image. When sex was changed, the autoencoder embedding led to the highest classification accuracy of 97.84% while also significantly impacting the age variable predictions, increasing the MAE to 5.24 years. Overall, 3D PCA provided the best balance, with an age prediction MAE of 4.57 years while maintaining 94.01% sex classification accuracy when altering the age variable and 94.73% sex classification accuracy and the lowest age prediction MAE (3.84 years) when altering the sex variable.</p><p><strong>Conclusions: </strong>3D PCA appears to be the best-suited DR method for causal neuroimage analysis.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 2","pages":"024506"},"PeriodicalIF":1.7000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12014944/pdf/","citationCount":"0","resultStr":"{\"title\":\"Dimensionality reduction in 3D causal deep learning for neuroimage generation: an evaluation study.\",\"authors\":\"Erik Y Ohara, Vibujithan Vigneshwaran, Raissa Souza, Finn G Vamosi, Matthias Wilms, Nils D Forkert\",\"doi\":\"10.1117/1.JMI.12.2.024506\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>Causal deep learning (DL) using normalizing flows allows the generation of true counterfactual images, which is relevant for many medical applications such as explainability of decisions, image harmonization, and in-silico studies. However, such models are computationally expensive when applied directly to high-resolution 3D images and, therefore, require image dimensionality reduction (DR) to efficiently process the data. The goal of this work was to compare how different DR methods affect counterfactual neuroimage generation.</p><p><strong>Approach: </strong>Five DR techniques [2D principal component analysis (PCA), 2.5D PCA, 3D PCA, autoencoder, and Vector Quantised-Variational AutoEncoder] were applied to 23,692 3D brain images to create low-dimensional representations for causal DL model training. Convolutional neural networks were used to quantitatively evaluate age and sex changes on the counterfactual neuroimages. Age alterations were measured using the mean absolute error (MAE), whereas sex changes were assessed via classification accuracy.</p><p><strong>Results: </strong>The 2.5D PCA technique achieved the lowest MAE of 4.16 when changing the age variable of an original image. When sex was changed, the autoencoder embedding led to the highest classification accuracy of 97.84% while also significantly impacting the age variable predictions, increasing the MAE to 5.24 years. Overall, 3D PCA provided the best balance, with an age prediction MAE of 4.57 years while maintaining 94.01% sex classification accuracy when altering the age variable and 94.73% sex classification accuracy and the lowest age prediction MAE (3.84 years) when altering the sex variable.</p><p><strong>Conclusions: </strong>3D PCA appears to be the best-suited DR method for causal neuroimage analysis.</p>\",\"PeriodicalId\":47707,\"journal\":{\"name\":\"Journal of Medical Imaging\",\"volume\":\"12 2\",\"pages\":\"024506\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2025-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12014944/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Medical Imaging\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1117/1.JMI.12.2.024506\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/4/22 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Imaging","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1117/1.JMI.12.2.024506","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/22 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
Dimensionality reduction in 3D causal deep learning for neuroimage generation: an evaluation study.
Purpose: Causal deep learning (DL) using normalizing flows allows the generation of true counterfactual images, which is relevant for many medical applications such as explainability of decisions, image harmonization, and in-silico studies. However, such models are computationally expensive when applied directly to high-resolution 3D images and, therefore, require image dimensionality reduction (DR) to efficiently process the data. The goal of this work was to compare how different DR methods affect counterfactual neuroimage generation.
Approach: Five DR techniques [2D principal component analysis (PCA), 2.5D PCA, 3D PCA, autoencoder, and Vector Quantised-Variational AutoEncoder] were applied to 23,692 3D brain images to create low-dimensional representations for causal DL model training. Convolutional neural networks were used to quantitatively evaluate age and sex changes on the counterfactual neuroimages. Age alterations were measured using the mean absolute error (MAE), whereas sex changes were assessed via classification accuracy.
Results: The 2.5D PCA technique achieved the lowest MAE of 4.16 when changing the age variable of an original image. When sex was changed, the autoencoder embedding led to the highest classification accuracy of 97.84% while also significantly impacting the age variable predictions, increasing the MAE to 5.24 years. Overall, 3D PCA provided the best balance, with an age prediction MAE of 4.57 years while maintaining 94.01% sex classification accuracy when altering the age variable and 94.73% sex classification accuracy and the lowest age prediction MAE (3.84 years) when altering the sex variable.
Conclusions: 3D PCA appears to be the best-suited DR method for causal neuroimage analysis.
期刊介绍:
JMI covers fundamental and translational research, as well as applications, focused on medical imaging, which continue to yield physical and biomedical advancements in the early detection, diagnostics, and therapy of disease as well as in the understanding of normal. The scope of JMI includes: Imaging physics, Tomographic reconstruction algorithms (such as those in CT and MRI), Image processing and deep learning, Computer-aided diagnosis and quantitative image analysis, Visualization and modeling, Picture archiving and communications systems (PACS), Image perception and observer performance, Technology assessment, Ultrasonic imaging, Image-guided procedures, Digital pathology, Biomedical applications of biomedical imaging. JMI allows for the peer-reviewed communication and archiving of scientific developments, translational and clinical applications, reviews, and recommendations for the field.