Enhanced Segmentation of Active and Nonactive Multiple Sclerosis Plaques in T1 and FLAIR MRI Images Using Transformer-Based Encoders

IF 2.5 4区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Mahsa Naeeni Davarani, Ali Arian Darestani, Virginia Guillen Cañas, Mohammad Hossein Harirchian, Amin Zarei, Sanaz Heydari Havadaragh, Hasan Hashemi
{"title":"Enhanced Segmentation of Active and Nonactive Multiple Sclerosis Plaques in T1 and FLAIR MRI Images Using Transformer-Based Encoders","authors":"Mahsa Naeeni Davarani,&nbsp;Ali Arian Darestani,&nbsp;Virginia Guillen Cañas,&nbsp;Mohammad Hossein Harirchian,&nbsp;Amin Zarei,&nbsp;Sanaz Heydari Havadaragh,&nbsp;Hasan Hashemi","doi":"10.1002/ima.70120","DOIUrl":null,"url":null,"abstract":"<p>Demyelinating plaques in multiple sclerosis (MS) can be visualized using magnetic resonance imaging (MRI), where accurate segmentation of active and nonactive lesions is critical for diagnosis, monitoring disease progression, and guiding treatment. Fluid-attenuated inversion recovery )FLAIR( images are widely used to detect both types of lesions, while T1-weighted images are, particularly, useful for identifying active plaques, although they are more challenging to segment due to their lower contrast and smaller lesion size. To enhance the segmentation accuracy of MS plaques, focusing on both active and non-active lesions, by utilizing TransUNet, a transformer-based neural network. The model's performance is evaluated on T1-weighted and FLAIR MRI images, with a specific focus on improving the segmentation of active plaques in T1-weighted images, which are traditionally more difficult to segment. The dataset included MRI scans from 174 patients diagnosed with MS, a significant expansion compared to previous studies. Additionally, 21 external subject test data were used to validate the model's generalizability. TransUNet was applied separately to T1-weighted and FLAIR images. Preprocessing steps included skull stripping and normalization. The model's performance was assessed using standard evaluation metrics, including Dice Coefficient, sensitivity, specificity, intersection over union (IoU), and Hausdorff distance at 95% (HD95). The study also conducted a comparative analysis between TransUNet and the widely used nnU-Net model. For FLAIR images, TransUNet achieved a sensitivity of 0.763, specificity of 0.998, IoU of 0.563, Dice coefficient of 0.712, and HD95 of 5.402 mm on the internal test set. On the external test set, it maintained a sensitivity of 0.739, specificity of 0.999, IoU of 0.551, Dice coefficient of 0.704, and HD95 of 14.630 mm. For T1-weighted images, the model showed a sensitivity of 0.494, specificity of 1.000, IoU of 0.411, Dice coefficient of 0.548, and HD95 of 22.144 mm on the internal test set. On the external test set, it improved to a sensitivity of 0.725, specificity of 0.999, IoU of 0.573, Dice coefficient of 0.693, and HD95 of 5.146 mm. Compared to nnU-Net on FLAIR images, TransUNet achieved a higher Dice coefficient (0.712 vs. 0.710) and significantly lower HD95 (5.402 vs. 28.300 mm). TransUNet significantly outperforms traditional methods, particularly in FLAIR images, demonstrating improved accuracy and boundary delineation. While T1-weighted images present challenges, the model shows potential for refinement. This study highlights the effectiveness of transformer-based architectures in medical image segmentation, suggesting TransUNet as a valuable tool for MS diagnosis and treatment monitoring.</p>","PeriodicalId":14027,"journal":{"name":"International Journal of Imaging Systems and Technology","volume":"35 3","pages":""},"PeriodicalIF":2.5000,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ima.70120","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Imaging Systems and Technology","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ima.70120","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Demyelinating plaques in multiple sclerosis (MS) can be visualized using magnetic resonance imaging (MRI), where accurate segmentation of active and nonactive lesions is critical for diagnosis, monitoring disease progression, and guiding treatment. Fluid-attenuated inversion recovery )FLAIR( images are widely used to detect both types of lesions, while T1-weighted images are, particularly, useful for identifying active plaques, although they are more challenging to segment due to their lower contrast and smaller lesion size. To enhance the segmentation accuracy of MS plaques, focusing on both active and non-active lesions, by utilizing TransUNet, a transformer-based neural network. The model's performance is evaluated on T1-weighted and FLAIR MRI images, with a specific focus on improving the segmentation of active plaques in T1-weighted images, which are traditionally more difficult to segment. The dataset included MRI scans from 174 patients diagnosed with MS, a significant expansion compared to previous studies. Additionally, 21 external subject test data were used to validate the model's generalizability. TransUNet was applied separately to T1-weighted and FLAIR images. Preprocessing steps included skull stripping and normalization. The model's performance was assessed using standard evaluation metrics, including Dice Coefficient, sensitivity, specificity, intersection over union (IoU), and Hausdorff distance at 95% (HD95). The study also conducted a comparative analysis between TransUNet and the widely used nnU-Net model. For FLAIR images, TransUNet achieved a sensitivity of 0.763, specificity of 0.998, IoU of 0.563, Dice coefficient of 0.712, and HD95 of 5.402 mm on the internal test set. On the external test set, it maintained a sensitivity of 0.739, specificity of 0.999, IoU of 0.551, Dice coefficient of 0.704, and HD95 of 14.630 mm. For T1-weighted images, the model showed a sensitivity of 0.494, specificity of 1.000, IoU of 0.411, Dice coefficient of 0.548, and HD95 of 22.144 mm on the internal test set. On the external test set, it improved to a sensitivity of 0.725, specificity of 0.999, IoU of 0.573, Dice coefficient of 0.693, and HD95 of 5.146 mm. Compared to nnU-Net on FLAIR images, TransUNet achieved a higher Dice coefficient (0.712 vs. 0.710) and significantly lower HD95 (5.402 vs. 28.300 mm). TransUNet significantly outperforms traditional methods, particularly in FLAIR images, demonstrating improved accuracy and boundary delineation. While T1-weighted images present challenges, the model shows potential for refinement. This study highlights the effectiveness of transformer-based architectures in medical image segmentation, suggesting TransUNet as a valuable tool for MS diagnosis and treatment monitoring.

Abstract Image

使用基于变压器的编码器增强T1和FLAIR MRI图像中活动和非活动多发性硬化症斑块的分割
多发性硬化症(MS)的脱髓鞘斑块可以使用磁共振成像(MRI)可视化,其中准确分割活动性和非活动性病变对于诊断、监测疾病进展和指导治疗至关重要。FLAIR图像被广泛用于检测这两种类型的病变,而t1加权图像尤其适用于识别活动斑块,尽管由于其对比度较低且病变面积较小,其分割更具挑战性。为了提高MS斑块的分割精度,重点关注活动和非活动病变,利用TransUNet,一个基于变压器的神经网络。该模型的性能在t1加权和FLAIR MRI图像上进行了评估,特别关注改善t1加权图像中活动斑块的分割,这在传统上更难分割。该数据集包括174名诊断为多发性硬化症的患者的MRI扫描,与之前的研究相比,这是一个显著的扩展。此外,还使用了21个外部受试者测试数据来验证模型的可推广性。TransUNet分别应用于t1加权图像和FLAIR图像。预处理步骤包括颅骨剥离和归一化。采用标准评价指标对模型的性能进行评估,包括Dice系数、敏感性、特异性、交集/联合(IoU)和95%时的Hausdorff距离(HD95)。本研究还对TransUNet和广泛使用的nnU-Net模型进行了比较分析。对于FLAIR图像,TransUNet在内测集上的灵敏度为0.763,特异度为0.998,IoU为0.563,Dice系数为0.712,HD95为5.402 mm。在外部测试集上,其敏感性为0.739,特异性为0.999,IoU为0.551,Dice系数为0.704,HD95为14.630 mm。对于t1加权图像,该模型在内测集上的灵敏度为0.494,特异性为1.000,IoU为0.411,Dice系数为0.548,HD95为22.144 mm。在外部测试集上,其灵敏度为0.725,特异性为0.999,IoU为0.573,Dice系数为0.693,HD95为5.146 mm。与nnU-Net相比,TransUNet在FLAIR图像上获得了更高的Dice系数(0.712对0.710)和显着更低的HD95(5.402对28.300 mm)。TransUNet明显优于传统方法,特别是在FLAIR图像中,显示出更高的准确性和边界划分。虽然t1加权图像存在挑战,但该模型显示了改进的潜力。这项研究强调了基于变压器的结构在医学图像分割中的有效性,表明TransUNet是MS诊断和治疗监测的有价值的工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Journal of Imaging Systems and Technology
International Journal of Imaging Systems and Technology 工程技术-成像科学与照相技术
CiteScore
6.90
自引率
6.10%
发文量
138
审稿时长
3 months
期刊介绍: The International Journal of Imaging Systems and Technology (IMA) is a forum for the exchange of ideas and results relevant to imaging systems, including imaging physics and informatics. The journal covers all imaging modalities in humans and animals. IMA accepts technically sound and scientifically rigorous research in the interdisciplinary field of imaging, including relevant algorithmic research and hardware and software development, and their applications relevant to medical research. The journal provides a platform to publish original research in structural and functional imaging. The journal is also open to imaging studies of the human body and on animals that describe novel diagnostic imaging and analyses methods. Technical, theoretical, and clinical research in both normal and clinical populations is encouraged. Submissions describing methods, software, databases, replication studies as well as negative results are also considered. The scope of the journal includes, but is not limited to, the following in the context of biomedical research: Imaging and neuro-imaging modalities: structural MRI, functional MRI, PET, SPECT, CT, ultrasound, EEG, MEG, NIRS etc.; Neuromodulation and brain stimulation techniques such as TMS and tDCS; Software and hardware for imaging, especially related to human and animal health; Image segmentation in normal and clinical populations; Pattern analysis and classification using machine learning techniques; Computational modeling and analysis; Brain connectivity and connectomics; Systems-level characterization of brain function; Neural networks and neurorobotics; Computer vision, based on human/animal physiology; Brain-computer interface (BCI) technology; Big data, databasing and data mining.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信