{"title":"Enhancement and Lightweight Fusion U-Net for Segmentation of Cardiac Structures in MRI","authors":"U. Salim, Shefa A. Dawwd, F. Ali","doi":"10.1109/IT-ELA52201.2021.9773601","DOIUrl":null,"url":null,"abstract":"Magnetic resonance imaging technology and the segmentation process are essential parts in obtaining accurate diagnosis of cardiac diseases. Recently, deep learning networks have shown progress in achieving good accuracy. However, the 2D network may not produce the required accuracy, and the use of 3D networks is restricted because of the computation and storage complexities. In this paper, a lightweight fusion U-Net (LWFU-Net) is proposed to achieve the trade-off between segmentation accuracy and complexities. LWFU-Net is a new variant of U-Net and LVRV-Net. It enhances 2D information by using a propagation flow approach with multipath and multilevel fusion. LWFU-Net operates via three stages. First, the adjacent slices of target slice are fused by using traditional average method, generating context information. Subsequently, the target slice is segmented similar to U-Net network, where the context information is fused with the target slice and the decoding results via concatenation operator and then processes information by using convolutional layers. Finally, the deep supervision generates the final outcome. The proposed networks are evaluated on the public Automated Cardiac Diagnosis Challenge dataset by using fivefold cross validation. LWFU-Net outperforms single-path LWU-Net and agrees with the LVRV-Net. The best performance of LWFU-Net exhibits mean dice similarity scores of 0.939 left ventricular cavity, 0.861 right ventricular cavity, and 0.885 left ventricular myocardium over the subtest of 10% of training set. Results demonstrate that LWFU-Net has an acceptable usage of 51 MB (weight memory), 13,274,252 (trainable parameters), and 20 G flop. It achieves a speedup of 6 for the training and approximately 2 for the testing.","PeriodicalId":330552,"journal":{"name":"2021 2nd Information Technology To Enhance e-learning and Other Application (IT-ELA)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 2nd Information Technology To Enhance e-learning and Other Application (IT-ELA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IT-ELA52201.2021.9773601","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Magnetic resonance imaging technology and the segmentation process are essential parts in obtaining accurate diagnosis of cardiac diseases. Recently, deep learning networks have shown progress in achieving good accuracy. However, the 2D network may not produce the required accuracy, and the use of 3D networks is restricted because of the computation and storage complexities. In this paper, a lightweight fusion U-Net (LWFU-Net) is proposed to achieve the trade-off between segmentation accuracy and complexities. LWFU-Net is a new variant of U-Net and LVRV-Net. It enhances 2D information by using a propagation flow approach with multipath and multilevel fusion. LWFU-Net operates via three stages. First, the adjacent slices of target slice are fused by using traditional average method, generating context information. Subsequently, the target slice is segmented similar to U-Net network, where the context information is fused with the target slice and the decoding results via concatenation operator and then processes information by using convolutional layers. Finally, the deep supervision generates the final outcome. The proposed networks are evaluated on the public Automated Cardiac Diagnosis Challenge dataset by using fivefold cross validation. LWFU-Net outperforms single-path LWU-Net and agrees with the LVRV-Net. The best performance of LWFU-Net exhibits mean dice similarity scores of 0.939 left ventricular cavity, 0.861 right ventricular cavity, and 0.885 left ventricular myocardium over the subtest of 10% of training set. Results demonstrate that LWFU-Net has an acceptable usage of 51 MB (weight memory), 13,274,252 (trainable parameters), and 20 G flop. It achieves a speedup of 6 for the training and approximately 2 for the testing.
磁共振成像技术和分割过程是获得心脏疾病准确诊断的关键环节。最近,深度学习网络在实现良好的准确性方面取得了进展。然而,2D网络可能无法产生所需的精度,并且由于计算和存储的复杂性,3D网络的使用受到限制。本文提出了一种轻量级融合U-Net (LWFU-Net),以实现分割精度和复杂度之间的平衡。LWFU-Net是U-Net和LVRV-Net的新变种。该算法采用多路径、多层次融合的传播流方法增强二维信息。LWFU-Net通过三个阶段运作。首先,采用传统的平均方法对目标切片的相邻切片进行融合,生成上下文信息;然后,类似于U-Net网络对目标切片进行分割,通过串接算子将上下文信息与目标切片和解码结果融合,然后使用卷积层对信息进行处理。最后,深度监督产生了最终的结果。通过使用五倍交叉验证,在公共自动心脏诊断挑战数据集上评估了所提出的网络。LWFU-Net优于单路径LWU-Net,与LVRV-Net一致。LWFU-Net在训练集10%的子测试上表现最佳,平均骰子相似度得分为0.939左心室,0.861右心室,0.885左心室心肌。结果表明,LWFU-Net具有51 MB(权重内存),13,274,252(可训练参数)和20 G flop的可接受使用率。它在训练中实现了6的加速,在测试中实现了大约2的加速。