{"title":"基于UXNet的多流多尺度融合肋骨骨折分割网络。","authors":"Yusi Liu, Liyuan Zhang, Zhengang Jiang","doi":"10.21037/qims-24-1356","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Accurate segmentation of rib fractures represents a pivotal procedure within surgical interventions. This meticulous process not only mitigates the likelihood of postoperative complications but also facilitates expedited patient recuperation. However, rib fractures in computed tomography (CT) images exhibit an uneven morphology and are not fixed in position, posing difficulties in segmenting fractures. This study aims to enhance the accuracy of elongated rib fracture segmentation, ultimately improving the efficiency of clinical diagnosis.</p><p><strong>Methods: </strong>In this study, we propose multi-stream and multi-scale fusion network based on efficient attention UXNet (M2SUXNet). It aims to enhance the segmentation accuracy of elongated rib fractures through multi-scale fusion attention enhancement. Firstly, we propose the multi-stream and multi-scale fusion (M2SF) module in the feature extraction stage. The module is designed with two parallel paths. Each path analyzes the image content using a different feature level. Then, the module effectively distinguishes the more critical feature information in the channel according to the feature weight ratio. The M2SF module integrates information from different scales to obtain comprehensive information on global and local features, achieving a more diverse feature representation. Secondly, the efficient attention (EA) module combines different channel information of input features to integrate channel and spatial features of different channels. The module better combines the context information, establishes the dependency between the space and the channel, enhances the focusing ability of the network on the fractures of different shapes, and improves the segmentation accuracy. Thirdly, the joint loss function of BCE with Logits Loss and Dice Loss is used to solve the sample imbalance problem.</p><p><strong>Results: </strong>We verified the effectiveness of the proposed model on the public RibFrac dataset. The experimental results demonstrated that the model achieved a Dice coefficient of 75.34%, a joint intersection over union (IoU) of 60.44%, and a precision of 93.79%.</p><p><strong>Conclusions: </strong>The proposed model for rib fracture segmentation has higher accuracy and feasibility than other existing models. Besides, the M2SUXNet can effectively improve the segmentation performance of elongated rib fractures.</p>","PeriodicalId":54267,"journal":{"name":"Quantitative Imaging in Medicine and Surgery","volume":"15 1","pages":"230-248"},"PeriodicalIF":2.9000,"publicationDate":"2025-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11744184/pdf/","citationCount":"0","resultStr":"{\"title\":\"Multi-stream and multi-scale fusion rib fracture segmentation network based on UXNet.\",\"authors\":\"Yusi Liu, Liyuan Zhang, Zhengang Jiang\",\"doi\":\"10.21037/qims-24-1356\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Accurate segmentation of rib fractures represents a pivotal procedure within surgical interventions. This meticulous process not only mitigates the likelihood of postoperative complications but also facilitates expedited patient recuperation. However, rib fractures in computed tomography (CT) images exhibit an uneven morphology and are not fixed in position, posing difficulties in segmenting fractures. This study aims to enhance the accuracy of elongated rib fracture segmentation, ultimately improving the efficiency of clinical diagnosis.</p><p><strong>Methods: </strong>In this study, we propose multi-stream and multi-scale fusion network based on efficient attention UXNet (M2SUXNet). It aims to enhance the segmentation accuracy of elongated rib fractures through multi-scale fusion attention enhancement. Firstly, we propose the multi-stream and multi-scale fusion (M2SF) module in the feature extraction stage. The module is designed with two parallel paths. Each path analyzes the image content using a different feature level. Then, the module effectively distinguishes the more critical feature information in the channel according to the feature weight ratio. The M2SF module integrates information from different scales to obtain comprehensive information on global and local features, achieving a more diverse feature representation. Secondly, the efficient attention (EA) module combines different channel information of input features to integrate channel and spatial features of different channels. The module better combines the context information, establishes the dependency between the space and the channel, enhances the focusing ability of the network on the fractures of different shapes, and improves the segmentation accuracy. Thirdly, the joint loss function of BCE with Logits Loss and Dice Loss is used to solve the sample imbalance problem.</p><p><strong>Results: </strong>We verified the effectiveness of the proposed model on the public RibFrac dataset. The experimental results demonstrated that the model achieved a Dice coefficient of 75.34%, a joint intersection over union (IoU) of 60.44%, and a precision of 93.79%.</p><p><strong>Conclusions: </strong>The proposed model for rib fracture segmentation has higher accuracy and feasibility than other existing models. Besides, the M2SUXNet can effectively improve the segmentation performance of elongated rib fractures.</p>\",\"PeriodicalId\":54267,\"journal\":{\"name\":\"Quantitative Imaging in Medicine and Surgery\",\"volume\":\"15 1\",\"pages\":\"230-248\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2025-01-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11744184/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Quantitative Imaging in Medicine and Surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.21037/qims-24-1356\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/12/30 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Quantitative Imaging in Medicine and Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.21037/qims-24-1356","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/12/30 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
摘要
背景:肋骨骨折的准确分割是外科干预中的关键步骤。这一细致的过程不仅减少了术后并发症的可能性,而且有助于加快患者的康复。然而,肋骨骨折在计算机断层扫描(CT)图像中表现出不均匀的形态和不固定的位置,给骨折分割带来困难。本研究旨在提高细长肋骨折分割的准确性,最终提高临床诊断的效率。方法:在本研究中,我们提出了基于高效关注UXNet的多流多尺度融合网络(M2SUXNet)。通过多尺度融合注意力增强,提高细长肋骨折的分割精度。首先,在特征提取阶段提出了多流多尺度融合(M2SF)模块;该模块采用两条并行路径设计。每个路径使用不同的特征级别分析图像内容。然后,该模块根据特征权重比有效区分通道中较为关键的特征信息。M2SF模块集成了不同尺度的信息,获得了全局和局部特征的综合信息,实现了更多样化的特征表示。其次,高效关注(EA)模块结合输入特征的不同通道信息,整合不同通道的通道和空间特征。该模块更好地结合了上下文信息,建立了空间与通道之间的依赖关系,增强了网络对不同形状裂缝的聚焦能力,提高了分割精度。第三,利用Logits loss和Dice loss的BCE联合损失函数来解决样本不平衡问题。结果:我们在公开的RibFrac数据集上验证了所提出模型的有效性。实验结果表明,该模型的Dice系数为75.34%,joint intersection over union (IoU)为60.44%,精度为93.79%。结论:所建立的肋骨骨折分割模型比现有模型具有更高的准确性和可行性。此外,M2SUXNet还能有效提高细长肋骨折的分割性能。
Multi-stream and multi-scale fusion rib fracture segmentation network based on UXNet.
Background: Accurate segmentation of rib fractures represents a pivotal procedure within surgical interventions. This meticulous process not only mitigates the likelihood of postoperative complications but also facilitates expedited patient recuperation. However, rib fractures in computed tomography (CT) images exhibit an uneven morphology and are not fixed in position, posing difficulties in segmenting fractures. This study aims to enhance the accuracy of elongated rib fracture segmentation, ultimately improving the efficiency of clinical diagnosis.
Methods: In this study, we propose multi-stream and multi-scale fusion network based on efficient attention UXNet (M2SUXNet). It aims to enhance the segmentation accuracy of elongated rib fractures through multi-scale fusion attention enhancement. Firstly, we propose the multi-stream and multi-scale fusion (M2SF) module in the feature extraction stage. The module is designed with two parallel paths. Each path analyzes the image content using a different feature level. Then, the module effectively distinguishes the more critical feature information in the channel according to the feature weight ratio. The M2SF module integrates information from different scales to obtain comprehensive information on global and local features, achieving a more diverse feature representation. Secondly, the efficient attention (EA) module combines different channel information of input features to integrate channel and spatial features of different channels. The module better combines the context information, establishes the dependency between the space and the channel, enhances the focusing ability of the network on the fractures of different shapes, and improves the segmentation accuracy. Thirdly, the joint loss function of BCE with Logits Loss and Dice Loss is used to solve the sample imbalance problem.
Results: We verified the effectiveness of the proposed model on the public RibFrac dataset. The experimental results demonstrated that the model achieved a Dice coefficient of 75.34%, a joint intersection over union (IoU) of 60.44%, and a precision of 93.79%.
Conclusions: The proposed model for rib fracture segmentation has higher accuracy and feasibility than other existing models. Besides, the M2SUXNet can effectively improve the segmentation performance of elongated rib fractures.