M.A. Kamphuis , E.H.G. Oei , J. Runhaar , D. Hanff , S.M.A. Bierma-Zeinstra , S. Klein , J. Hirvasniemi
{"title":"ENHANCING MODEL PERFORMANCE IN HIP JOINT SEGMENTATION BY LEVERAGING MULTIPLE IMAGE OUTPUTS FROM DIXON MRI","authors":"M.A. Kamphuis , E.H.G. Oei , J. Runhaar , D. Hanff , S.M.A. Bierma-Zeinstra , S. Klein , J. Hirvasniemi","doi":"10.1016/j.ostima.2024.100193","DOIUrl":null,"url":null,"abstract":"<div><h3>INTRODUCTION</h3><p>Exploring ways to improve methodologies for model training in MRI-based segmentation tasks is important for enhancing segmentation accuracy. Accurate automated segmentations are essential for applications including the extraction of imaging biomarkers. Leveraging advanced deep learning techniques, such as nnU-Net, holds promise for achieving precise segmentations. Additionally, incorporating multiple image outputs from Dixon MRI into these methodologies could improve segmentation performance.</p></div><div><h3>OBJECTIVE</h3><p>The aim of the study was to investigate whether the accuracy of an automated deep learning segmentation model for the hip joint could be improved by combining information from multiple image outputs from a Dixon sequence.</p></div><div><h3>METHODS</h3><p>Manual segmentations of 20 participants (40 hips) of the Generation R study, comprising individuals who were 19 years old (11 males, 9 females), were used to train an nnU-Net. The segmented regions included the femoral bone, acetabular bone, femoral cartilage, and acetabular cartilage in both the left and right hip. The 2D and 3D configurations of the nnU-Net were trained using 5-fold cross-validation and an ensemble of the 2D-3D configurations was used in the analyses. The input consisted of 1) water-only images from the Lava Flex sequence, with an in-plane resolution of 0.89 × 0.89 mm<sup>2</sup> and a slice thickness of 1.2 mm, 2) a combination of in-phase and water-only images, as well as 3) a combination of water-only and fat-only images from the same sequence, allowing for comparison between the methodologies. The combination of water-only and in-phase images was chosen for potentially increasing segmentation accuracy, following visual inspection. Additionally, the water-only and fat-only combination aimed to assess if segmentation results could be enhanced by offering additional tissue contrast. Evaluation was performed on a hold-out test set consisting of 10 manually segmented hips, using the Dice similarity coefficient (DSC) and mean surface distance (MSD).</p></div><div><h3>RESULTS</h3><p>The mean ±SD DSC for the segmentation of bone and cartilage in the hip using the 1) water-only vs 2) in-phase and water-only combination vs. 3) combination of fat-only and water-only images were as follows: femoral bone 1) 0.961±0.013 vs. 2) 0.967±0.004 vs. 3) 0.950±0.036, acetabular bone 1) 0.886±0.027 vs. 2) 0.893±0.021 vs. 3) 0.896±0.016, femoral cartilage 1) 0.762±0.018 vs. 2) 0.763±0.020 vs. 3) 0.752±0.023, and acetabular cartilage 1) 0.760±0.028 vs. 2) 0.768±0.022 vs. 3) 0.768±0.022. The MSDs were: femoral bone 1) 0.412± 0.105 mm vs. 2) 0.341±0.047 mm vs. 3) 0.297±5.59 mm, acetabular bone 1) 0.602±0.109 mm vs. 2) 0.567±0.097 mm vs. 3) 0.651±0.077 mm, femoral cartilage 1) 0.276±0.033 mm vs. 2) 0.271±0.034 mm vs. 3) 0.295±0.033 mm, and acetabular cartilage 1) 0.313±0.078 mm vs. 2) 0.282±0.049 mm vs. 3) 0.281±0.046 mm.</p></div><div><h3>CONCLUSION</h3><p>The results indicate that combining the in-phase and the water-only images for model training improves segmentation quality. Specifically, improved overlap and better alignment of the boundaries was observed, as indicated by higher DSCs, and reduced MSD. These results underscore the efficacy of using combined image outputs to enhance the accuracy of hip segmentation in MRI.</p></div>","PeriodicalId":74378,"journal":{"name":"Osteoarthritis imaging","volume":"4 ","pages":"Article 100193"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772654124000217/pdfft?md5=e1f4286e8a8e3a3f941cc6b986a250cd&pid=1-s2.0-S2772654124000217-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Osteoarthritis imaging","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772654124000217","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
INTRODUCTION
Exploring ways to improve methodologies for model training in MRI-based segmentation tasks is important for enhancing segmentation accuracy. Accurate automated segmentations are essential for applications including the extraction of imaging biomarkers. Leveraging advanced deep learning techniques, such as nnU-Net, holds promise for achieving precise segmentations. Additionally, incorporating multiple image outputs from Dixon MRI into these methodologies could improve segmentation performance.
OBJECTIVE
The aim of the study was to investigate whether the accuracy of an automated deep learning segmentation model for the hip joint could be improved by combining information from multiple image outputs from a Dixon sequence.
METHODS
Manual segmentations of 20 participants (40 hips) of the Generation R study, comprising individuals who were 19 years old (11 males, 9 females), were used to train an nnU-Net. The segmented regions included the femoral bone, acetabular bone, femoral cartilage, and acetabular cartilage in both the left and right hip. The 2D and 3D configurations of the nnU-Net were trained using 5-fold cross-validation and an ensemble of the 2D-3D configurations was used in the analyses. The input consisted of 1) water-only images from the Lava Flex sequence, with an in-plane resolution of 0.89 × 0.89 mm2 and a slice thickness of 1.2 mm, 2) a combination of in-phase and water-only images, as well as 3) a combination of water-only and fat-only images from the same sequence, allowing for comparison between the methodologies. The combination of water-only and in-phase images was chosen for potentially increasing segmentation accuracy, following visual inspection. Additionally, the water-only and fat-only combination aimed to assess if segmentation results could be enhanced by offering additional tissue contrast. Evaluation was performed on a hold-out test set consisting of 10 manually segmented hips, using the Dice similarity coefficient (DSC) and mean surface distance (MSD).
RESULTS
The mean ±SD DSC for the segmentation of bone and cartilage in the hip using the 1) water-only vs 2) in-phase and water-only combination vs. 3) combination of fat-only and water-only images were as follows: femoral bone 1) 0.961±0.013 vs. 2) 0.967±0.004 vs. 3) 0.950±0.036, acetabular bone 1) 0.886±0.027 vs. 2) 0.893±0.021 vs. 3) 0.896±0.016, femoral cartilage 1) 0.762±0.018 vs. 2) 0.763±0.020 vs. 3) 0.752±0.023, and acetabular cartilage 1) 0.760±0.028 vs. 2) 0.768±0.022 vs. 3) 0.768±0.022. The MSDs were: femoral bone 1) 0.412± 0.105 mm vs. 2) 0.341±0.047 mm vs. 3) 0.297±5.59 mm, acetabular bone 1) 0.602±0.109 mm vs. 2) 0.567±0.097 mm vs. 3) 0.651±0.077 mm, femoral cartilage 1) 0.276±0.033 mm vs. 2) 0.271±0.034 mm vs. 3) 0.295±0.033 mm, and acetabular cartilage 1) 0.313±0.078 mm vs. 2) 0.282±0.049 mm vs. 3) 0.281±0.046 mm.
CONCLUSION
The results indicate that combining the in-phase and the water-only images for model training improves segmentation quality. Specifically, improved overlap and better alignment of the boundaries was observed, as indicated by higher DSCs, and reduced MSD. These results underscore the efficacy of using combined image outputs to enhance the accuracy of hip segmentation in MRI.
引言 在基于核磁共振成像的分割任务中,探索如何改进模型训练方法对于提高分割准确性非常重要。准确的自动分割对于提取成像生物标记物等应用至关重要。利用先进的深度学习技术(如 nnU-Net)有望实现精确的分割。此外,将 Dixon 核磁共振成像的多个图像输出纳入这些方法可提高分割性能。研究的目的是探讨是否可以通过结合 Dixon 序列的多个图像输出信息来提高髋关节自动深度学习分割模型的准确性。分割区域包括左右髋部的股骨头、髋臼骨、股软骨和髋臼软骨。nnU-Net 的 2D 和 3D 配置通过 5 倍交叉验证进行了训练,在分析中使用了 2D-3D 配置的集合。输入包括:1)来自 Lava Flex 序列的纯水图像(平面内分辨率为 0.89 × 0.89 mm2,切片厚度为 1.2 mm);2)同相图像和纯水图像的组合;以及 3)来自同一序列的纯水图像和纯脂肪图像的组合,以便在不同方法之间进行比较。经目测,选择纯水图像和同相图像的组合可能会提高分割的准确性。此外,纯水和纯脂肪组合旨在评估是否可以通过提供额外的组织对比度来增强分割结果。使用 Dice 相似性系数(DSC)和平均表面距离(MSD)对由 10 个人工分割的髋关节组成的暂留测试集进行了评估。结果使用 1) 纯水 vs 2) 同相和纯水组合 vs 3) 纯脂肪和纯水组合分割髋关节骨骼和软骨的平均 ±SD DSC。股骨头 1) 0.961±0.013 vs. 2) 0.967±0.004 vs. 3) 0.950±0.036;髋臼骨 1) 0.886±0.027 vs. 2) 0.893±0.021 vs. 3) 0.896±0.016;股骨头软骨 1) 0.762±0.013 vs. 2) 0.762±0.014 vs. 3) 0.950±0.036。0.762±0.018 vs. 2) 0.763±0.020 vs. 3) 0.752±0.023,髋臼软骨 1)0.760±0.028 vs. 2) 0.768±0.022 vs. 3) 0.768±0.022。MSD为:股骨头 1) 0.412±0.105 mm vs. 2) 0.341±0.047 mm vs. 3) 0.297±5.59 mm,髋臼骨 1) 0.602±0.109 mm vs. 2) 0.567±0.097 mm vs. 3) 0.651±0.077 mm,股骨头软骨 1)0.276±0.033 mm vs. 2) 0.271±0.034 mm vs. 3) 0.295±0.033 mm,髋臼软骨 1)结果表明,结合同相图像和纯水图像进行模型训练可提高分割质量。具体来说,DSCs 提高了,MSD 减少了,这表明边界的重叠和对齐得到了改善。这些结果凸显了在核磁共振成像中使用组合图像输出来提高髋关节分割准确性的功效。