将广义骰子重叠作为深度学习损失函数用于高度不平衡分割

Carole H Sudre, Wenqi Li, Tom Vercauteren, Sebastien Ourselin, M Jorge Cardoso
{"title":"将广义骰子重叠作为深度学习损失函数用于高度不平衡分割","authors":"Carole H Sudre, Wenqi Li, Tom Vercauteren, Sebastien Ourselin, M Jorge Cardoso","doi":"10.1007/978-3-319-67558-9_28","DOIUrl":null,"url":null,"abstract":"<p><p>Deep-learning has proved in recent years to be a powerful tool for image analysis and is now widely used to segment both 2D and 3D medical images. Deep-learning segmentation frameworks rely not only on the choice of network architecture but also on the choice of loss function. When the segmentation process targets rare observations, a severe class imbalance is likely to occur between candidate labels, thus resulting in sub-optimal performance. In order to mitigate this issue, strategies such as the weighted cross-entropy function, the sensitivity function or the Dice loss function, have been proposed. In this work, we investigate the behavior of these loss functions and their sensitivity to learning rate tuning in the presence of different rates of label imbalance across 2D and 3D segmentation tasks. We also propose to use the class re-balancing properties of the Generalized Dice overlap, a known metric for segmentation assessment, as a robust and accurate deep-learning loss function for unbalanced tasks.</p>","PeriodicalId":92023,"journal":{"name":"Deep learning in medical image analysis and multimodal learning for clinical decision support : Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, held in conjunction with MICCAI 2017 Quebec City, QC,...","volume":"2017 ","pages":"240-248"},"PeriodicalIF":0.0000,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7610921/pdf/EMS126388.pdf","citationCount":"0","resultStr":"{\"title\":\"Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations.\",\"authors\":\"Carole H Sudre, Wenqi Li, Tom Vercauteren, Sebastien Ourselin, M Jorge Cardoso\",\"doi\":\"10.1007/978-3-319-67558-9_28\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Deep-learning has proved in recent years to be a powerful tool for image analysis and is now widely used to segment both 2D and 3D medical images. Deep-learning segmentation frameworks rely not only on the choice of network architecture but also on the choice of loss function. When the segmentation process targets rare observations, a severe class imbalance is likely to occur between candidate labels, thus resulting in sub-optimal performance. In order to mitigate this issue, strategies such as the weighted cross-entropy function, the sensitivity function or the Dice loss function, have been proposed. In this work, we investigate the behavior of these loss functions and their sensitivity to learning rate tuning in the presence of different rates of label imbalance across 2D and 3D segmentation tasks. We also propose to use the class re-balancing properties of the Generalized Dice overlap, a known metric for segmentation assessment, as a robust and accurate deep-learning loss function for unbalanced tasks.</p>\",\"PeriodicalId\":92023,\"journal\":{\"name\":\"Deep learning in medical image analysis and multimodal learning for clinical decision support : Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, held in conjunction with MICCAI 2017 Quebec City, QC,...\",\"volume\":\"2017 \",\"pages\":\"240-248\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7610921/pdf/EMS126388.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Deep learning in medical image analysis and multimodal learning for clinical decision support : Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, held in conjunction with MICCAI 2017 Quebec City, QC,...\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/978-3-319-67558-9_28\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2017/9/9 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Deep learning in medical image analysis and multimodal learning for clinical decision support : Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, held in conjunction with MICCAI 2017 Quebec City, QC,...","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-319-67558-9_28","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2017/9/9 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

近年来,深度学习已被证明是一种强大的图像分析工具,现已广泛应用于二维和三维医学图像的分割。深度学习分割框架不仅取决于网络架构的选择,还取决于损失函数的选择。当分割过程以罕见观察结果为目标时,候选标签之间很可能会出现严重的类不平衡,从而导致性能不达标。为了缓解这一问题,有人提出了加权交叉熵函数、灵敏度函数或 Dice 损失函数等策略。在这项工作中,我们研究了这些损失函数的行为,以及它们在二维和三维分割任务中存在不同标签不平衡率时对学习率调整的敏感性。我们还建议使用广义骰子重叠(一种已知的分割评估指标)的类再平衡特性,作为不平衡任务的稳健而准确的深度学习损失函数。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations.

Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations.

Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations.

Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations.

Deep-learning has proved in recent years to be a powerful tool for image analysis and is now widely used to segment both 2D and 3D medical images. Deep-learning segmentation frameworks rely not only on the choice of network architecture but also on the choice of loss function. When the segmentation process targets rare observations, a severe class imbalance is likely to occur between candidate labels, thus resulting in sub-optimal performance. In order to mitigate this issue, strategies such as the weighted cross-entropy function, the sensitivity function or the Dice loss function, have been proposed. In this work, we investigate the behavior of these loss functions and their sensitivity to learning rate tuning in the presence of different rates of label imbalance across 2D and 3D segmentation tasks. We also propose to use the class re-balancing properties of the Generalized Dice overlap, a known metric for segmentation assessment, as a robust and accurate deep-learning loss function for unbalanced tasks.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信