ADASSM:图像统计形状模型中的对抗性数据增强。

Mokshagna Sai Teja Karanam, Tushar Kataria, Krithika Iyer, Shireen Y Elhabian
{"title":"ADASSM:图像统计形状模型中的对抗性数据增强。","authors":"Mokshagna Sai Teja Karanam, Tushar Kataria, Krithika Iyer, Shireen Y Elhabian","doi":"10.1007/978-3-031-46914-5_8","DOIUrl":null,"url":null,"abstract":"<p><p>Statistical shape models (SSM) have been well-established as an excellent tool for identifying variations in the morphology of anatomy across the underlying population. Shape models use consistent shape representation across all the samples in a given cohort, which helps to compare shapes and identify the variations that can detect pathologies and help in formulating treatment plans. In medical imaging, computing these shape representations from CT/MRI scans requires time-intensive preprocessing operations, including but not limited to anatomy segmentation annotations, registration, and texture denoising. Deep learning models have demonstrated exceptional capabilities in learning shape representations directly from volumetric images, giving rise to highly effective and efficient Image-to-SSM networks. Nevertheless, these models are data-hungry and due to the limited availability of medical data, deep learning models tend to overfit. Offline data augmentation techniques, that use kernel density estimation based (KDE) methods for generating shape-augmented samples, have successfully aided Image-to-SSM networks in achieving comparable accuracy to traditional SSM methods. However, these augmentation methods focus on shape augmentation, whereas deep learning models exhibit image-based texture bias resulting in sub-optimal models. This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. The proposed framework is trained as an adversary to the Image-to-SSM network, augmenting diverse and challenging noisy samples. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":"14350 ","pages":"90-104"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11251192/pdf/","citationCount":"0","resultStr":"{\"title\":\"ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images.\",\"authors\":\"Mokshagna Sai Teja Karanam, Tushar Kataria, Krithika Iyer, Shireen Y Elhabian\",\"doi\":\"10.1007/978-3-031-46914-5_8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Statistical shape models (SSM) have been well-established as an excellent tool for identifying variations in the morphology of anatomy across the underlying population. Shape models use consistent shape representation across all the samples in a given cohort, which helps to compare shapes and identify the variations that can detect pathologies and help in formulating treatment plans. In medical imaging, computing these shape representations from CT/MRI scans requires time-intensive preprocessing operations, including but not limited to anatomy segmentation annotations, registration, and texture denoising. Deep learning models have demonstrated exceptional capabilities in learning shape representations directly from volumetric images, giving rise to highly effective and efficient Image-to-SSM networks. Nevertheless, these models are data-hungry and due to the limited availability of medical data, deep learning models tend to overfit. Offline data augmentation techniques, that use kernel density estimation based (KDE) methods for generating shape-augmented samples, have successfully aided Image-to-SSM networks in achieving comparable accuracy to traditional SSM methods. However, these augmentation methods focus on shape augmentation, whereas deep learning models exhibit image-based texture bias resulting in sub-optimal models. This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. The proposed framework is trained as an adversary to the Image-to-SSM network, augmenting diverse and challenging noisy samples. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.</p>\",\"PeriodicalId\":516531,\"journal\":{\"name\":\"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)\",\"volume\":\"14350 \",\"pages\":\"90-104\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11251192/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/978-3-031-46914-5_8\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/10/31 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-46914-5_8","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/10/31 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

统计形状模型(SSM)已被公认为是一种极好的工具,可用于识别潜在人群中解剖形态的变化。形状模型在给定队列中的所有样本中使用一致的形状表示,这有助于比较形状和识别可检测病理和帮助制定治疗计划的变异。在医学成像中,从 CT/MRI 扫描中计算这些形状表示需要耗费大量时间进行预处理操作,包括但不限于解剖分割注释、配准和纹理去噪。深度学习模型在直接从容积图像中学习形状表征方面表现出了卓越的能力,从而产生了高效的 "图像-到-SSM "网络。然而,这些模型对数据的要求很高,而且由于医疗数据的可用性有限,深度学习模型往往会过度拟合。离线数据增强技术使用基于核密度估计(KDE)的方法生成形状增强样本,成功地帮助图像到 SMM 网络实现了与传统 SSM 方法相当的准确性。然而,这些增强方法侧重于形状增强,而深度学习模型则表现出基于图像的纹理偏差,从而导致次优模型的产生。本文通过利用与数据相关的噪声生成或纹理增强,为图像到 SSM 框架引入了一种新的即时数据增强策略。所提出的框架是作为图像-到-SSM 网络的对手进行训练的,它增强了各种具有挑战性的噪声样本。我们的方法通过鼓励模型关注底层几何而非仅仅依赖像素值来提高准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images.

Statistical shape models (SSM) have been well-established as an excellent tool for identifying variations in the morphology of anatomy across the underlying population. Shape models use consistent shape representation across all the samples in a given cohort, which helps to compare shapes and identify the variations that can detect pathologies and help in formulating treatment plans. In medical imaging, computing these shape representations from CT/MRI scans requires time-intensive preprocessing operations, including but not limited to anatomy segmentation annotations, registration, and texture denoising. Deep learning models have demonstrated exceptional capabilities in learning shape representations directly from volumetric images, giving rise to highly effective and efficient Image-to-SSM networks. Nevertheless, these models are data-hungry and due to the limited availability of medical data, deep learning models tend to overfit. Offline data augmentation techniques, that use kernel density estimation based (KDE) methods for generating shape-augmented samples, have successfully aided Image-to-SSM networks in achieving comparable accuracy to traditional SSM methods. However, these augmentation methods focus on shape augmentation, whereas deep learning models exhibit image-based texture bias resulting in sub-optimal models. This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. The proposed framework is trained as an adversary to the Image-to-SSM network, augmenting diverse and challenging noisy samples. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信