评估自监督xLSTM-UNet架构在头颈部肿瘤分割的mr引导应用。

Abdul Qayyum, Moona Mazher, Steven A Niederer
{"title":"评估自监督xLSTM-UNet架构在头颈部肿瘤分割的mr引导应用。","authors":"Abdul Qayyum, Moona Mazher, Steven A Niederer","doi":"10.1007/978-3-031-83274-1_12","DOIUrl":null,"url":null,"abstract":"<p><p>Radiation therapy (RT) plays a pivotal role in treating head and neck cancer (HNC), with MRI-guided approaches offering superior soft tissue contrast and daily adaptive capabilities that significantly enhance treatment precision while minimizing side effects. To optimize MRI-guided adaptive RT for HNC, we propose a novel two-stage model for Head and Neck Tumor Segmentation. In the first stage, we leverage a Self-Supervised 3D Student-Teacher Learning Framework, specifically utilizing the DINOv2 architecture, to learn effective representations from a limited unlabeled dataset. This approach effectively addresses the challenge posed by the scarcity of annotated data, enabling the model to generalize better in tumor identification and segmentation. In the second stage, we fine-tune an xLSTM-based UNet model that is specifically designed to capture both spatial and sequential features of tumor progression. This hybrid architecture improves segmentation accuracy by integrating temporal dependencies, making it particularly well-suited for MRI-guided adaptive RT planning in HNC. The model's performance is rigorously evaluated on a diverse set of HNC cases, demonstrating significant improvements over state-of-the-art deep learning models in accurately segmenting tumor structures. Our proposed solution achieved an impressive mean aggregated Dice Coefficient of 0.81 for pre-RT segments and 0.65 for mid-RT segments, underscoring its effectiveness in automated segmentation tasks. This work advances the field of HNC imaging by providing a robust, generalizable solution for automated Head and Neck Tumor Segmentation, ultimately enhancing the quality of care for patients undergoing RT. Our team name is DeepLearnAI (CEMRG). The code for this work is available at https://github.com/RespectKnowledge/SSL-based-DINOv2_Vision-LSTM_Head-and-Neck-Tumor_Segmentation.</p>","PeriodicalId":520475,"journal":{"name":"Head and Neck Tumor Segmentation for MR-Guided Applications : First MICCAI Challenge, HNTS-MRG 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 17, 2024, proceedings","volume":"15273 ","pages":"166-178"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12091698/pdf/","citationCount":"0","resultStr":"{\"title\":\"Assessing Self-supervised xLSTM-UNet Architectures for Head and Neck Tumor Segmentation in MR-Guided Applications.\",\"authors\":\"Abdul Qayyum, Moona Mazher, Steven A Niederer\",\"doi\":\"10.1007/978-3-031-83274-1_12\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Radiation therapy (RT) plays a pivotal role in treating head and neck cancer (HNC), with MRI-guided approaches offering superior soft tissue contrast and daily adaptive capabilities that significantly enhance treatment precision while minimizing side effects. To optimize MRI-guided adaptive RT for HNC, we propose a novel two-stage model for Head and Neck Tumor Segmentation. In the first stage, we leverage a Self-Supervised 3D Student-Teacher Learning Framework, specifically utilizing the DINOv2 architecture, to learn effective representations from a limited unlabeled dataset. This approach effectively addresses the challenge posed by the scarcity of annotated data, enabling the model to generalize better in tumor identification and segmentation. In the second stage, we fine-tune an xLSTM-based UNet model that is specifically designed to capture both spatial and sequential features of tumor progression. This hybrid architecture improves segmentation accuracy by integrating temporal dependencies, making it particularly well-suited for MRI-guided adaptive RT planning in HNC. The model's performance is rigorously evaluated on a diverse set of HNC cases, demonstrating significant improvements over state-of-the-art deep learning models in accurately segmenting tumor structures. Our proposed solution achieved an impressive mean aggregated Dice Coefficient of 0.81 for pre-RT segments and 0.65 for mid-RT segments, underscoring its effectiveness in automated segmentation tasks. This work advances the field of HNC imaging by providing a robust, generalizable solution for automated Head and Neck Tumor Segmentation, ultimately enhancing the quality of care for patients undergoing RT. Our team name is DeepLearnAI (CEMRG). The code for this work is available at https://github.com/RespectKnowledge/SSL-based-DINOv2_Vision-LSTM_Head-and-Neck-Tumor_Segmentation.</p>\",\"PeriodicalId\":520475,\"journal\":{\"name\":\"Head and Neck Tumor Segmentation for MR-Guided Applications : First MICCAI Challenge, HNTS-MRG 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 17, 2024, proceedings\",\"volume\":\"15273 \",\"pages\":\"166-178\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12091698/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Head and Neck Tumor Segmentation for MR-Guided Applications : First MICCAI Challenge, HNTS-MRG 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 17, 2024, proceedings\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/978-3-031-83274-1_12\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/3/3 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Head and Neck Tumor Segmentation for MR-Guided Applications : First MICCAI Challenge, HNTS-MRG 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 17, 2024, proceedings","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-83274-1_12","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/3/3 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

放射治疗(RT)在治疗头颈癌(HNC)中起着关键作用,mri引导的方法提供卓越的软组织对比和日常适应能力,显着提高治疗精度,同时最大限度地减少副作用。为了优化mri引导的HNC自适应放疗,我们提出了一种新的两阶段头颈部肿瘤分割模型。在第一阶段,我们利用一个自我监督的3D学生-教师学习框架,特别是利用DINOv2架构,从有限的未标记数据集中学习有效的表示。该方法有效地解决了标注数据稀缺带来的挑战,使模型能够更好地泛化肿瘤识别和分割。在第二阶段,我们对基于xlstm的UNet模型进行微调,该模型专门用于捕获肿瘤进展的空间和序列特征。这种混合架构通过整合时间依赖性来提高分割精度,使其特别适合于HNC中mri引导的自适应RT规划。该模型的性能在一组不同的HNC病例中得到了严格的评估,在准确分割肿瘤结构方面,该模型比最先进的深度学习模型有了显著的改进。我们提出的解决方案实现了令人印象深刻的平均聚合骰子系数0.81的前rt段和0.65的中期rt段,强调了其在自动分割任务中的有效性。这项工作通过提供一个强大的、通用的头颈部肿瘤自动分割解决方案,推动了HNC成像领域的发展,最终提高了接受rt的患者的护理质量。我们的团队名称是DeepLearnAI (CEMRG)。这项工作的代码可在https://github.com/RespectKnowledge/SSL-based-DINOv2_Vision-LSTM_Head-and-Neck-Tumor_Segmentation上获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Assessing Self-supervised xLSTM-UNet Architectures for Head and Neck Tumor Segmentation in MR-Guided Applications.

Radiation therapy (RT) plays a pivotal role in treating head and neck cancer (HNC), with MRI-guided approaches offering superior soft tissue contrast and daily adaptive capabilities that significantly enhance treatment precision while minimizing side effects. To optimize MRI-guided adaptive RT for HNC, we propose a novel two-stage model for Head and Neck Tumor Segmentation. In the first stage, we leverage a Self-Supervised 3D Student-Teacher Learning Framework, specifically utilizing the DINOv2 architecture, to learn effective representations from a limited unlabeled dataset. This approach effectively addresses the challenge posed by the scarcity of annotated data, enabling the model to generalize better in tumor identification and segmentation. In the second stage, we fine-tune an xLSTM-based UNet model that is specifically designed to capture both spatial and sequential features of tumor progression. This hybrid architecture improves segmentation accuracy by integrating temporal dependencies, making it particularly well-suited for MRI-guided adaptive RT planning in HNC. The model's performance is rigorously evaluated on a diverse set of HNC cases, demonstrating significant improvements over state-of-the-art deep learning models in accurately segmenting tumor structures. Our proposed solution achieved an impressive mean aggregated Dice Coefficient of 0.81 for pre-RT segments and 0.65 for mid-RT segments, underscoring its effectiveness in automated segmentation tasks. This work advances the field of HNC imaging by providing a robust, generalizable solution for automated Head and Neck Tumor Segmentation, ultimately enhancing the quality of care for patients undergoing RT. Our team name is DeepLearnAI (CEMRG). The code for this work is available at https://github.com/RespectKnowledge/SSL-based-DINOv2_Vision-LSTM_Head-and-Neck-Tumor_Segmentation.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信