基于扩散时间融合的动态光谱校准用于精确和可解释的高光谱脑肿瘤分割

IF 4.4 3区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY
Priyanka Gupta, Garima Jaiswal, Ashish Kumar
{"title":"基于扩散时间融合的动态光谱校准用于精确和可解释的高光谱脑肿瘤分割","authors":"Priyanka Gupta,&nbsp;Garima Jaiswal,&nbsp;Ashish Kumar","doi":"10.1007/s42235-026-00955-1","DOIUrl":null,"url":null,"abstract":"<div><p>The segmentation of brain tumors, based on hyperspectral imaging (HSI), has been attracting considerable interest for its capability of providing detailed spectral–spatial information about tissue. Current segmentation methods based on HSI have limitations such as spectral noise, illumination changes, high dimensionality of data, and temporal variation between successive surgical frames, which can impact the accuracy of segmentation and its clinical utility. In this work, we suggest a dynamic spectral calibration (DSC) integrated with diffusion-based temporal fusion (DTF) framework to overcome these limitations and achieve interpretable and low latency brain tumor segmentation in HSI. It is based on a spectral-attentive denoising stage using a deep convolutional autoencoder to remove spectral noise while maintaining the most important biochemical and morphological tissue properties. Then, a diffusion-assisted spectral–spatial tumor mapping module is used to iteratively refine the tumor boundary using a reverse diffusion method. A DSC module adaptively recalibrates the spectral responses based on a gradient guided spectral prior optimization to increase robustness in varying illumination conditions during surgery. Moreover, the Hierarchical Spatial–Temporal Integration module integrates multi-scale spatial representations and temporal feature learning via recurrent attention mechanisms and gated recurrent units to ensure temporal coherence between successive frames. The explainable artificial intelligence module is also integrated to offer interpretable visualization of spectral and spatial decision patterns, offering clinical transparency and confidence in the model predictions. Experimental results on hyperspectral brain tumor datasets show that the proposed DSC–DTF framework provides competitive segmentation results with dice similarity coefficient of 97.12%, intersection over union of 94.47%, sensitivity of 96.32%, specificity of 97.18%, Hausdorff distance of 3.42 mm, spectral angle mapper of 3.41° and Temporal Consistency Index of 95.25%. The outcomes demonstrate the effectiveness of the proposed framework in enhancing the spectral consistency, segmentation accuracy, and temporal stability of the hyperspectral brain tumor data while maintaining its interpretability and computational efficiency for real-time intraoperative support in analyzing brain tumors.</p></div>","PeriodicalId":614,"journal":{"name":"Journal of Bionic Engineering","volume":"23 5","pages":"3236 - 3262"},"PeriodicalIF":4.4000,"publicationDate":"2026-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dynamic Spectral Calibration Integrated with Diffusion Based Temporal Fusion for Accurate and Interpretable Hyperspectral Brain Tumor Segmentation\",\"authors\":\"Priyanka Gupta,&nbsp;Garima Jaiswal,&nbsp;Ashish Kumar\",\"doi\":\"10.1007/s42235-026-00955-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The segmentation of brain tumors, based on hyperspectral imaging (HSI), has been attracting considerable interest for its capability of providing detailed spectral–spatial information about tissue. Current segmentation methods based on HSI have limitations such as spectral noise, illumination changes, high dimensionality of data, and temporal variation between successive surgical frames, which can impact the accuracy of segmentation and its clinical utility. In this work, we suggest a dynamic spectral calibration (DSC) integrated with diffusion-based temporal fusion (DTF) framework to overcome these limitations and achieve interpretable and low latency brain tumor segmentation in HSI. It is based on a spectral-attentive denoising stage using a deep convolutional autoencoder to remove spectral noise while maintaining the most important biochemical and morphological tissue properties. Then, a diffusion-assisted spectral–spatial tumor mapping module is used to iteratively refine the tumor boundary using a reverse diffusion method. A DSC module adaptively recalibrates the spectral responses based on a gradient guided spectral prior optimization to increase robustness in varying illumination conditions during surgery. Moreover, the Hierarchical Spatial–Temporal Integration module integrates multi-scale spatial representations and temporal feature learning via recurrent attention mechanisms and gated recurrent units to ensure temporal coherence between successive frames. The explainable artificial intelligence module is also integrated to offer interpretable visualization of spectral and spatial decision patterns, offering clinical transparency and confidence in the model predictions. Experimental results on hyperspectral brain tumor datasets show that the proposed DSC–DTF framework provides competitive segmentation results with dice similarity coefficient of 97.12%, intersection over union of 94.47%, sensitivity of 96.32%, specificity of 97.18%, Hausdorff distance of 3.42 mm, spectral angle mapper of 3.41° and Temporal Consistency Index of 95.25%. The outcomes demonstrate the effectiveness of the proposed framework in enhancing the spectral consistency, segmentation accuracy, and temporal stability of the hyperspectral brain tumor data while maintaining its interpretability and computational efficiency for real-time intraoperative support in analyzing brain tumors.</p></div>\",\"PeriodicalId\":614,\"journal\":{\"name\":\"Journal of Bionic Engineering\",\"volume\":\"23 5\",\"pages\":\"3236 - 3262\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2026-07-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Bionic Engineering\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s42235-026-00955-1\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Bionic Engineering","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s42235-026-00955-1","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

基于高光谱成像(HSI)的脑肿瘤分割,由于其提供组织的详细光谱空间信息的能力,已经引起了相当大的兴趣。目前基于HSI的分割方法存在光谱噪声、光照变化、数据高维以及连续手术帧之间的时间变化等局限性,影响了分割的准确性和临床应用。在这项工作中,我们建议将动态光谱校准(DSC)与基于扩散的时间融合(DTF)框架相结合,以克服这些限制,并在HSI中实现可解释和低延迟的脑肿瘤分割。它基于频谱关注去噪阶段,使用深度卷积自编码器去除光谱噪声,同时保持最重要的生化和形态学组织特性。然后,利用扩散辅助的光谱空间肿瘤映射模块,利用反向扩散方法迭代细化肿瘤边界;DSC模块基于梯度引导光谱先验优化自适应重新校准光谱响应,以增加手术期间不同照明条件下的鲁棒性。此外,层次化时空整合模块通过循环注意机制和门控循环单元整合多尺度空间表征和时间特征学习,以确保连续框架之间的时间一致性。还集成了可解释的人工智能模块,以提供光谱和空间决策模式的可解释可视化,为模型预测提供临床透明度和信心。在高光谱脑肿瘤数据集上的实验结果表明,所提出的DSC-DTF框架提供的竞争分割结果具有:dice similarity系数为97.12%,intersection over union系数为94.47%,sensitivity为96.32%,specificity为97.18%,Hausdorff distance为3.42 mm, spectral angle mapper为3.41°,Temporal Consistency Index为95.25%。结果表明,所提出的框架在提高高光谱脑肿瘤数据的光谱一致性、分割精度和时间稳定性方面是有效的,同时保持了高光谱脑肿瘤数据的可解释性和计算效率,为脑肿瘤分析提供实时术中支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Dynamic Spectral Calibration Integrated with Diffusion Based Temporal Fusion for Accurate and Interpretable Hyperspectral Brain Tumor Segmentation

The segmentation of brain tumors, based on hyperspectral imaging (HSI), has been attracting considerable interest for its capability of providing detailed spectral–spatial information about tissue. Current segmentation methods based on HSI have limitations such as spectral noise, illumination changes, high dimensionality of data, and temporal variation between successive surgical frames, which can impact the accuracy of segmentation and its clinical utility. In this work, we suggest a dynamic spectral calibration (DSC) integrated with diffusion-based temporal fusion (DTF) framework to overcome these limitations and achieve interpretable and low latency brain tumor segmentation in HSI. It is based on a spectral-attentive denoising stage using a deep convolutional autoencoder to remove spectral noise while maintaining the most important biochemical and morphological tissue properties. Then, a diffusion-assisted spectral–spatial tumor mapping module is used to iteratively refine the tumor boundary using a reverse diffusion method. A DSC module adaptively recalibrates the spectral responses based on a gradient guided spectral prior optimization to increase robustness in varying illumination conditions during surgery. Moreover, the Hierarchical Spatial–Temporal Integration module integrates multi-scale spatial representations and temporal feature learning via recurrent attention mechanisms and gated recurrent units to ensure temporal coherence between successive frames. The explainable artificial intelligence module is also integrated to offer interpretable visualization of spectral and spatial decision patterns, offering clinical transparency and confidence in the model predictions. Experimental results on hyperspectral brain tumor datasets show that the proposed DSC–DTF framework provides competitive segmentation results with dice similarity coefficient of 97.12%, intersection over union of 94.47%, sensitivity of 96.32%, specificity of 97.18%, Hausdorff distance of 3.42 mm, spectral angle mapper of 3.41° and Temporal Consistency Index of 95.25%. The outcomes demonstrate the effectiveness of the proposed framework in enhancing the spectral consistency, segmentation accuracy, and temporal stability of the hyperspectral brain tumor data while maintaining its interpretability and computational efficiency for real-time intraoperative support in analyzing brain tumors.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Bionic Engineering
Journal of Bionic Engineering 工程技术-材料科学:生物材料
CiteScore
7.10
自引率
10.00%
发文量
162
审稿时长
10.0 months
期刊介绍: The Journal of Bionic Engineering (JBE) is a peer-reviewed journal that publishes original research papers and reviews that apply the knowledge learned from nature and biological systems to solve concrete engineering problems. The topics that JBE covers include but are not limited to: Mechanisms, kinematical mechanics and control of animal locomotion, development of mobile robots with walking (running and crawling), swimming or flying abilities inspired by animal locomotion. Structures, morphologies, composition and physical properties of natural and biomaterials; fabrication of new materials mimicking the properties and functions of natural and biomaterials. Biomedical materials, artificial organs and tissue engineering for medical applications; rehabilitation equipment and devices. Development of bioinspired computation methods and artificial intelligence for engineering applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书