DGDOT-Net: A Deep Generative Model With Attention Fusion for Enhanced High-Density Diffuse Optical Tomography

IF 5.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Di Wu;Meiyun Xia;Deyu Li;Chuanxin M. Niu;Daifa Wang
{"title":"DGDOT-Net: A Deep Generative Model With Attention Fusion for Enhanced High-Density Diffuse Optical Tomography","authors":"Di Wu;Meiyun Xia;Deyu Li;Chuanxin M. Niu;Daifa Wang","doi":"10.1109/TIM.2025.3554283","DOIUrl":null,"url":null,"abstract":"Functional near-infrared spectroscopy (fNIRS) noninvasively evaluates the optical properties of target tissues to monitor functional changes. High-density diffuse optical tomography (HD-DOT) based on this technology enables high-resolution 3-D reconstruction. However, the strong scattering of photons by brain tissue limits the ability of detected signals to accurately reflect changes in brain function, reducing both the accuracy and 3-D resolution of fNIRS-based reconstructions. This article introduces a deep generative model, DGDOT-Net, which incorporates an attention fusion mechanism to enhance the imaging resolution and robustness. The model first decouples key features in the inverse mapping process between observed signals and reconstructed results, leveraging the conditional variational autoencoder (CVAE) architecture to model the probability distribution in latent space and regulate the reconstruction outcome. In addition, a depth-aware attention mechanism embedded within the encoder and decoder extracts effective features from the progressive encoding process, improving learning efficiency. This study first demonstrates the superior reconstruction performance of the model through a series of numerical simulation experiments and evaluates its robustness under low signal-to-noise ratios and varying medium conditions. Specifically, the average values of structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), mean absolute error (MAE), contrast-to-noise ratio (CNR), R, and Jaccard Index achieved by DGDOT-Net on simulated data are 0.83, 21.03 dB, <inline-formula> <tex-math>$2.75\\times 10 ^{\\mathrm {-3}}$ </tex-math></inline-formula>, 7.10, 0.45, and 0.73, respectively. Subsequently, physical phantom data collected using a locally developed prototype system are tested, yielding average metric values of 0.87, 18.65 dB, <inline-formula> <tex-math>$15.32\\times 10 ^{\\mathrm {-3}}$ </tex-math></inline-formula>, 9.61, 0.79, and 0.92, respectively. Furthermore, DGDOT-Net demonstrates the ability to reconstruct optical properties at a depth of 1.5 cm with a spatial resolution of 1 cm. The experimental results confirm that the proposed model enhances the 3-D reconstruction of brain functions using fNIRS, advancing the clinical applicability of related technologies.","PeriodicalId":13341,"journal":{"name":"IEEE Transactions on Instrumentation and Measurement","volume":"74 ","pages":"1-20"},"PeriodicalIF":5.6000,"publicationDate":"2025-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Instrumentation and Measurement","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10959734/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Functional near-infrared spectroscopy (fNIRS) noninvasively evaluates the optical properties of target tissues to monitor functional changes. High-density diffuse optical tomography (HD-DOT) based on this technology enables high-resolution 3-D reconstruction. However, the strong scattering of photons by brain tissue limits the ability of detected signals to accurately reflect changes in brain function, reducing both the accuracy and 3-D resolution of fNIRS-based reconstructions. This article introduces a deep generative model, DGDOT-Net, which incorporates an attention fusion mechanism to enhance the imaging resolution and robustness. The model first decouples key features in the inverse mapping process between observed signals and reconstructed results, leveraging the conditional variational autoencoder (CVAE) architecture to model the probability distribution in latent space and regulate the reconstruction outcome. In addition, a depth-aware attention mechanism embedded within the encoder and decoder extracts effective features from the progressive encoding process, improving learning efficiency. This study first demonstrates the superior reconstruction performance of the model through a series of numerical simulation experiments and evaluates its robustness under low signal-to-noise ratios and varying medium conditions. Specifically, the average values of structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), mean absolute error (MAE), contrast-to-noise ratio (CNR), R, and Jaccard Index achieved by DGDOT-Net on simulated data are 0.83, 21.03 dB, $2.75\times 10 ^{\mathrm {-3}}$ , 7.10, 0.45, and 0.73, respectively. Subsequently, physical phantom data collected using a locally developed prototype system are tested, yielding average metric values of 0.87, 18.65 dB, $15.32\times 10 ^{\mathrm {-3}}$ , 9.61, 0.79, and 0.92, respectively. Furthermore, DGDOT-Net demonstrates the ability to reconstruct optical properties at a depth of 1.5 cm with a spatial resolution of 1 cm. The experimental results confirm that the proposed model enhances the 3-D reconstruction of brain functions using fNIRS, advancing the clinical applicability of related technologies.
DGDOT-Net:一种增强高密度漫射光学层析成像的深度生成模型
功能近红外光谱(fNIRS)是非侵入性地评估目标组织的光学特性以监测功能变化。基于该技术的高密度漫射光学层析成像(HD-DOT)实现了高分辨率的三维重建。然而,大脑组织对光子的强烈散射限制了检测信号准确反映大脑功能变化的能力,从而降低了基于fnir的重建的精度和三维分辨率。本文介绍了一种深度生成模型DGDOT-Net,该模型采用了注意力融合机制来提高图像分辨率和鲁棒性。该模型首先解耦了观测信号与重建结果之间逆映射过程中的关键特征,利用条件变分自编码器(CVAE)架构对潜在空间中的概率分布进行建模并调节重建结果。此外,在编码器和解码器中嵌入深度感知注意机制,从渐进式编码过程中提取有效特征,提高学习效率。本研究首先通过一系列数值模拟实验证明了该模型具有优越的重建性能,并评估了其在低信噪比和变介质条件下的鲁棒性。具体而言,DGDOT-Net在模拟数据上获得的结构相似指数(SSIM)、峰值信噪比(PSNR)、平均绝对误差(MAE)、对比噪声比(CNR)、R和Jaccard指数的平均值分别为0.83、21.03 dB、2.75\times 10 ^{\ mathm{-3}}$、7.10、0.45和0.73。随后,使用本地开发的原型系统收集的物理模型数据进行测试,平均度量值分别为0.87,18.65 dB, $15.32\times 10 ^{\ mathm{-3}}$, 9.61, 0.79和0.92。此外,DGDOT-Net还展示了在1.5 cm深度以1 cm空间分辨率重建光学特性的能力。实验结果证实了该模型增强了fNIRS脑功能的三维重建,提高了相关技术的临床适用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Instrumentation and Measurement
IEEE Transactions on Instrumentation and Measurement 工程技术-工程:电子与电气
CiteScore
9.00
自引率
23.20%
发文量
1294
审稿时长
3.9 months
期刊介绍: Papers are sought that address innovative solutions to the development and use of electrical and electronic instruments and equipment to measure, monitor and/or record physical phenomena for the purpose of advancing measurement science, methods, functionality and applications. The scope of these papers may encompass: (1) theory, methodology, and practice of measurement; (2) design, development and evaluation of instrumentation and measurement systems and components used in generating, acquiring, conditioning and processing signals; (3) analysis, representation, display, and preservation of the information obtained from a set of measurements; and (4) scientific and technical support to establishment and maintenance of technical standards in the field of Instrumentation and Measurement.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信