3D电声断层成像图像增强使用深度学习与SAM-Med3D编码器。

IF 3.4 3区 医学 Q2 ENGINEERING, BIOMEDICAL
Yankun Lang, Jadon Buller, Yifei Xu, Leshan Sun, Zhuoran Jiang, Shawn Xiang, Lei Ren
{"title":"3D电声断层成像图像增强使用深度学习与SAM-Med3D编码器。","authors":"Yankun Lang, Jadon Buller, Yifei Xu, Leshan Sun, Zhuoran Jiang, Shawn Xiang, Lei Ren","doi":"10.1088/1361-6560/ae077d","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective.</i>To overcome the limitations of electroacoustic tomography (EAT) in clinical settings-particularly the artifacts and distortions caused by limited-angle data acquisition-and enable accurate, efficient visualization of electric field distributions for electroporation-based therapies.<i>Approach.</i>We developed a deep learning-based framework that enhances 3D EAT image reconstruction from single-view projections by leveraging the large foundation model (LFM) SAM-Med3D. The encoder was modified into a local-global feature fusion architecture that extracts multi-scale features from intermediate transformer layers, preserving fine structural details while maintaining computational efficiency. A lightweight decoder with progressive up-sampling and skip connections was employed to generate high-resolution images, addressing limitations of conventional U-Net architectures.<i>Main results.</i>We collected a dataset of 50 EAT scans-each with 120 views-for a total of 6000 views. These were acquired from water phantoms and tissue samples under varied electrode configurations and voltages, and split into training (30 scans, 3600 views), validation (10 scans, 1200 views), and testing (10 scans, 1200 views). Our model significantly outperformed baseline 3D U-Nets, achieving an RMSE of 0.0092, PSNR of 41.10, and SSIM of 0.9377. Remarkably, our method reconstructs a full-view 3D EAT image from a single view in just 2 s, demonstrating its potential for near real-time monitoring and adaptive dose verification in electroporation-based therapies.<i>Significance.</i>This is the first application of a LFM like SAM-Med3D for enhancing 3D EAT imaging. The proposed framework addresses the critical challenge of limited-angle data in EAT and demonstrates strong potential for improving precision and safety in electroporation-based therapies, thereby advancing the technique's clinical viability.</p>","PeriodicalId":20185,"journal":{"name":"Physics in medicine and biology","volume":" ","pages":""},"PeriodicalIF":3.4000,"publicationDate":"2025-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"3D electroacoustic tomography image enhancement using deep learning with the SAM-Med3D encoder.\",\"authors\":\"Yankun Lang, Jadon Buller, Yifei Xu, Leshan Sun, Zhuoran Jiang, Shawn Xiang, Lei Ren\",\"doi\":\"10.1088/1361-6560/ae077d\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><i>Objective.</i>To overcome the limitations of electroacoustic tomography (EAT) in clinical settings-particularly the artifacts and distortions caused by limited-angle data acquisition-and enable accurate, efficient visualization of electric field distributions for electroporation-based therapies.<i>Approach.</i>We developed a deep learning-based framework that enhances 3D EAT image reconstruction from single-view projections by leveraging the large foundation model (LFM) SAM-Med3D. The encoder was modified into a local-global feature fusion architecture that extracts multi-scale features from intermediate transformer layers, preserving fine structural details while maintaining computational efficiency. A lightweight decoder with progressive up-sampling and skip connections was employed to generate high-resolution images, addressing limitations of conventional U-Net architectures.<i>Main results.</i>We collected a dataset of 50 EAT scans-each with 120 views-for a total of 6000 views. These were acquired from water phantoms and tissue samples under varied electrode configurations and voltages, and split into training (30 scans, 3600 views), validation (10 scans, 1200 views), and testing (10 scans, 1200 views). Our model significantly outperformed baseline 3D U-Nets, achieving an RMSE of 0.0092, PSNR of 41.10, and SSIM of 0.9377. Remarkably, our method reconstructs a full-view 3D EAT image from a single view in just 2 s, demonstrating its potential for near real-time monitoring and adaptive dose verification in electroporation-based therapies.<i>Significance.</i>This is the first application of a LFM like SAM-Med3D for enhancing 3D EAT imaging. The proposed framework addresses the critical challenge of limited-angle data in EAT and demonstrates strong potential for improving precision and safety in electroporation-based therapies, thereby advancing the technique's clinical viability.</p>\",\"PeriodicalId\":20185,\"journal\":{\"name\":\"Physics in medicine and biology\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physics in medicine and biology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1088/1361-6560/ae077d\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physics in medicine and biology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6560/ae077d","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

摘要

为了克服电声断层扫描(EAT)在临床环境中的局限性,特别是由有限角度数据采集引起的人工影和畸变,并为基于电穿孔的治疗实现准确、高效的电场分布可视化。方法:我们开发了一个基于深度学习的框架,通过利用大型基础模型SAM-Med3D,增强了单视图投影的3D EAT图像重建。将编码器改进为局部-全局特征融合架构,从中间变压器层提取多尺度特征,在保持计算效率的同时保留了精细的结构细节。一个轻量级的解码器采用渐进上采样和跳过连接来生成高分辨率图像,解决了传统U-Net架构的局限性。主要结果:我们收集了50个EAT扫描的数据集,每个扫描有120个视图,总共有6000个视图。这些数据是在不同电极配置和电压下从水幻影和组织样本中获得的,并分为训练(30次扫描,3600次浏览)、验证(10次扫描,1200次浏览)和测试(10次扫描,1200次浏览)。我们的模型显著优于基线3D U-Nets, RMSE为0.0092,PSNR为41.10,SSIM为0.9377。值得注意的是,我们的方法仅在2秒内从单个视图重建了全视图3D EAT图像,显示了其在基于电孔疗法的近实时监测和自适应剂量验证方面的潜力。这是SAM-Med3D等大型基础模型在增强3D EAT成像方面的首次应用。提出的框架解决了EAT中有限角度数据的关键挑战,并展示了提高基于电穿孔治疗的精度和安全性的强大潜力,从而提高了该技术的临床可行性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
3D electroacoustic tomography image enhancement using deep learning with the SAM-Med3D encoder.

Objective.To overcome the limitations of electroacoustic tomography (EAT) in clinical settings-particularly the artifacts and distortions caused by limited-angle data acquisition-and enable accurate, efficient visualization of electric field distributions for electroporation-based therapies.Approach.We developed a deep learning-based framework that enhances 3D EAT image reconstruction from single-view projections by leveraging the large foundation model (LFM) SAM-Med3D. The encoder was modified into a local-global feature fusion architecture that extracts multi-scale features from intermediate transformer layers, preserving fine structural details while maintaining computational efficiency. A lightweight decoder with progressive up-sampling and skip connections was employed to generate high-resolution images, addressing limitations of conventional U-Net architectures.Main results.We collected a dataset of 50 EAT scans-each with 120 views-for a total of 6000 views. These were acquired from water phantoms and tissue samples under varied electrode configurations and voltages, and split into training (30 scans, 3600 views), validation (10 scans, 1200 views), and testing (10 scans, 1200 views). Our model significantly outperformed baseline 3D U-Nets, achieving an RMSE of 0.0092, PSNR of 41.10, and SSIM of 0.9377. Remarkably, our method reconstructs a full-view 3D EAT image from a single view in just 2 s, demonstrating its potential for near real-time monitoring and adaptive dose verification in electroporation-based therapies.Significance.This is the first application of a LFM like SAM-Med3D for enhancing 3D EAT imaging. The proposed framework addresses the critical challenge of limited-angle data in EAT and demonstrates strong potential for improving precision and safety in electroporation-based therapies, thereby advancing the technique's clinical viability.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Physics in medicine and biology
Physics in medicine and biology 医学-工程:生物医学
CiteScore
6.50
自引率
14.30%
发文量
409
审稿时长
2 months
期刊介绍: The development and application of theoretical, computational and experimental physics to medicine, physiology and biology. Topics covered are: therapy physics (including ionizing and non-ionizing radiation); biomedical imaging (e.g. x-ray, magnetic resonance, ultrasound, optical and nuclear imaging); image-guided interventions; image reconstruction and analysis (including kinetic modelling); artificial intelligence in biomedical physics and analysis; nanoparticles in imaging and therapy; radiobiology; radiation protection and patient dose monitoring; radiation dosimetry
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信