Automatic probe guidance for volumetric liver ultrasound acquisition via imitation learning from a virtual expert.

IF 2.8 3区 医学 Q3 ENGINEERING, BIOMEDICAL
Taiyu Han, Hanying Liang, Qi Zeng, Yan Kang, Hongen Liao, Guochen Ning, Septimiu E Salcudean
{"title":"Automatic probe guidance for volumetric liver ultrasound acquisition via imitation learning from a virtual expert.","authors":"Taiyu Han, Hanying Liang, Qi Zeng, Yan Kang, Hongen Liao, Guochen Ning, Septimiu E Salcudean","doi":"10.1007/s11548-026-03787-w","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Volumetric liver ultrasound (US) plays an important role in clinical diagnosis but remains highly dependent on operator expertise, particularly during target view localization. This study aims to develop an automatic probe guidance framework that reduces reliance on manual demonstrations and additional sensing hardware, while supporting robust volumetric liver US acquisition.</p><p><strong>Methods: </strong>We propose an image-based imitation learning framework that learns probe guidance policies from a virtual expert in a simulated US scanning environment. A simulation pipeline is constructed using cross-modal medical images and a hybrid US simulator that combines physics-based ray casting with generation-based image synthesis to produce anatomically consistent and acoustically realistic US images. Optimal scanning trajectories are generated based solely on target views typically available in clinical practice. To improve robustness, pose-level and image-level data augmentations are introduced, and US observations are encoded into an anatomy-aware state representation for intercostal liver scanning.</p><p><strong>Results: </strong>Experimental results in simulation and real clinical data demonstrate that the proposed framework achieves accurate and stable target view localization for volumetric liver US acquisition. Compared with baseline and ablated models, the method shows improved localization accuracy, increased liver coverage, and reduced rib interference, while maintaining robustness across different anatomical conditions.</p><p><strong>Conclusion: </strong>This work presents a data-efficient and clinically practical solution for automatic probe guidance in volumetric liver US. By leveraging realistic simulation, virtual expert demonstrations, and anatomy-aware image representations, the proposed framework enables effective learning of probe movements without requiring manual trajectory annotations or additional sensors. The results suggest strong potential for integration into computer-assisted and robotic US systems.</p>","PeriodicalId":51251,"journal":{"name":"International Journal of Computer Assisted Radiology and Surgery","volume":" ","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2026-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Computer Assisted Radiology and Surgery","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s11548-026-03787-w","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: Volumetric liver ultrasound (US) plays an important role in clinical diagnosis but remains highly dependent on operator expertise, particularly during target view localization. This study aims to develop an automatic probe guidance framework that reduces reliance on manual demonstrations and additional sensing hardware, while supporting robust volumetric liver US acquisition.

Methods: We propose an image-based imitation learning framework that learns probe guidance policies from a virtual expert in a simulated US scanning environment. A simulation pipeline is constructed using cross-modal medical images and a hybrid US simulator that combines physics-based ray casting with generation-based image synthesis to produce anatomically consistent and acoustically realistic US images. Optimal scanning trajectories are generated based solely on target views typically available in clinical practice. To improve robustness, pose-level and image-level data augmentations are introduced, and US observations are encoded into an anatomy-aware state representation for intercostal liver scanning.

Results: Experimental results in simulation and real clinical data demonstrate that the proposed framework achieves accurate and stable target view localization for volumetric liver US acquisition. Compared with baseline and ablated models, the method shows improved localization accuracy, increased liver coverage, and reduced rib interference, while maintaining robustness across different anatomical conditions.

Conclusion: This work presents a data-efficient and clinically practical solution for automatic probe guidance in volumetric liver US. By leveraging realistic simulation, virtual expert demonstrations, and anatomy-aware image representations, the proposed framework enables effective learning of probe movements without requiring manual trajectory annotations or additional sensors. The results suggest strong potential for integration into computer-assisted and robotic US systems.

通过虚拟专家的模仿学习实现肝脏体积超声采集的自动探针引导。
目的:体积肝超声(US)在临床诊断中发挥着重要作用,但仍然高度依赖于操作员的专业知识,特别是在目标视图定位时。本研究旨在开发一种自动探针引导框架,减少对人工演示和额外传感硬件的依赖,同时支持强大的肝脏体积US采集。方法:我们提出了一个基于图像的模仿学习框架,该框架在模拟的美国扫描环境中从虚拟专家那里学习探针引导策略。使用跨模态医学图像和混合US模拟器构建模拟管道,该模拟器将基于物理的光线投射与基于生成的图像合成相结合,以产生解剖学上一致且声学上真实的US图像。最佳扫描轨迹仅基于临床实践中通常可用的目标视图生成。为了提高鲁棒性,引入了姿态级和图像级数据增强,并将US观察编码为肋间肝脏扫描的解剖感知状态表示。结果:模拟实验和真实临床数据表明,该框架能够实现准确、稳定的肝脏体积超声成像目标视图定位。与基线模型和消融模型相比,该方法显示出更高的定位精度,增加肝脏覆盖范围,减少肋骨干扰,同时在不同解剖条件下保持稳健性。结论:本研究为肝容量超声自动导引提供了一种数据高效、临床实用的解决方案。通过利用逼真的模拟、虚拟专家演示和解剖感知图像表示,所提出的框架能够有效地学习探针运动,而无需手动轨迹注释或额外的传感器。结果表明,整合到计算机辅助和机器人美国系统的巨大潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Journal of Computer Assisted Radiology and Surgery
International Journal of Computer Assisted Radiology and Surgery ENGINEERING, BIOMEDICAL-RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
CiteScore
5.90
自引率
6.70%
发文量
243
审稿时长
6-12 weeks
期刊介绍: The International Journal for Computer Assisted Radiology and Surgery (IJCARS) is a peer-reviewed journal that provides a platform for closing the gap between medical and technical disciplines, and encourages interdisciplinary research and development activities in an international environment.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书