Taiyu Han, Hanying Liang, Qi Zeng, Yan Kang, Hongen Liao, Guochen Ning, Septimiu E Salcudean
{"title":"Automatic probe guidance for volumetric liver ultrasound acquisition via imitation learning from a virtual expert.","authors":"Taiyu Han, Hanying Liang, Qi Zeng, Yan Kang, Hongen Liao, Guochen Ning, Septimiu E Salcudean","doi":"10.1007/s11548-026-03787-w","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Volumetric liver ultrasound (US) plays an important role in clinical diagnosis but remains highly dependent on operator expertise, particularly during target view localization. This study aims to develop an automatic probe guidance framework that reduces reliance on manual demonstrations and additional sensing hardware, while supporting robust volumetric liver US acquisition.</p><p><strong>Methods: </strong>We propose an image-based imitation learning framework that learns probe guidance policies from a virtual expert in a simulated US scanning environment. A simulation pipeline is constructed using cross-modal medical images and a hybrid US simulator that combines physics-based ray casting with generation-based image synthesis to produce anatomically consistent and acoustically realistic US images. Optimal scanning trajectories are generated based solely on target views typically available in clinical practice. To improve robustness, pose-level and image-level data augmentations are introduced, and US observations are encoded into an anatomy-aware state representation for intercostal liver scanning.</p><p><strong>Results: </strong>Experimental results in simulation and real clinical data demonstrate that the proposed framework achieves accurate and stable target view localization for volumetric liver US acquisition. Compared with baseline and ablated models, the method shows improved localization accuracy, increased liver coverage, and reduced rib interference, while maintaining robustness across different anatomical conditions.</p><p><strong>Conclusion: </strong>This work presents a data-efficient and clinically practical solution for automatic probe guidance in volumetric liver US. By leveraging realistic simulation, virtual expert demonstrations, and anatomy-aware image representations, the proposed framework enables effective learning of probe movements without requiring manual trajectory annotations or additional sensors. The results suggest strong potential for integration into computer-assisted and robotic US systems.</p>","PeriodicalId":51251,"journal":{"name":"International Journal of Computer Assisted Radiology and Surgery","volume":" ","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2026-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Computer Assisted Radiology and Surgery","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s11548-026-03787-w","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Volumetric liver ultrasound (US) plays an important role in clinical diagnosis but remains highly dependent on operator expertise, particularly during target view localization. This study aims to develop an automatic probe guidance framework that reduces reliance on manual demonstrations and additional sensing hardware, while supporting robust volumetric liver US acquisition.
Methods: We propose an image-based imitation learning framework that learns probe guidance policies from a virtual expert in a simulated US scanning environment. A simulation pipeline is constructed using cross-modal medical images and a hybrid US simulator that combines physics-based ray casting with generation-based image synthesis to produce anatomically consistent and acoustically realistic US images. Optimal scanning trajectories are generated based solely on target views typically available in clinical practice. To improve robustness, pose-level and image-level data augmentations are introduced, and US observations are encoded into an anatomy-aware state representation for intercostal liver scanning.
Results: Experimental results in simulation and real clinical data demonstrate that the proposed framework achieves accurate and stable target view localization for volumetric liver US acquisition. Compared with baseline and ablated models, the method shows improved localization accuracy, increased liver coverage, and reduced rib interference, while maintaining robustness across different anatomical conditions.
Conclusion: This work presents a data-efficient and clinically practical solution for automatic probe guidance in volumetric liver US. By leveraging realistic simulation, virtual expert demonstrations, and anatomy-aware image representations, the proposed framework enables effective learning of probe movements without requiring manual trajectory annotations or additional sensors. The results suggest strong potential for integration into computer-assisted and robotic US systems.
期刊介绍:
The International Journal for Computer Assisted Radiology and Surgery (IJCARS) is a peer-reviewed journal that provides a platform for closing the gap between medical and technical disciplines, and encourages interdisciplinary research and development activities in an international environment.