Shuwei Xing, Derek W. Cool, David Tessier, Elvis C. S. Chen, Terry M. Peters, Aaron Fenster
{"title":"深度回归 2D-3D 超声波配准用于病灶肿瘤热消融中的肝脏运动校正","authors":"Shuwei Xing, Derek W. Cool, David Tessier, Elvis C. S. Chen, Terry M. Peters, Aaron Fenster","doi":"10.1049/htl2.12117","DOIUrl":null,"url":null,"abstract":"<p>Liver tumour ablation procedures require accurate placement of the needle applicator at the tumour centroid. The lower-cost and real-time nature of ultrasound (US) has advantages over computed tomography for applicator guidance, however, in some patients, liver tumours may be occult on US and tumour mimics can make lesion identification challenging. Image registration techniques can aid in interpreting anatomical details and identifying tumours, but their clinical application has been hindered by the tradeoff between alignment accuracy and runtime performance, particularly when compensating for liver motion due to patient breathing or movement. Therefore, we propose a 2D–3D US registration approach to enable intra-procedural alignment that mitigates errors caused by liver motion. Specifically, our approach can correlate imbalanced 2D and 3D US image features and use continuous 6D rotation representations to enhance the model's training stability. The dataset was divided into 2388, 196, and 193 image pairs for training, validation and testing, respectively. Our approach achieved a mean Euclidean distance error of <span></span><math>\n <semantics>\n <mrow>\n <mn>2.28</mn>\n <mspace></mspace>\n <mi>m</mi>\n <mi>m</mi>\n </mrow>\n <annotation>$2.28 \\,\\mathrm{m}\\mathrm{m}$</annotation>\n </semantics></math> <span></span><math>\n <semantics>\n <mo>±</mo>\n <annotation>$\\pm$</annotation>\n </semantics></math> <span></span><math>\n <semantics>\n <mrow>\n <mn>1.81</mn>\n <mspace></mspace>\n <mi>m</mi>\n <mi>m</mi>\n </mrow>\n <annotation>$1.81 \\,\\mathrm{m}\\mathrm{m}$</annotation>\n </semantics></math> and a mean geodesic angular error of <span></span><math>\n <semantics>\n <mrow>\n <mn>2.99</mn>\n <msup>\n <mspace></mspace>\n <mo>∘</mo>\n </msup>\n </mrow>\n <annotation>$2.99 \\,\\mathrm{^{\\circ }}$</annotation>\n </semantics></math> <span></span><math>\n <semantics>\n <mo>±</mo>\n <annotation>$\\pm$</annotation>\n </semantics></math> <span></span><math>\n <semantics>\n <mrow>\n <mn>1.95</mn>\n <msup>\n <mspace></mspace>\n <mo>∘</mo>\n </msup>\n </mrow>\n <annotation>$1.95 \\,\\mathrm{^{\\circ }}$</annotation>\n </semantics></math>, with a runtime of <span></span><math>\n <semantics>\n <mrow>\n <mn>0.22</mn>\n <mspace></mspace>\n <mi>s</mi>\n </mrow>\n <annotation>$0.22 \\,\\mathrm{s}$</annotation>\n </semantics></math> per 2D–3D US image pair. These results demonstrate that our approach can achieve accurate alignment and clinically acceptable runtime, indicating potential for clinical translation.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"12 1","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2025-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12117","citationCount":"0","resultStr":"{\"title\":\"Deep regression 2D-3D ultrasound registration for liver motion correction in focal tumour thermal ablation\",\"authors\":\"Shuwei Xing, Derek W. Cool, David Tessier, Elvis C. S. Chen, Terry M. Peters, Aaron Fenster\",\"doi\":\"10.1049/htl2.12117\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Liver tumour ablation procedures require accurate placement of the needle applicator at the tumour centroid. The lower-cost and real-time nature of ultrasound (US) has advantages over computed tomography for applicator guidance, however, in some patients, liver tumours may be occult on US and tumour mimics can make lesion identification challenging. Image registration techniques can aid in interpreting anatomical details and identifying tumours, but their clinical application has been hindered by the tradeoff between alignment accuracy and runtime performance, particularly when compensating for liver motion due to patient breathing or movement. Therefore, we propose a 2D–3D US registration approach to enable intra-procedural alignment that mitigates errors caused by liver motion. Specifically, our approach can correlate imbalanced 2D and 3D US image features and use continuous 6D rotation representations to enhance the model's training stability. The dataset was divided into 2388, 196, and 193 image pairs for training, validation and testing, respectively. Our approach achieved a mean Euclidean distance error of <span></span><math>\\n <semantics>\\n <mrow>\\n <mn>2.28</mn>\\n <mspace></mspace>\\n <mi>m</mi>\\n <mi>m</mi>\\n </mrow>\\n <annotation>$2.28 \\\\,\\\\mathrm{m}\\\\mathrm{m}$</annotation>\\n </semantics></math> <span></span><math>\\n <semantics>\\n <mo>±</mo>\\n <annotation>$\\\\pm$</annotation>\\n </semantics></math> <span></span><math>\\n <semantics>\\n <mrow>\\n <mn>1.81</mn>\\n <mspace></mspace>\\n <mi>m</mi>\\n <mi>m</mi>\\n </mrow>\\n <annotation>$1.81 \\\\,\\\\mathrm{m}\\\\mathrm{m}$</annotation>\\n </semantics></math> and a mean geodesic angular error of <span></span><math>\\n <semantics>\\n <mrow>\\n <mn>2.99</mn>\\n <msup>\\n <mspace></mspace>\\n <mo>∘</mo>\\n </msup>\\n </mrow>\\n <annotation>$2.99 \\\\,\\\\mathrm{^{\\\\circ }}$</annotation>\\n </semantics></math> <span></span><math>\\n <semantics>\\n <mo>±</mo>\\n <annotation>$\\\\pm$</annotation>\\n </semantics></math> <span></span><math>\\n <semantics>\\n <mrow>\\n <mn>1.95</mn>\\n <msup>\\n <mspace></mspace>\\n <mo>∘</mo>\\n </msup>\\n </mrow>\\n <annotation>$1.95 \\\\,\\\\mathrm{^{\\\\circ }}$</annotation>\\n </semantics></math>, with a runtime of <span></span><math>\\n <semantics>\\n <mrow>\\n <mn>0.22</mn>\\n <mspace></mspace>\\n <mi>s</mi>\\n </mrow>\\n <annotation>$0.22 \\\\,\\\\mathrm{s}$</annotation>\\n </semantics></math> per 2D–3D US image pair. These results demonstrate that our approach can achieve accurate alignment and clinically acceptable runtime, indicating potential for clinical translation.</p>\",\"PeriodicalId\":37474,\"journal\":{\"name\":\"Healthcare Technology Letters\",\"volume\":\"12 1\",\"pages\":\"\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2025-02-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12117\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Healthcare Technology Letters\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/htl2.12117\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Healthcare Technology Letters","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/htl2.12117","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
Deep regression 2D-3D ultrasound registration for liver motion correction in focal tumour thermal ablation
Liver tumour ablation procedures require accurate placement of the needle applicator at the tumour centroid. The lower-cost and real-time nature of ultrasound (US) has advantages over computed tomography for applicator guidance, however, in some patients, liver tumours may be occult on US and tumour mimics can make lesion identification challenging. Image registration techniques can aid in interpreting anatomical details and identifying tumours, but their clinical application has been hindered by the tradeoff between alignment accuracy and runtime performance, particularly when compensating for liver motion due to patient breathing or movement. Therefore, we propose a 2D–3D US registration approach to enable intra-procedural alignment that mitigates errors caused by liver motion. Specifically, our approach can correlate imbalanced 2D and 3D US image features and use continuous 6D rotation representations to enhance the model's training stability. The dataset was divided into 2388, 196, and 193 image pairs for training, validation and testing, respectively. Our approach achieved a mean Euclidean distance error of and a mean geodesic angular error of , with a runtime of per 2D–3D US image pair. These results demonstrate that our approach can achieve accurate alignment and clinically acceptable runtime, indicating potential for clinical translation.
期刊介绍:
Healthcare Technology Letters aims to bring together an audience of biomedical and electrical engineers, physical and computer scientists, and mathematicians to enable the exchange of the latest ideas and advances through rapid online publication of original healthcare technology research. Major themes of the journal include (but are not limited to): Major technological/methodological areas: Biomedical signal processing Biomedical imaging and image processing Bioinstrumentation (sensors, wearable technologies, etc) Biomedical informatics Major application areas: Cardiovascular and respiratory systems engineering Neural engineering, neuromuscular systems Rehabilitation engineering Bio-robotics, surgical planning and biomechanics Therapeutic and diagnostic systems, devices and technologies Clinical engineering Healthcare information systems, telemedicine, mHealth.