Jonas Frederik Faust, Axel Joachim Krafft, Daniel Polak, Peter Speier, Nicolas Gerhard Roland Behl, Nathan Ooms, Jesse Roll, Joshua Krieger, Mark Edward Ladd, Florian Maier
{"title":"利用三维欠采样径向白标记成像,基于 CNN 的快速针定位技术实现磁共振引导介入治疗中的切片自动对齐","authors":"Jonas Frederik Faust, Axel Joachim Krafft, Daniel Polak, Peter Speier, Nicolas Gerhard Roland Behl, Nathan Ooms, Jesse Roll, Joshua Krieger, Mark Edward Ladd, Florian Maier","doi":"10.1002/mp.17376","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>In MR-guided in-bore percutaneous needle interventions, typically 2D interactive real-time imaging is used for navigating the needle into the target. Misaligned 2D imaging planes can result in losing visibility of the needle in the 2D images, which impedes successful targeting. Necessary iterative manual slice adjustment can prolong interventional workflows. Therefore, rapid automatic alignment of the imaging planes with the needle would be preferable to improve such workflows.</p>\n </section>\n \n <section>\n \n <h3> Purpose</h3>\n \n <p>To investigate rapid 3D localization of needles in MR-guided interventions via a convolutional neural network (CNN)-based localization algorithm using an undersampled white-marker contrast acquisition for the purpose of automatic imaging slice alignment.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>A radial 3D rf-spoiled gradient echo MR pulse sequence with white-marker encoding was implemented and a CNN-based localization algorithm was employed to extract position and orientation of an aspiration needle from the undersampled white-marker images. The CNN was trained using porcine tissue phantoms (257 needle trajectories, four-fold data augmentation, 90%/10% split into training and validation dataset). Achievable localization times and accuracy were evaluated retrospectively in an ex vivo study (109 needle trajectories) for a range of needle orientations between 78° and 90° relative to the B<sub>0</sub> field. A proof-of-concept in vivo experiment was performed in two porcine animal models and feasibility of automatic imaging slice alignment was evaluated retrospectively.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Ex vivo needle localization was achieved with a median localization accuracy of 1.9 mm (distance needle tip to detected needle axis) and a median angular deviation of 2.6° for needle orientations between 86° and 90° to the B<sub>0</sub> field from fully sampled WM images (resolution of (4 mm)<sup>3</sup>, 6434 acquired radial k-space spokes, acquisition time of 80.4 s) in a field-of-view of (256 mm)<sup>3</sup>. Localization accuracy decreased with increasing undersampling and needle trajectory increasingly aligned with B<sub>0</sub>. For needle orientations between 86° and 90° to the B<sub>0</sub> field, a highly accelerated acquisition of only 32 k-space spokes (acquisition time of 0.4 s) yielded a median localization accuracy of 3.1 mm and a median angular deviation of 4.7°. For needle orientations between 78° and 82° to the B<sub>0</sub> field, a median accuracy and angular deviation of 3.5 mm and 6.8° could still be achieved with 64 sampled spokes (acquisition time of 0.8 s). In vivo, a localization accuracy of 1.4 mm and angular deviation of 3.4° was achieved sampling 32 k-space spokes (acquisition time of 0.48 s) with the needle oriented at 87.7° to the B<sub>0</sub> field. For a needle oriented at 77.6° to the B<sub>0</sub> field, localization accuracy of 5.3 mm and angular deviation of 6.8° were still achieved sampling 128 k-space spokes (acquisition time of 1.92 s), allowing for retrospective slice alignment.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>The investigated approach enables passive biopsy needle localization in 3D. Acceleration of the localization to real-time applicability is feasible for needle orientations approximately perpendicular to B<sub>0</sub>. The method can potentially facilitate MR-guided needle interventions by enabling automatic imaging slice alignment with the needle.</p>\n </section>\n </div>","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/mp.17376","citationCount":"0","resultStr":"{\"title\":\"Rapid CNN-based needle localization for automatic slice alignment in MR-guided interventions using 3D undersampled radial white-marker imaging\",\"authors\":\"Jonas Frederik Faust, Axel Joachim Krafft, Daniel Polak, Peter Speier, Nicolas Gerhard Roland Behl, Nathan Ooms, Jesse Roll, Joshua Krieger, Mark Edward Ladd, Florian Maier\",\"doi\":\"10.1002/mp.17376\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Background</h3>\\n \\n <p>In MR-guided in-bore percutaneous needle interventions, typically 2D interactive real-time imaging is used for navigating the needle into the target. Misaligned 2D imaging planes can result in losing visibility of the needle in the 2D images, which impedes successful targeting. Necessary iterative manual slice adjustment can prolong interventional workflows. Therefore, rapid automatic alignment of the imaging planes with the needle would be preferable to improve such workflows.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Purpose</h3>\\n \\n <p>To investigate rapid 3D localization of needles in MR-guided interventions via a convolutional neural network (CNN)-based localization algorithm using an undersampled white-marker contrast acquisition for the purpose of automatic imaging slice alignment.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Methods</h3>\\n \\n <p>A radial 3D rf-spoiled gradient echo MR pulse sequence with white-marker encoding was implemented and a CNN-based localization algorithm was employed to extract position and orientation of an aspiration needle from the undersampled white-marker images. The CNN was trained using porcine tissue phantoms (257 needle trajectories, four-fold data augmentation, 90%/10% split into training and validation dataset). Achievable localization times and accuracy were evaluated retrospectively in an ex vivo study (109 needle trajectories) for a range of needle orientations between 78° and 90° relative to the B<sub>0</sub> field. A proof-of-concept in vivo experiment was performed in two porcine animal models and feasibility of automatic imaging slice alignment was evaluated retrospectively.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results</h3>\\n \\n <p>Ex vivo needle localization was achieved with a median localization accuracy of 1.9 mm (distance needle tip to detected needle axis) and a median angular deviation of 2.6° for needle orientations between 86° and 90° to the B<sub>0</sub> field from fully sampled WM images (resolution of (4 mm)<sup>3</sup>, 6434 acquired radial k-space spokes, acquisition time of 80.4 s) in a field-of-view of (256 mm)<sup>3</sup>. Localization accuracy decreased with increasing undersampling and needle trajectory increasingly aligned with B<sub>0</sub>. For needle orientations between 86° and 90° to the B<sub>0</sub> field, a highly accelerated acquisition of only 32 k-space spokes (acquisition time of 0.4 s) yielded a median localization accuracy of 3.1 mm and a median angular deviation of 4.7°. For needle orientations between 78° and 82° to the B<sub>0</sub> field, a median accuracy and angular deviation of 3.5 mm and 6.8° could still be achieved with 64 sampled spokes (acquisition time of 0.8 s). In vivo, a localization accuracy of 1.4 mm and angular deviation of 3.4° was achieved sampling 32 k-space spokes (acquisition time of 0.48 s) with the needle oriented at 87.7° to the B<sub>0</sub> field. For a needle oriented at 77.6° to the B<sub>0</sub> field, localization accuracy of 5.3 mm and angular deviation of 6.8° were still achieved sampling 128 k-space spokes (acquisition time of 1.92 s), allowing for retrospective slice alignment.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusion</h3>\\n \\n <p>The investigated approach enables passive biopsy needle localization in 3D. Acceleration of the localization to real-time applicability is feasible for needle orientations approximately perpendicular to B<sub>0</sub>. The method can potentially facilitate MR-guided needle interventions by enabling automatic imaging slice alignment with the needle.</p>\\n </section>\\n </div>\",\"PeriodicalId\":3,\"journal\":{\"name\":\"ACS Applied Electronic Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1002/mp.17376\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Electronic Materials\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/mp.17376\",\"RegionNum\":3,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/mp.17376","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Rapid CNN-based needle localization for automatic slice alignment in MR-guided interventions using 3D undersampled radial white-marker imaging
Background
In MR-guided in-bore percutaneous needle interventions, typically 2D interactive real-time imaging is used for navigating the needle into the target. Misaligned 2D imaging planes can result in losing visibility of the needle in the 2D images, which impedes successful targeting. Necessary iterative manual slice adjustment can prolong interventional workflows. Therefore, rapid automatic alignment of the imaging planes with the needle would be preferable to improve such workflows.
Purpose
To investigate rapid 3D localization of needles in MR-guided interventions via a convolutional neural network (CNN)-based localization algorithm using an undersampled white-marker contrast acquisition for the purpose of automatic imaging slice alignment.
Methods
A radial 3D rf-spoiled gradient echo MR pulse sequence with white-marker encoding was implemented and a CNN-based localization algorithm was employed to extract position and orientation of an aspiration needle from the undersampled white-marker images. The CNN was trained using porcine tissue phantoms (257 needle trajectories, four-fold data augmentation, 90%/10% split into training and validation dataset). Achievable localization times and accuracy were evaluated retrospectively in an ex vivo study (109 needle trajectories) for a range of needle orientations between 78° and 90° relative to the B0 field. A proof-of-concept in vivo experiment was performed in two porcine animal models and feasibility of automatic imaging slice alignment was evaluated retrospectively.
Results
Ex vivo needle localization was achieved with a median localization accuracy of 1.9 mm (distance needle tip to detected needle axis) and a median angular deviation of 2.6° for needle orientations between 86° and 90° to the B0 field from fully sampled WM images (resolution of (4 mm)3, 6434 acquired radial k-space spokes, acquisition time of 80.4 s) in a field-of-view of (256 mm)3. Localization accuracy decreased with increasing undersampling and needle trajectory increasingly aligned with B0. For needle orientations between 86° and 90° to the B0 field, a highly accelerated acquisition of only 32 k-space spokes (acquisition time of 0.4 s) yielded a median localization accuracy of 3.1 mm and a median angular deviation of 4.7°. For needle orientations between 78° and 82° to the B0 field, a median accuracy and angular deviation of 3.5 mm and 6.8° could still be achieved with 64 sampled spokes (acquisition time of 0.8 s). In vivo, a localization accuracy of 1.4 mm and angular deviation of 3.4° was achieved sampling 32 k-space spokes (acquisition time of 0.48 s) with the needle oriented at 87.7° to the B0 field. For a needle oriented at 77.6° to the B0 field, localization accuracy of 5.3 mm and angular deviation of 6.8° were still achieved sampling 128 k-space spokes (acquisition time of 1.92 s), allowing for retrospective slice alignment.
Conclusion
The investigated approach enables passive biopsy needle localization in 3D. Acceleration of the localization to real-time applicability is feasible for needle orientations approximately perpendicular to B0. The method can potentially facilitate MR-guided needle interventions by enabling automatic imaging slice alignment with the needle.