Shunlei Li;Ajay Gunalan;Muhammad Adeel Azam;Veronica Penza;Darwin G. Caldwell;Leonardo S. Mattos
{"title":"Auto-CALM: 自主计算机辅助激光显微外科手术","authors":"Shunlei Li;Ajay Gunalan;Muhammad Adeel Azam;Veronica Penza;Darwin G. Caldwell;Leonardo S. Mattos","doi":"10.1109/TMRB.2024.3468385","DOIUrl":null,"url":null,"abstract":"This paper introduces a new controller for real-time dynamic laser ablation: the autonomous computer-assisted laser microsurgery system (Auto-CALM). Auto-CALM allows the surgeon to define the ablation area, which is then precisely ablated by the system while compensating for tissue motions and deformations. This is achieved based on three control blocks: target tracking, laser tracking, and ablation control algorithm. The ablation area, i.e., the target, is defined by the surgeon using a graphics tablet and graphics overlay on the surgical video. This target is then tracked in real-time using improved optical flow and a novel scaling strategy that makes the system robust against tissue deformations. Laser tracking is based on a pretrained Segment Anything Model that localizes the position of the laser in the surgical video. The ablation algorithm generates a trajectory to ablate the target given the dynamically updated laser position and target position. This enables motion compensation, which increases the accuracy of the system. Auto-CALM was validated through laser ablation experiments based on a porcine larynx fixed to a breathing motion simulation stage. The obtained results were also compared with those achieved under manual operation of CALM, and under autonomous ablation using the Track Anything Model as the target tracking algorithm. Furthermore, four different parts of the ex-vivo porcine larynx were tested to investigate different tracking features and the robustness of the system. Auto-CALM achieved a Dice Similarity Coefficient of 95.49% under the most challenging conditions (including tissue motion and no feature), reaching an ablation speed of \n<inline-formula> <tex-math>$1.43~mm^{2}/s$ </tex-math></inline-formula>\n. The accuracy and usability of the integrated platform bear potential for the accurate ablation of tissue volumes in clinical settings. Further ex-vivo and in-vivo animal studies shall help translate these findings to clinical use.","PeriodicalId":73318,"journal":{"name":"IEEE transactions on medical robotics and bionics","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Auto-CALM: Autonomous Computer-Assisted Laser Microsurgery\",\"authors\":\"Shunlei Li;Ajay Gunalan;Muhammad Adeel Azam;Veronica Penza;Darwin G. Caldwell;Leonardo S. Mattos\",\"doi\":\"10.1109/TMRB.2024.3468385\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper introduces a new controller for real-time dynamic laser ablation: the autonomous computer-assisted laser microsurgery system (Auto-CALM). Auto-CALM allows the surgeon to define the ablation area, which is then precisely ablated by the system while compensating for tissue motions and deformations. This is achieved based on three control blocks: target tracking, laser tracking, and ablation control algorithm. The ablation area, i.e., the target, is defined by the surgeon using a graphics tablet and graphics overlay on the surgical video. This target is then tracked in real-time using improved optical flow and a novel scaling strategy that makes the system robust against tissue deformations. Laser tracking is based on a pretrained Segment Anything Model that localizes the position of the laser in the surgical video. The ablation algorithm generates a trajectory to ablate the target given the dynamically updated laser position and target position. This enables motion compensation, which increases the accuracy of the system. Auto-CALM was validated through laser ablation experiments based on a porcine larynx fixed to a breathing motion simulation stage. The obtained results were also compared with those achieved under manual operation of CALM, and under autonomous ablation using the Track Anything Model as the target tracking algorithm. Furthermore, four different parts of the ex-vivo porcine larynx were tested to investigate different tracking features and the robustness of the system. Auto-CALM achieved a Dice Similarity Coefficient of 95.49% under the most challenging conditions (including tissue motion and no feature), reaching an ablation speed of \\n<inline-formula> <tex-math>$1.43~mm^{2}/s$ </tex-math></inline-formula>\\n. The accuracy and usability of the integrated platform bear potential for the accurate ablation of tissue volumes in clinical settings. Further ex-vivo and in-vivo animal studies shall help translate these findings to clinical use.\",\"PeriodicalId\":73318,\"journal\":{\"name\":\"IEEE transactions on medical robotics and bionics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-09-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE transactions on medical robotics and bionics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10697472/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical robotics and bionics","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10697472/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
This paper introduces a new controller for real-time dynamic laser ablation: the autonomous computer-assisted laser microsurgery system (Auto-CALM). Auto-CALM allows the surgeon to define the ablation area, which is then precisely ablated by the system while compensating for tissue motions and deformations. This is achieved based on three control blocks: target tracking, laser tracking, and ablation control algorithm. The ablation area, i.e., the target, is defined by the surgeon using a graphics tablet and graphics overlay on the surgical video. This target is then tracked in real-time using improved optical flow and a novel scaling strategy that makes the system robust against tissue deformations. Laser tracking is based on a pretrained Segment Anything Model that localizes the position of the laser in the surgical video. The ablation algorithm generates a trajectory to ablate the target given the dynamically updated laser position and target position. This enables motion compensation, which increases the accuracy of the system. Auto-CALM was validated through laser ablation experiments based on a porcine larynx fixed to a breathing motion simulation stage. The obtained results were also compared with those achieved under manual operation of CALM, and under autonomous ablation using the Track Anything Model as the target tracking algorithm. Furthermore, four different parts of the ex-vivo porcine larynx were tested to investigate different tracking features and the robustness of the system. Auto-CALM achieved a Dice Similarity Coefficient of 95.49% under the most challenging conditions (including tissue motion and no feature), reaching an ablation speed of
$1.43~mm^{2}/s$
. The accuracy and usability of the integrated platform bear potential for the accurate ablation of tissue volumes in clinical settings. Further ex-vivo and in-vivo animal studies shall help translate these findings to clinical use.