Autonomous Closed-Loop Control for Robotic Soft Tissue Electrosurgery Using RGB-D Image Guidance

IF 3.8 Q2 ENGINEERING, BIOMEDICAL
Michael Kam;Jiawei Ge;Naveed D. Riaziat;Justin D. Opfermann;Leila J. Mady;Jeremy D. Brown;Axel Krieger
{"title":"Autonomous Closed-Loop Control for Robotic Soft Tissue Electrosurgery Using RGB-D Image Guidance","authors":"Michael Kam;Jiawei Ge;Naveed D. Riaziat;Justin D. Opfermann;Leila J. Mady;Jeremy D. Brown;Axel Krieger","doi":"10.1109/TMRB.2025.3583169","DOIUrl":null,"url":null,"abstract":"Oral cavity cancer, a common head and neck cancer, is typically treated through precise tumor excision via electrosurgery. Autonomous robotic electrosurgery has demonstrated the potential to achieve more accurate and consistent resection margins compared to manual methods, thereby improving surgical outcomes. However, current autonomous systems face challenges in tracking tissue deformation during electrosurgical cutting due to unpredictable and complex soft tissue dynamics. Failure to monitor and adapt to tissue deformation can significantly compromise resection precision. This paper presents an autonomous closed-loop robotic electrosurgery system to enhance surgical precision via 3D tissue tracking and image-based feedback control utilizing a Red Green Blue – Depth (RGB-D) sensor. The developed 3D tissue tracker employs CoTracker, a deep learning-based model for markerless tracking, complemented by a tool-occlusion algorithm to achieve tissue deformation tracking with no prior knowledge of the tissue model. The estimated deformation is fed into a fuzzy logic controller, which dynamically adjusts the cutting velocity to minimize cutting error during electrosurgery. The system’s efficacy was validated using ex vivo porcine tongues, demonstrating a 55% reduction in average cutting error (from 1.2 mm to 0.54 mm, <inline-formula> <tex-math>$p\\lt 0.001$ </tex-math></inline-formula>) in closed-loop operations (N=6) compared to open-loop cutting without feedback control (N=3). The results demonstrate the effectiveness of image-based closed-loop control in improving margin accuracy, a key factor in reducing the likelihood of cancer recurrence.","PeriodicalId":73318,"journal":{"name":"IEEE transactions on medical robotics and bionics","volume":"7 3","pages":"1041-1050"},"PeriodicalIF":3.8000,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical robotics and bionics","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11051047/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Oral cavity cancer, a common head and neck cancer, is typically treated through precise tumor excision via electrosurgery. Autonomous robotic electrosurgery has demonstrated the potential to achieve more accurate and consistent resection margins compared to manual methods, thereby improving surgical outcomes. However, current autonomous systems face challenges in tracking tissue deformation during electrosurgical cutting due to unpredictable and complex soft tissue dynamics. Failure to monitor and adapt to tissue deformation can significantly compromise resection precision. This paper presents an autonomous closed-loop robotic electrosurgery system to enhance surgical precision via 3D tissue tracking and image-based feedback control utilizing a Red Green Blue – Depth (RGB-D) sensor. The developed 3D tissue tracker employs CoTracker, a deep learning-based model for markerless tracking, complemented by a tool-occlusion algorithm to achieve tissue deformation tracking with no prior knowledge of the tissue model. The estimated deformation is fed into a fuzzy logic controller, which dynamically adjusts the cutting velocity to minimize cutting error during electrosurgery. The system’s efficacy was validated using ex vivo porcine tongues, demonstrating a 55% reduction in average cutting error (from 1.2 mm to 0.54 mm, $p\lt 0.001$ ) in closed-loop operations (N=6) compared to open-loop cutting without feedback control (N=3). The results demonstrate the effectiveness of image-based closed-loop control in improving margin accuracy, a key factor in reducing the likelihood of cancer recurrence.
基于RGB-D图像制导的软组织电手术机器人自主闭环控制
口腔癌是一种常见的头颈部癌症,通常通过电手术进行精确的肿瘤切除。与人工方法相比,自主机器人电手术已经证明了实现更准确和一致切除边缘的潜力,从而改善了手术结果。然而,由于不可预测和复杂的软组织动力学,目前的自主系统在跟踪电刀切割过程中的组织变形方面面临挑战。未能监测和适应组织变形可以显著损害切除精度。本文介绍了一种自主闭环机器人电手术系统,该系统利用红绿蓝深度(RGB-D)传感器通过3D组织跟踪和基于图像的反馈控制来提高手术精度。开发的3D组织跟踪器采用CoTracker,这是一种基于深度学习的无标记跟踪模型,辅以工具遮挡算法来实现组织变形跟踪,而无需预先了解组织模型。将估计的变形量输入到模糊逻辑控制器中,该控制器动态调整切割速度,使电切过程中的切割误差最小化。用离体猪舌验证了该系统的有效性,与没有反馈控制的开环切割(N=3)相比,闭环操作(N=6)的平均切割误差减少了55%(从1.2毫米减少到0.54毫米,p\lt 0.001美元)。结果表明,基于图像的闭环控制在提高切缘精度方面是有效的,这是降低癌症复发可能性的关键因素。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.80
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信