Jin Fang;Xiaojian Li;Hangjie Mo;Hua Tang;Pengxin Guo;Kai Yan;Xinyue Li;Ling Li
{"title":"Enhancing Robotic Surgery With Haptic Feedback: A Cooperative Control Strategy for Autonomous Laparoscope Control","authors":"Jin Fang;Xiaojian Li;Hangjie Mo;Hua Tang;Pengxin Guo;Kai Yan;Xinyue Li;Ling Li","doi":"10.1109/TSMC.2025.3579383","DOIUrl":null,"url":null,"abstract":"The development of autonomous laparoscope control in robot-assisted surgery has emerged as a significant research area, particularly due to its potential to reduce assistant fatigue and minimize miscommunication between the surgeon and assistant. A notable challenge, however, is the tendency of autonomous control strategies to override the surgeon’s direct command occasionally. To address this issue, we propose a novel haptic feedback-based cooperative control strategy that enhances the surgeon’s command of laparoscopic field of view (FOV) movement in robot-assisted laparoscopic surgery. Specifically, we first established a dynamic model of the laparoscope-holding robot, which serves as a link between the movement of the laparoscopic FOV and the surgical instruments to deliver haptic feedback to the surgeon. Next, a motion observer was developed to transform 30 Hz visual feedback into 1 kHz haptic feedback by integrating visual tracking data with kinematic information, ensuring smoother and more continuous haptic feedback. Finally, we propose two distinct collaboration modes: the plane tracking mode (PTM) ensures instruments remain within the laparoscopic image, and the space tracking mode (STM) synchronizes the laparoscope with instrument movement. The laboratory experiments validated the effectiveness of the proposed method in enhancing the cooperative performance of robot-assisted laparoscope systems while animal experiments demonstrated the feasibility of the PTM design.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":"55 10","pages":"6545-6557"},"PeriodicalIF":8.7000,"publicationDate":"2025-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11066297/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
The development of autonomous laparoscope control in robot-assisted surgery has emerged as a significant research area, particularly due to its potential to reduce assistant fatigue and minimize miscommunication between the surgeon and assistant. A notable challenge, however, is the tendency of autonomous control strategies to override the surgeon’s direct command occasionally. To address this issue, we propose a novel haptic feedback-based cooperative control strategy that enhances the surgeon’s command of laparoscopic field of view (FOV) movement in robot-assisted laparoscopic surgery. Specifically, we first established a dynamic model of the laparoscope-holding robot, which serves as a link between the movement of the laparoscopic FOV and the surgical instruments to deliver haptic feedback to the surgeon. Next, a motion observer was developed to transform 30 Hz visual feedback into 1 kHz haptic feedback by integrating visual tracking data with kinematic information, ensuring smoother and more continuous haptic feedback. Finally, we propose two distinct collaboration modes: the plane tracking mode (PTM) ensures instruments remain within the laparoscopic image, and the space tracking mode (STM) synchronizes the laparoscope with instrument movement. The laboratory experiments validated the effectiveness of the proposed method in enhancing the cooperative performance of robot-assisted laparoscope systems while animal experiments demonstrated the feasibility of the PTM design.
期刊介绍:
The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.