具有深度视觉驱动的自主降维共享控制的远程机器人触诊

IF 9.4 1区 计算机科学 Q1 ROBOTICS
Jingwen Zhao;Leone Costi;Luca Scimeca;Fumiya Iida
{"title":"具有深度视觉驱动的自主降维共享控制的远程机器人触诊","authors":"Jingwen Zhao;Leone Costi;Luca Scimeca;Fumiya Iida","doi":"10.1109/TRO.2025.3544104","DOIUrl":null,"url":null,"abstract":"Teleoperated medical robots have the potential to revolutionize healthcare. However, when developing systems for tasks like remote palpation, state-of-the-art literature still uses test phantoms of oversimplified geometries, due to the complexity of the required mechanical robot–patient interaction. In reality, human bodies have complex 3-D shapes and require fine-tuning of all six manipulator's degrees of freedom, controlled by the user. In this article, we argue that the implementation of depth-vision-driven autonomous dimensionality-reduction (DVD ADR) shared control can greatly improve the users' performance. The proposed control method keeps the user in control of the end-effector’s position, while automatically adjusting its orientation in order to maintain the tactile sensor normal to the phantom's surface. A depth camera and a computer vision algorithm are used to infer the phantom's shape and achieve DVD ADR shared control. Experimental results showcase how this leads to statistically significant performance improvement. Not only were the participants able to achieve more precise palpations, with up to 29.5% and 22.4% more accuracy in position and orientation, respectively, but the DVD ADR shared control allowed them to achieve a 8.8% better detection accuracy while needing 13.8% less time. The abovementioned results are all tested for statistical significance and achieved a <italic>p</i>-value lower than 0.05.","PeriodicalId":50388,"journal":{"name":"IEEE Transactions on Robotics","volume":"41 ","pages":"1882-1897"},"PeriodicalIF":9.4000,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Remote Robotic Palpation With Depth-Vision-Driven Autonomous-Dimensionality-Reduction Shared Control\",\"authors\":\"Jingwen Zhao;Leone Costi;Luca Scimeca;Fumiya Iida\",\"doi\":\"10.1109/TRO.2025.3544104\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Teleoperated medical robots have the potential to revolutionize healthcare. However, when developing systems for tasks like remote palpation, state-of-the-art literature still uses test phantoms of oversimplified geometries, due to the complexity of the required mechanical robot–patient interaction. In reality, human bodies have complex 3-D shapes and require fine-tuning of all six manipulator's degrees of freedom, controlled by the user. In this article, we argue that the implementation of depth-vision-driven autonomous dimensionality-reduction (DVD ADR) shared control can greatly improve the users' performance. The proposed control method keeps the user in control of the end-effector’s position, while automatically adjusting its orientation in order to maintain the tactile sensor normal to the phantom's surface. A depth camera and a computer vision algorithm are used to infer the phantom's shape and achieve DVD ADR shared control. Experimental results showcase how this leads to statistically significant performance improvement. Not only were the participants able to achieve more precise palpations, with up to 29.5% and 22.4% more accuracy in position and orientation, respectively, but the DVD ADR shared control allowed them to achieve a 8.8% better detection accuracy while needing 13.8% less time. The abovementioned results are all tested for statistical significance and achieved a <italic>p</i>-value lower than 0.05.\",\"PeriodicalId\":50388,\"journal\":{\"name\":\"IEEE Transactions on Robotics\",\"volume\":\"41 \",\"pages\":\"1882-1897\"},\"PeriodicalIF\":9.4000,\"publicationDate\":\"2025-02-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Robotics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10896825/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ROBOTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Robotics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10896825/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

摘要

远程操作的医疗机器人有可能彻底改变医疗保健。然而,在开发远程触诊等任务的系统时,由于所需的机械机器人与患者交互的复杂性,最新的文献仍然使用过于简化的几何形状的测试幻影。在现实中,人体具有复杂的三维形状,需要对所有六个机械手的自由度进行微调,由用户控制。在本文中,我们认为深度视觉驱动的自主降维(DVD ADR)共享控制的实现可以极大地提高用户的性能。所提出的控制方法使用户能够控制末端执行器的位置,同时自动调整其方向,以保持触觉传感器与幻影表面的法线。利用深度相机和计算机视觉算法对幻影的形状进行推断,实现DVD - ADR的共享控制。实验结果展示了这如何导致统计上显著的性能改进。参与者不仅能够实现更精确的触诊,在位置和方向上的准确度分别提高29.5%和22.4%,而且DVD ADR共享控制使他们能够实现8.8%的更好的检测精度,而需要的时间减少13.8%。以上结果均经统计学显著性检验,p值均小于0.05。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Remote Robotic Palpation With Depth-Vision-Driven Autonomous-Dimensionality-Reduction Shared Control
Teleoperated medical robots have the potential to revolutionize healthcare. However, when developing systems for tasks like remote palpation, state-of-the-art literature still uses test phantoms of oversimplified geometries, due to the complexity of the required mechanical robot–patient interaction. In reality, human bodies have complex 3-D shapes and require fine-tuning of all six manipulator's degrees of freedom, controlled by the user. In this article, we argue that the implementation of depth-vision-driven autonomous dimensionality-reduction (DVD ADR) shared control can greatly improve the users' performance. The proposed control method keeps the user in control of the end-effector’s position, while automatically adjusting its orientation in order to maintain the tactile sensor normal to the phantom's surface. A depth camera and a computer vision algorithm are used to infer the phantom's shape and achieve DVD ADR shared control. Experimental results showcase how this leads to statistically significant performance improvement. Not only were the participants able to achieve more precise palpations, with up to 29.5% and 22.4% more accuracy in position and orientation, respectively, but the DVD ADR shared control allowed them to achieve a 8.8% better detection accuracy while needing 13.8% less time. The abovementioned results are all tested for statistical significance and achieved a p-value lower than 0.05.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Robotics
IEEE Transactions on Robotics 工程技术-机器人学
CiteScore
14.90
自引率
5.10%
发文量
259
审稿时长
6.0 months
期刊介绍: The IEEE Transactions on Robotics (T-RO) is dedicated to publishing fundamental papers covering all facets of robotics, drawing on interdisciplinary approaches from computer science, control systems, electrical engineering, mathematics, mechanical engineering, and beyond. From industrial applications to service and personal assistants, surgical operations to space, underwater, and remote exploration, robots and intelligent machines play pivotal roles across various domains, including entertainment, safety, search and rescue, military applications, agriculture, and intelligent vehicles. Special emphasis is placed on intelligent machines and systems designed for unstructured environments, where a significant portion of the environment remains unknown and beyond direct sensing or control.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信