Development and evaluation of the second version of scrub nurse robot (SNR) for endoscopic and laparoscopic surgery

K. Yoshimitsu, F. Miyawaki, T. Sadahiro, Kentaro Ohnuma, Y. Fukui, D. Hashimoto, K. Masamune
{"title":"Development and evaluation of the second version of scrub nurse robot (SNR) for endoscopic and laparoscopic surgery","authors":"K. Yoshimitsu, F. Miyawaki, T. Sadahiro, Kentaro Ohnuma, Y. Fukui, D. Hashimoto, K. Masamune","doi":"10.1109/IROS.2007.4399359","DOIUrl":null,"url":null,"abstract":"The shortage of nurses in large hospitals of developed countries has become a major problem. Especially, the shortage of scrub nurses, who assist operating surgeons exchange surgical instruments, has been chronically severe. To compensate for this shortage, we have been proposing the scrub nurse robot (SNR) system that is capable of functioning as a skilled human scrub nurse in endoscopic and laparoscopic surgery. We developed the 2nd version of SNR, and achieved smooth and wide movement of its arms each with 4 DOF. The 2nd SNR is able to speak several sentences and recognize some words as well as the names of surgical instruments, and is also capable of recognizing a surgeon's intraoperative actions by its real-time visual recognition system (RTVRS). The RTVRS is basically composed of both a commercially-available 3D position tracking system and the algorithm that we developed to recognize surgeons' actions during exchange of instruments from the above-mentioned positional data. In this paper, we evaluated how quickly and timely the RTVRS-driven SNR helped surgeon's stand-ins exchange instruments in a laboratory, in comparison with human scrub nurses in real surgical operations. We found two problems about the current RTVRS-driven SNR: one is its response time and the other is chiefly related to the design and mechanism of the part storing the surgical instruments. 1) Concerning the first problem, the RTVRS-driven SNR took 2.11 sec until it finished holding out its hand with an instrument after it had detected a surgeon's stand-in's motions observed during extraction of a surgical instrument. However, a skilled real surgeon took 1.90 sec until he got the requested instrument in the clinical cases although he had to wait for as long as 1.24 sec until receiving it. Therefore, we must speed up the SNR's performance at least by 0.2 sec to assist the real surgeon as human scrub nurses did. Especially, since 0.68 sec out of the 2.11 sec was spent in data processing within the current RTVRS, we conclude that the performance of the RTVRS must be improved rather than speed-up of its arm movement. 2) The other problem was highlighted by measurement of the time during which the stand-ins and the real surgeon had to take their eyes from the monitor displaying the operative field within the abdomen. We termed this period of time 'eyes-off time. The existence of 'eyes-off' time observed during his actions of returning an instrument after use and of waiting for the next instrument was regarded as unfavorable. The 'eyes-off' time was 2.34 sec in the laboratory whereas it was 0.19 sec in the clinical cases. The much longer 'eyes-off' time in the laboratory was partly due to inexperienced stand-ins' performances, but mainly because of the design and mechanism of the part storing the instruments (a tool changer). To overcome these two problems, we are now developing the next version of SNR.","PeriodicalId":227148,"journal":{"name":"2007 IEEE/RSJ International Conference on Intelligent Robots and Systems","volume":"35 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2007-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"26","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2007 IEEE/RSJ International Conference on Intelligent Robots and Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IROS.2007.4399359","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 26

Abstract

The shortage of nurses in large hospitals of developed countries has become a major problem. Especially, the shortage of scrub nurses, who assist operating surgeons exchange surgical instruments, has been chronically severe. To compensate for this shortage, we have been proposing the scrub nurse robot (SNR) system that is capable of functioning as a skilled human scrub nurse in endoscopic and laparoscopic surgery. We developed the 2nd version of SNR, and achieved smooth and wide movement of its arms each with 4 DOF. The 2nd SNR is able to speak several sentences and recognize some words as well as the names of surgical instruments, and is also capable of recognizing a surgeon's intraoperative actions by its real-time visual recognition system (RTVRS). The RTVRS is basically composed of both a commercially-available 3D position tracking system and the algorithm that we developed to recognize surgeons' actions during exchange of instruments from the above-mentioned positional data. In this paper, we evaluated how quickly and timely the RTVRS-driven SNR helped surgeon's stand-ins exchange instruments in a laboratory, in comparison with human scrub nurses in real surgical operations. We found two problems about the current RTVRS-driven SNR: one is its response time and the other is chiefly related to the design and mechanism of the part storing the surgical instruments. 1) Concerning the first problem, the RTVRS-driven SNR took 2.11 sec until it finished holding out its hand with an instrument after it had detected a surgeon's stand-in's motions observed during extraction of a surgical instrument. However, a skilled real surgeon took 1.90 sec until he got the requested instrument in the clinical cases although he had to wait for as long as 1.24 sec until receiving it. Therefore, we must speed up the SNR's performance at least by 0.2 sec to assist the real surgeon as human scrub nurses did. Especially, since 0.68 sec out of the 2.11 sec was spent in data processing within the current RTVRS, we conclude that the performance of the RTVRS must be improved rather than speed-up of its arm movement. 2) The other problem was highlighted by measurement of the time during which the stand-ins and the real surgeon had to take their eyes from the monitor displaying the operative field within the abdomen. We termed this period of time 'eyes-off time. The existence of 'eyes-off' time observed during his actions of returning an instrument after use and of waiting for the next instrument was regarded as unfavorable. The 'eyes-off' time was 2.34 sec in the laboratory whereas it was 0.19 sec in the clinical cases. The much longer 'eyes-off' time in the laboratory was partly due to inexperienced stand-ins' performances, but mainly because of the design and mechanism of the part storing the instruments (a tool changer). To overcome these two problems, we are now developing the next version of SNR.
用于内窥镜和腹腔镜手术的第二版擦洗护士机器人(SNR)的开发和评估
发达国家的大医院护士短缺已成为一个重大问题。特别是,协助外科医生更换手术器械的助理护士的短缺一直很严重。为了弥补这一不足,我们提出了能够在内窥镜和腹腔镜手术中作为熟练的人类擦洗护士的擦洗护士机器人(SNR)系统。我们开发了第二个版本的信噪比,并实现了平稳和广泛的运动,每个手臂有4个DOF。第二个SNR能够说出几个句子,识别一些单词以及手术器械的名称,并且还能够通过其实时视觉识别系统(RTVRS)识别外科医生的术中动作。RTVRS基本上由商用3D位置跟踪系统和我们开发的算法组成,该算法可以根据上述位置数据识别外科医生在交换器械时的动作。在本文中,我们评估了rtvrs驱动的信噪比如何快速及时地帮助外科医生在实验室中替换器械,并与真实外科手术中的人工清洁护士进行比较。我们发现目前rtvrs驱动的信噪比存在两个问题:一是响应时间问题,二是手术器械存放部件的设计和工作机制问题。1)关于第一个问题,rtvrs驱动的信噪比在检测到外科医生在取出手术器械过程中观察到的替身动作后,直到用器械伸出手为止,其时间为2.11秒。然而,一个熟练的真正的外科医生在临床病例中需要等待1.24秒才能拿到所需的器械,但他只需要1.90秒就能拿到。因此,我们必须将信噪比的性能至少提高0.2秒,以帮助真正的外科医生,就像人类护士一样。特别是,由于当前RTVRS的2.11秒中有0.68秒用于数据处理,因此我们得出结论,RTVRS的性能必须得到改善,而不是加速其手臂运动。2)另一个突出的问题是,替身医生和真正的外科医生必须将眼睛从显示腹部手术野的显示器上移开的时间。我们把这段时间称为“不看时间”。在使用仪器后归还仪器和等待下一个仪器的过程中观察到的“眼睛离开”时间被认为是不利的。实验室的“移眼”时间为2.34秒,而临床病例的“移眼”时间为0.19秒。在实验室里,长时间的“闭目”部分是由于缺乏经验的替身的表现,但主要是因为储存仪器的部分(工具更换器)的设计和机制。为了克服这两个问题,我们正在开发下一个版本的信噪比。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信