Hang Su, Wen Qi, Y. Schmirander, S. E. Ovur, Shuting Cai, Xiaoming Xiong
{"title":"面向医疗人机交互的人类活动感知共享控制解决方案","authors":"Hang Su, Wen Qi, Y. Schmirander, S. E. Ovur, Shuting Cai, Xiaoming Xiong","doi":"10.1108/aa-12-2021-0174","DOIUrl":null,"url":null,"abstract":"\nPurpose\nThe purpose of this paper is to develop a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation. Hands-on control and teleoperation are two main procedures switched frequently in teleoperated minimally invasive surgery (MIS). The detailed human activity in the procedures can be defined and recognized using the sensor information. In this paper, a novel continuous adaptive shared control method is proposed for manipulators with Cartesian impedance control in the surgical scenario.\n\n\nDesign/methodology/approach\nA human activity-aware shared control solution by adjusting the weight function is introduced to achieve smooth transition among different human activities, including hands-on control and teleoperation. Instead of introducing various controllers and switching among them during the surgical procedures, the proposed solution integrated all the human activity-based controllers into a single controller and the transition among the procedures is smooth and stable. The effectiveness of the proposed control approach was verified in a lab setup environment. The results prove that the robot behavior is stable and smooth. The algorithm is feasible and can achieve a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation.\n\n\nFindings\nBased on the experiment, the results confirm that the proposed human activity-aware adaptive shared control solution can switch the device behavior automatically using the real-time sensor information. The transition between different activities is smooth and stable.\n\n\nPractical implications\nFor teleoperated surgical applications, the proposed method integrated different controllers for various human activities into a single controller by recognizing the activities using the real-time sensor information and the transition between different procedures is smooth and stable. It eases the surgical work for the surgeon and enhances the safety during the transition of control modes. The presented scheme provides a general solution to address the switching of working procedures in teleoperated MIS.\n\n\nOriginality/value\nTo the best of the authors’ knowledge, this paper is the first to propose human activity-aware adaptive shared control solution for human–robot interaction in surgical operations.\n","PeriodicalId":55448,"journal":{"name":"Assembly Automation","volume":" ","pages":""},"PeriodicalIF":1.9000,"publicationDate":"2022-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"39","resultStr":"{\"title\":\"A human activity-aware shared control solution for medical human–robot interaction\",\"authors\":\"Hang Su, Wen Qi, Y. Schmirander, S. E. Ovur, Shuting Cai, Xiaoming Xiong\",\"doi\":\"10.1108/aa-12-2021-0174\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\nPurpose\\nThe purpose of this paper is to develop a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation. Hands-on control and teleoperation are two main procedures switched frequently in teleoperated minimally invasive surgery (MIS). The detailed human activity in the procedures can be defined and recognized using the sensor information. In this paper, a novel continuous adaptive shared control method is proposed for manipulators with Cartesian impedance control in the surgical scenario.\\n\\n\\nDesign/methodology/approach\\nA human activity-aware shared control solution by adjusting the weight function is introduced to achieve smooth transition among different human activities, including hands-on control and teleoperation. Instead of introducing various controllers and switching among them during the surgical procedures, the proposed solution integrated all the human activity-based controllers into a single controller and the transition among the procedures is smooth and stable. The effectiveness of the proposed control approach was verified in a lab setup environment. The results prove that the robot behavior is stable and smooth. The algorithm is feasible and can achieve a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation.\\n\\n\\nFindings\\nBased on the experiment, the results confirm that the proposed human activity-aware adaptive shared control solution can switch the device behavior automatically using the real-time sensor information. The transition between different activities is smooth and stable.\\n\\n\\nPractical implications\\nFor teleoperated surgical applications, the proposed method integrated different controllers for various human activities into a single controller by recognizing the activities using the real-time sensor information and the transition between different procedures is smooth and stable. It eases the surgical work for the surgeon and enhances the safety during the transition of control modes. The presented scheme provides a general solution to address the switching of working procedures in teleoperated MIS.\\n\\n\\nOriginality/value\\nTo the best of the authors’ knowledge, this paper is the first to propose human activity-aware adaptive shared control solution for human–robot interaction in surgical operations.\\n\",\"PeriodicalId\":55448,\"journal\":{\"name\":\"Assembly Automation\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2022-05-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"39\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Assembly Automation\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1108/aa-12-2021-0174\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Assembly Automation","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1108/aa-12-2021-0174","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
A human activity-aware shared control solution for medical human–robot interaction
Purpose
The purpose of this paper is to develop a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation. Hands-on control and teleoperation are two main procedures switched frequently in teleoperated minimally invasive surgery (MIS). The detailed human activity in the procedures can be defined and recognized using the sensor information. In this paper, a novel continuous adaptive shared control method is proposed for manipulators with Cartesian impedance control in the surgical scenario.
Design/methodology/approach
A human activity-aware shared control solution by adjusting the weight function is introduced to achieve smooth transition among different human activities, including hands-on control and teleoperation. Instead of introducing various controllers and switching among them during the surgical procedures, the proposed solution integrated all the human activity-based controllers into a single controller and the transition among the procedures is smooth and stable. The effectiveness of the proposed control approach was verified in a lab setup environment. The results prove that the robot behavior is stable and smooth. The algorithm is feasible and can achieve a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation.
Findings
Based on the experiment, the results confirm that the proposed human activity-aware adaptive shared control solution can switch the device behavior automatically using the real-time sensor information. The transition between different activities is smooth and stable.
Practical implications
For teleoperated surgical applications, the proposed method integrated different controllers for various human activities into a single controller by recognizing the activities using the real-time sensor information and the transition between different procedures is smooth and stable. It eases the surgical work for the surgeon and enhances the safety during the transition of control modes. The presented scheme provides a general solution to address the switching of working procedures in teleoperated MIS.
Originality/value
To the best of the authors’ knowledge, this paper is the first to propose human activity-aware adaptive shared control solution for human–robot interaction in surgical operations.
期刊介绍:
Assembly Automation publishes peer reviewed research articles, technology reviews and specially commissioned case studies. Each issue includes high quality content covering all aspects of assembly technology and automation, and reflecting the most interesting and strategically important research and development activities from around the world. Because of this, readers can stay at the very forefront of industry developments.
All research articles undergo rigorous double-blind peer review, and the journal’s policy of not publishing work that has only been tested in simulation means that only the very best and most practical research articles are included. This ensures that the material that is published has real relevance and value for commercial manufacturing and research organizations.