{"title":"利用电子信息技术和软推杆在内窥镜检查中进行组织触诊","authors":"Amirhosein Alian, James Avery, George Mylonas","doi":"10.3389/frobt.2024.1372936","DOIUrl":null,"url":null,"abstract":"The integration of soft robots in medical procedures has significantly improved diagnostic and therapeutic interventions, addressing safety concerns and enhancing surgeon dexterity. In conjunction with artificial intelligence, these soft robots hold the potential to expedite autonomous interventions, such as tissue palpation for cancer detection. While cameras are prevalent in surgical instruments, situations with obscured views necessitate palpation. This proof-of-concept study investigates the effectiveness of using a soft robot integrated with Electrical Impedance Tomography (EIT) capabilities for tissue palpation in simulated in vivo inspection of the large intestine. The approach involves classifying tissue samples of varying thickness into healthy and cancerous tissues using the shape changes induced on a hydraulically-driven soft continuum robot during palpation. Shape changes of the robot are mapped using EIT, providing arrays of impedance measurements. Following the fabrication of an in-plane bending soft manipulator, the preliminary tissue phantom design is detailed. The phantom, representing the descending colon wall, considers induced stiffness by surrounding tissues based on a mass-spring model. The shape changes of the manipulator, resulting from interactions with tissues of different stiffness, are measured, and EIT measurements are fed into a Long Short-Term Memory (LSTM) classifier. Train and test datasets are collected as temporal sequences of data from a single training phantom and two test phantoms, namely, A and B, possessing distinctive thickness patterns. The collected dataset from phantom B, which differs in stiffness distribution, remains unseen to the network, thus posing challenges to the classifier. The classifier and proposed method achieve an accuracy of 93% and 88.1% on phantom A and B, respectively. Classification results are presented through confusion matrices and heat maps, visualising the accuracy of the algorithm and corresponding classified tissues.","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9000,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Tissue palpation in endoscopy using EIT and soft actuators\",\"authors\":\"Amirhosein Alian, James Avery, George Mylonas\",\"doi\":\"10.3389/frobt.2024.1372936\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The integration of soft robots in medical procedures has significantly improved diagnostic and therapeutic interventions, addressing safety concerns and enhancing surgeon dexterity. In conjunction with artificial intelligence, these soft robots hold the potential to expedite autonomous interventions, such as tissue palpation for cancer detection. While cameras are prevalent in surgical instruments, situations with obscured views necessitate palpation. This proof-of-concept study investigates the effectiveness of using a soft robot integrated with Electrical Impedance Tomography (EIT) capabilities for tissue palpation in simulated in vivo inspection of the large intestine. The approach involves classifying tissue samples of varying thickness into healthy and cancerous tissues using the shape changes induced on a hydraulically-driven soft continuum robot during palpation. Shape changes of the robot are mapped using EIT, providing arrays of impedance measurements. Following the fabrication of an in-plane bending soft manipulator, the preliminary tissue phantom design is detailed. The phantom, representing the descending colon wall, considers induced stiffness by surrounding tissues based on a mass-spring model. The shape changes of the manipulator, resulting from interactions with tissues of different stiffness, are measured, and EIT measurements are fed into a Long Short-Term Memory (LSTM) classifier. Train and test datasets are collected as temporal sequences of data from a single training phantom and two test phantoms, namely, A and B, possessing distinctive thickness patterns. The collected dataset from phantom B, which differs in stiffness distribution, remains unseen to the network, thus posing challenges to the classifier. The classifier and proposed method achieve an accuracy of 93% and 88.1% on phantom A and B, respectively. Classification results are presented through confusion matrices and heat maps, visualising the accuracy of the algorithm and corresponding classified tissues.\",\"PeriodicalId\":47597,\"journal\":{\"name\":\"Frontiers in Robotics and AI\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-08-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Frontiers in Robotics and AI\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3389/frobt.2024.1372936\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ROBOTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Robotics and AI","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/frobt.2024.1372936","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0
摘要
将软体机器人集成到医疗程序中,大大改善了诊断和治疗干预,解决了安全问题,提高了外科医生的灵巧性。结合人工智能,这些软体机器人有可能加快自主干预的速度,例如用于癌症检测的组织触诊。虽然摄像头在手术器械中很普遍,但在视线不清晰的情况下,必须进行触诊。这项概念验证研究调查了在模拟大肠活体检查中使用集成了电阻抗断层扫描(EIT)功能的软体机器人进行组织触诊的有效性。该方法包括利用软连续机器人在触诊过程中产生的形状变化,将不同厚度的组织样本分为健康组织和癌变组织。使用 EIT 对机器人的形状变化进行映射,提供阻抗测量阵列。在制作了平面弯曲软机械手之后,详细介绍了初步的组织模型设计。该模型代表降结肠壁,根据质量弹簧模型考虑了周围组织的诱导刚度。机械手与不同刚度的组织相互作用后产生的形状变化将被测量,EIT 测量值将被输入长短期记忆(LSTM)分类器。训练和测试数据集是从一个训练模型和两个测试模型(即 A 和 B)收集的数据时间序列,这两个模型具有不同的厚度模式。收集到的幻影 B 的数据集在刚度分布上有所不同,网络仍未看到,因此给分类器带来了挑战。分类器和建议的方法在模型 A 和模型 B 上的准确率分别达到 93% 和 88.1%。分类结果通过混淆矩阵和热图呈现,直观显示了算法的准确性和相应的分类组织。
Tissue palpation in endoscopy using EIT and soft actuators
The integration of soft robots in medical procedures has significantly improved diagnostic and therapeutic interventions, addressing safety concerns and enhancing surgeon dexterity. In conjunction with artificial intelligence, these soft robots hold the potential to expedite autonomous interventions, such as tissue palpation for cancer detection. While cameras are prevalent in surgical instruments, situations with obscured views necessitate palpation. This proof-of-concept study investigates the effectiveness of using a soft robot integrated with Electrical Impedance Tomography (EIT) capabilities for tissue palpation in simulated in vivo inspection of the large intestine. The approach involves classifying tissue samples of varying thickness into healthy and cancerous tissues using the shape changes induced on a hydraulically-driven soft continuum robot during palpation. Shape changes of the robot are mapped using EIT, providing arrays of impedance measurements. Following the fabrication of an in-plane bending soft manipulator, the preliminary tissue phantom design is detailed. The phantom, representing the descending colon wall, considers induced stiffness by surrounding tissues based on a mass-spring model. The shape changes of the manipulator, resulting from interactions with tissues of different stiffness, are measured, and EIT measurements are fed into a Long Short-Term Memory (LSTM) classifier. Train and test datasets are collected as temporal sequences of data from a single training phantom and two test phantoms, namely, A and B, possessing distinctive thickness patterns. The collected dataset from phantom B, which differs in stiffness distribution, remains unseen to the network, thus posing challenges to the classifier. The classifier and proposed method achieve an accuracy of 93% and 88.1% on phantom A and B, respectively. Classification results are presented through confusion matrices and heat maps, visualising the accuracy of the algorithm and corresponding classified tissues.
期刊介绍:
Frontiers in Robotics and AI publishes rigorously peer-reviewed research covering all theory and applications of robotics, technology, and artificial intelligence, from biomedical to space robotics.