Koloud N. Alkhamaiseh, J. Grantner, Saad A. Shebrain, I. Abdel-Qader
{"title":"基于跨阶段局部网络的腹腔镜训练机性能自动评估研究","authors":"Koloud N. Alkhamaiseh, J. Grantner, Saad A. Shebrain, I. Abdel-Qader","doi":"10.1109/DICTA52665.2021.9647393","DOIUrl":null,"url":null,"abstract":"Recent advances in laparoscopic surgery have increased the need to improve surgical resident training and feedback by incorporating simulator based training in traditional training programs. However, the current training methods still require the presence of an expert surgeon to assess the surgical dexterity of the trainee. This process is time consuming and may lead to subjective assessment. This research aims to extend the application of object detection in laparoscopy training by tracking tool motion, surgical object detection and tracking. YOLOv5 and scaled-YOLOv4 object detection neural networks based on cross-stage partial network (CSP) are trained and tested on the Fundamentals of Laparoscopic Surgery (FLS) pattern cutting exercise in a box trainer. Experiments show that Scaled-YOLOv4 have a mAP score of 98.9, 79.5 precision and 98.9 recall for bounding boxes on a limited training dataset. This research clearly demonstrates the potential of using CSP networks in automated tool motion analysis for the assessment of the resident's performance during training.","PeriodicalId":424950,"journal":{"name":"2021 Digital Image Computing: Techniques and Applications (DICTA)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Towards Automated Performance Assessment for Laparoscopic Box Trainer using Cross-Stage Partial Network\",\"authors\":\"Koloud N. Alkhamaiseh, J. Grantner, Saad A. Shebrain, I. Abdel-Qader\",\"doi\":\"10.1109/DICTA52665.2021.9647393\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent advances in laparoscopic surgery have increased the need to improve surgical resident training and feedback by incorporating simulator based training in traditional training programs. However, the current training methods still require the presence of an expert surgeon to assess the surgical dexterity of the trainee. This process is time consuming and may lead to subjective assessment. This research aims to extend the application of object detection in laparoscopy training by tracking tool motion, surgical object detection and tracking. YOLOv5 and scaled-YOLOv4 object detection neural networks based on cross-stage partial network (CSP) are trained and tested on the Fundamentals of Laparoscopic Surgery (FLS) pattern cutting exercise in a box trainer. Experiments show that Scaled-YOLOv4 have a mAP score of 98.9, 79.5 precision and 98.9 recall for bounding boxes on a limited training dataset. This research clearly demonstrates the potential of using CSP networks in automated tool motion analysis for the assessment of the resident's performance during training.\",\"PeriodicalId\":424950,\"journal\":{\"name\":\"2021 Digital Image Computing: Techniques and Applications (DICTA)\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 Digital Image Computing: Techniques and Applications (DICTA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DICTA52665.2021.9647393\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 Digital Image Computing: Techniques and Applications (DICTA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DICTA52665.2021.9647393","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Towards Automated Performance Assessment for Laparoscopic Box Trainer using Cross-Stage Partial Network
Recent advances in laparoscopic surgery have increased the need to improve surgical resident training and feedback by incorporating simulator based training in traditional training programs. However, the current training methods still require the presence of an expert surgeon to assess the surgical dexterity of the trainee. This process is time consuming and may lead to subjective assessment. This research aims to extend the application of object detection in laparoscopy training by tracking tool motion, surgical object detection and tracking. YOLOv5 and scaled-YOLOv4 object detection neural networks based on cross-stage partial network (CSP) are trained and tested on the Fundamentals of Laparoscopic Surgery (FLS) pattern cutting exercise in a box trainer. Experiments show that Scaled-YOLOv4 have a mAP score of 98.9, 79.5 precision and 98.9 recall for bounding boxes on a limited training dataset. This research clearly demonstrates the potential of using CSP networks in automated tool motion analysis for the assessment of the resident's performance during training.