关节镜视频中相位识别的新数据集和方法。

IF 1.5 4区 医学 Q3 SURGERY
Computer Assisted Surgery Pub Date : 2025-12-01 Epub Date: 2025-05-31 DOI:10.1080/24699322.2025.2508144
Ali Bahari Malayeri, Matthias Seibold, Nicola A Cavalcanti, Jonas Hein, Sascha Jecklin, Lazaros Vlachopoulos, Sandro Fucentese, Sandro Hodel, Philipp Fürnstahl
{"title":"关节镜视频中相位识别的新数据集和方法。","authors":"Ali Bahari Malayeri, Matthias Seibold, Nicola A Cavalcanti, Jonas Hein, Sascha Jecklin, Lazaros Vlachopoulos, Sandro Fucentese, Sandro Hodel, Philipp Fürnstahl","doi":"10.1080/24699322.2025.2508144","DOIUrl":null,"url":null,"abstract":"<p><p>This study advances surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and a novel transformer-based model. We establish a benchmark for arthroscopic surgical phase recognition by leveraging spatio-temporal features to address challenges such as limited field of view, occlusions, and visual distortions. We developed the ACL27 dataset, comprising 27 videos of ACL surgeries, each labeled with surgical phases. Our model employs a transformer-based architecture, utilizing temporal-aware frame-wise feature extraction through ResNet-50 and transformer layers. This approach integrates spatio-temporal features and introduces a Surgical Progress Index (SPI) to quantify surgery progression. The model's performance was evaluated using accuracy, precision, recall, and Jaccard Index on the ACL27 and Cholec80 datasets. The proposed model achieved an overall accuracy of 72.9% on the ACL27 dataset. On the Cholec80 dataset, the model achieved performance comparable to state-of-the-art methods, with an accuracy of 92.4%. The SPI demonstrated an output error of 10.6% and 9.8% on ACL27 and Cholec80 datasets, respectively, indicating reliable surgery progression estimation. This study introduces a significant advancement in surgical phase recognition for arthroscopy, providing a comprehensive dataset and robust transformer-based model. The results validate the model's effectiveness and generalizability, highlighting its potential to improve surgical training, real-time assistance, and operational efficiency in orthopedic surgery. The publicly available dataset and code will facilitate future research in this critical field. Word Count: 6490.</p>","PeriodicalId":56051,"journal":{"name":"Computer Assisted Surgery","volume":"30 1","pages":"2508144"},"PeriodicalIF":1.5000,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ArthroPhase: a novel dataset and method for phase recognition in arthroscopic video.\",\"authors\":\"Ali Bahari Malayeri, Matthias Seibold, Nicola A Cavalcanti, Jonas Hein, Sascha Jecklin, Lazaros Vlachopoulos, Sandro Fucentese, Sandro Hodel, Philipp Fürnstahl\",\"doi\":\"10.1080/24699322.2025.2508144\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This study advances surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and a novel transformer-based model. We establish a benchmark for arthroscopic surgical phase recognition by leveraging spatio-temporal features to address challenges such as limited field of view, occlusions, and visual distortions. We developed the ACL27 dataset, comprising 27 videos of ACL surgeries, each labeled with surgical phases. Our model employs a transformer-based architecture, utilizing temporal-aware frame-wise feature extraction through ResNet-50 and transformer layers. This approach integrates spatio-temporal features and introduces a Surgical Progress Index (SPI) to quantify surgery progression. The model's performance was evaluated using accuracy, precision, recall, and Jaccard Index on the ACL27 and Cholec80 datasets. The proposed model achieved an overall accuracy of 72.9% on the ACL27 dataset. On the Cholec80 dataset, the model achieved performance comparable to state-of-the-art methods, with an accuracy of 92.4%. The SPI demonstrated an output error of 10.6% and 9.8% on ACL27 and Cholec80 datasets, respectively, indicating reliable surgery progression estimation. This study introduces a significant advancement in surgical phase recognition for arthroscopy, providing a comprehensive dataset and robust transformer-based model. The results validate the model's effectiveness and generalizability, highlighting its potential to improve surgical training, real-time assistance, and operational efficiency in orthopedic surgery. The publicly available dataset and code will facilitate future research in this critical field. Word Count: 6490.</p>\",\"PeriodicalId\":56051,\"journal\":{\"name\":\"Computer Assisted Surgery\",\"volume\":\"30 1\",\"pages\":\"2508144\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2025-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Assisted Surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/24699322.2025.2508144\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/5/31 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"SURGERY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Assisted Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/24699322.2025.2508144","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/5/31 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0

摘要

本研究通过引入第一个关节镜数据集和一个新的基于变压器的模型,推进了关节镜手术阶段识别,特别是前交叉韧带(ACL)重建。我们通过利用时空特征来解决诸如视野有限、闭塞和视觉扭曲等挑战,建立了关节镜手术相位识别的基准。我们开发了ACL27数据集,包括27个ACL手术视频,每个视频都标有手术阶段。我们的模型采用基于变压器的架构,通过ResNet-50和变压器层利用时序感知的帧特征提取。该方法整合了时空特征,并引入了手术进展指数(SPI)来量化手术进展。使用ACL27和Cholec80数据集上的准确率、精密度、召回率和Jaccard指数来评估模型的性能。该模型在ACL27数据集上的总体准确率为72.9%。在Cholec80数据集上,该模型达到了与最先进的方法相当的性能,准确率为92.4%。SPI在ACL27和Cholec80数据集上的输出误差分别为10.6%和9.8%,表明可靠的手术进展估计。本研究介绍了关节镜手术相位识别的重大进展,提供了一个全面的数据集和鲁棒的基于变压器的模型。结果验证了该模型的有效性和可推广性,突出了其在骨科手术培训、实时辅助和操作效率方面的潜力。公开可用的数据集和代码将促进这一关键领域的未来研究。字数:6490。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
ArthroPhase: a novel dataset and method for phase recognition in arthroscopic video.

This study advances surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and a novel transformer-based model. We establish a benchmark for arthroscopic surgical phase recognition by leveraging spatio-temporal features to address challenges such as limited field of view, occlusions, and visual distortions. We developed the ACL27 dataset, comprising 27 videos of ACL surgeries, each labeled with surgical phases. Our model employs a transformer-based architecture, utilizing temporal-aware frame-wise feature extraction through ResNet-50 and transformer layers. This approach integrates spatio-temporal features and introduces a Surgical Progress Index (SPI) to quantify surgery progression. The model's performance was evaluated using accuracy, precision, recall, and Jaccard Index on the ACL27 and Cholec80 datasets. The proposed model achieved an overall accuracy of 72.9% on the ACL27 dataset. On the Cholec80 dataset, the model achieved performance comparable to state-of-the-art methods, with an accuracy of 92.4%. The SPI demonstrated an output error of 10.6% and 9.8% on ACL27 and Cholec80 datasets, respectively, indicating reliable surgery progression estimation. This study introduces a significant advancement in surgical phase recognition for arthroscopy, providing a comprehensive dataset and robust transformer-based model. The results validate the model's effectiveness and generalizability, highlighting its potential to improve surgical training, real-time assistance, and operational efficiency in orthopedic surgery. The publicly available dataset and code will facilitate future research in this critical field. Word Count: 6490.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computer Assisted Surgery
Computer Assisted Surgery Medicine-Surgery
CiteScore
2.30
自引率
0.00%
发文量
13
审稿时长
10 weeks
期刊介绍: omputer Assisted Surgery aims to improve patient care by advancing the utilization of computers during treatment; to evaluate the benefits and risks associated with the integration of advanced digital technologies into surgical practice; to disseminate clinical and basic research relevant to stereotactic surgery, minimal access surgery, endoscopy, and surgical robotics; to encourage interdisciplinary collaboration between engineers and physicians in developing new concepts and applications; to educate clinicians about the principles and techniques of computer assisted surgery and therapeutics; and to serve the international scientific community as a medium for the transfer of new information relating to theory, research, and practice in biomedical imaging and the surgical specialties. The scope of Computer Assisted Surgery encompasses all fields within surgery, as well as biomedical imaging and instrumentation, and digital technology employed as an adjunct to imaging in diagnosis, therapeutics, and surgery. Topics featured include frameless as well as conventional stereotactic procedures, surgery guided by intraoperative ultrasound or magnetic resonance imaging, image guided focused irradiation, robotic surgery, and any therapeutic interventions performed with the use of digital imaging technology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信