{"title":"Objective evaluation for Endoscopic Sinus Surgeries’ proficiency by image analysis for postoperative 3D sinus models","authors":"Kaito Yamada , Masanobu Suzuki , Kou Miyaji , Kazuya Sase , Koki Ebina , Teppei Tsujita , Xiaoshuai Chen , Shunsuke Komizunai , Taku Senoo , Akira Nakazono , Ryosuke Watanabe , Shogo Kimura , Takayoshi Suzuki , Yuji Nakamaru , Kotaro Matoba , Dominik Hinder , Alexander Zhang , Alkis J. Psaltis , Peter J. Wormald , Atsushi Konno , Akihiro Homma","doi":"10.1016/j.anl.2025.08.005","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><div>Objective assessment for endoscopic sinus surgery skill proficiency is challenging, partly due to the great diversity of anatomies. Recently developed 3D-printed sinus models provide standardized anatomy with realistic tissue-feel. In this study, we developed a method to evaluate endoscopic sinus surgery skill proficiency through pre- and post-operative image analysis of CT images of dissected 3D sinus models and validated it by comparing to other surgical proficiency indices.</div></div><div><h3>Methods</h3><div>Forty-seven otolaryngologists performed endoscopic sinus surgery for 3D sinus models. CT images of each postoperative 3D model were taken. The region growing method, an image segmentation technique, was utilized to assess the surgical space expansion. The region of interest (ROI) was defined as the space within nasal cavity and paranasal sinuses and continuous from the anterior nostril with a width of >4.00 mm kept. The volume of ROI was estimated and compared with conventional assessment methods such as board-certification, the objective structured assessment of technical skills score, and the number of experienced surgery cases. Further, the 3D-CG images of ROI were created. The completion of surgical steps within the allocated time was evaluated based on the 3D-CG and compared with the recorded endoscopic video.</div></div><div><h3>Results</h3><div>The volume in postoperative models was 24.48±4.34 cm<sup>3</sup> across all participants, respectively. The postoperative volume was significantly larger in board-certified participants (certified; 25.51±4.22 cm<sup>3</sup> vs. uncertified; 22.87±4.14 cm<sup>3</sup>, <em>p</em> = 0.03). The volume is positively correlated to the objective structured assessment of technical skills score (<em>r</em> = 0.72, <em>p</em> < 0.01) and the number of experienced cases (<em>r</em> = 0.51, <em>p</em> = 0.01). The accuracy of the 3D-CG judgement for completion of a surgical middle meatal antrostomy, sphenoidotomy, and frontal sinusotomy were 91.3 %, 69.6 %, and 84.8 %, when compared to recorded endoscopic video, with high sensitivity and specificity.</div></div><div><h3>Conclusion</h3><div>The combination of standardized 3D models and image analysis provides a simple and objective tool for the assessment of surgical skill proficiency.</div></div>","PeriodicalId":55627,"journal":{"name":"Auris Nasus Larynx","volume":"52 5","pages":"Pages 567-574"},"PeriodicalIF":1.5000,"publicationDate":"2025-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Auris Nasus Larynx","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S038581462500121X","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OTORHINOLARYNGOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective
Objective assessment for endoscopic sinus surgery skill proficiency is challenging, partly due to the great diversity of anatomies. Recently developed 3D-printed sinus models provide standardized anatomy with realistic tissue-feel. In this study, we developed a method to evaluate endoscopic sinus surgery skill proficiency through pre- and post-operative image analysis of CT images of dissected 3D sinus models and validated it by comparing to other surgical proficiency indices.
Methods
Forty-seven otolaryngologists performed endoscopic sinus surgery for 3D sinus models. CT images of each postoperative 3D model were taken. The region growing method, an image segmentation technique, was utilized to assess the surgical space expansion. The region of interest (ROI) was defined as the space within nasal cavity and paranasal sinuses and continuous from the anterior nostril with a width of >4.00 mm kept. The volume of ROI was estimated and compared with conventional assessment methods such as board-certification, the objective structured assessment of technical skills score, and the number of experienced surgery cases. Further, the 3D-CG images of ROI were created. The completion of surgical steps within the allocated time was evaluated based on the 3D-CG and compared with the recorded endoscopic video.
Results
The volume in postoperative models was 24.48±4.34 cm3 across all participants, respectively. The postoperative volume was significantly larger in board-certified participants (certified; 25.51±4.22 cm3 vs. uncertified; 22.87±4.14 cm3, p = 0.03). The volume is positively correlated to the objective structured assessment of technical skills score (r = 0.72, p < 0.01) and the number of experienced cases (r = 0.51, p = 0.01). The accuracy of the 3D-CG judgement for completion of a surgical middle meatal antrostomy, sphenoidotomy, and frontal sinusotomy were 91.3 %, 69.6 %, and 84.8 %, when compared to recorded endoscopic video, with high sensitivity and specificity.
Conclusion
The combination of standardized 3D models and image analysis provides a simple and objective tool for the assessment of surgical skill proficiency.
期刊介绍:
The international journal Auris Nasus Larynx provides the opportunity for rapid, carefully reviewed publications concerning the fundamental and clinical aspects of otorhinolaryngology and related fields. This includes otology, neurotology, bronchoesophagology, laryngology, rhinology, allergology, head and neck medicine and oncologic surgery, maxillofacial and plastic surgery, audiology, speech science.
Original papers, short communications and original case reports can be submitted. Reviews on recent developments are invited regularly and Letters to the Editor commenting on papers or any aspect of Auris Nasus Larynx are welcomed.
Founded in 1973 and previously published by the Society for Promotion of International Otorhinolaryngology, the journal is now the official English-language journal of the Oto-Rhino-Laryngological Society of Japan, Inc. The aim of its new international Editorial Board is to make Auris Nasus Larynx an international forum for high quality research and clinical sciences.