Dannielle Lee, Laurent Mennillo, Emalee Burrows, Jia-En Chen, Danyal Z Khan, Joachim Starup-Hansen, Danail Stoyanov, Matthew J Clarkson, Hani J Marcus, Sophia Bano
{"title":"3D reconstruction in endonasal pituitary surgery.","authors":"Dannielle Lee, Laurent Mennillo, Emalee Burrows, Jia-En Chen, Danyal Z Khan, Joachim Starup-Hansen, Danail Stoyanov, Matthew J Clarkson, Hani J Marcus, Sophia Bano","doi":"10.1007/s11548-025-03362-9","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Endoscopic transsphenoidal surgery for pituitary tumors is hindered by limited visibility and maneuverability due to the narrow nasal corridor, increasing the risk of complications. To address these challenges, we present a pipeline for 3D reconstruction of the sellar anatomy from monocular endoscopic videos to enhance intraoperative visualization and navigation.</p><p><strong>Methods: </strong>Data were collected through a user study with trainee surgeons, and the procedure was conducted on 3D printed, anatomically correct phantom devices. To overcome limitations posed by the uniform, textureless surfaces of these devices, learned feature detectors and matchers were leveraged to extract meaningful information from the images. The matched features were reconstructed using COLMAP, and the resulting surfaces were evaluated using the iterative closest point algorithm against the CAD ground-truth surface of the printed phantoms.</p><p><strong>Results: </strong>Most methods resulted in accurate reconstructions with moderate variability in cases with high blur or occlusions. Average RMSE values of 0.33 mm and 0.41 mm, for the two best methods, Dense Kernelized Feature Matching and SuperPoint with LightGlue, respectively, were obtained in the surface registrations across all test sequences, with a significantly higher computation time for Dense Kernelized Feature Matching.</p><p><strong>Conclusion: </strong>The proposed pipeline was able to accurately reconstruct anatomically correct 3D models of the phantom devices, showing potential for the use of learned feature detectors and matchers in real time for AR-guided navigation in pituitary surgery.</p>","PeriodicalId":51251,"journal":{"name":"International Journal of Computer Assisted Radiology and Surgery","volume":" ","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Computer Assisted Radiology and Surgery","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s11548-025-03362-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Endoscopic transsphenoidal surgery for pituitary tumors is hindered by limited visibility and maneuverability due to the narrow nasal corridor, increasing the risk of complications. To address these challenges, we present a pipeline for 3D reconstruction of the sellar anatomy from monocular endoscopic videos to enhance intraoperative visualization and navigation.
Methods: Data were collected through a user study with trainee surgeons, and the procedure was conducted on 3D printed, anatomically correct phantom devices. To overcome limitations posed by the uniform, textureless surfaces of these devices, learned feature detectors and matchers were leveraged to extract meaningful information from the images. The matched features were reconstructed using COLMAP, and the resulting surfaces were evaluated using the iterative closest point algorithm against the CAD ground-truth surface of the printed phantoms.
Results: Most methods resulted in accurate reconstructions with moderate variability in cases with high blur or occlusions. Average RMSE values of 0.33 mm and 0.41 mm, for the two best methods, Dense Kernelized Feature Matching and SuperPoint with LightGlue, respectively, were obtained in the surface registrations across all test sequences, with a significantly higher computation time for Dense Kernelized Feature Matching.
Conclusion: The proposed pipeline was able to accurately reconstruct anatomically correct 3D models of the phantom devices, showing potential for the use of learned feature detectors and matchers in real time for AR-guided navigation in pituitary surgery.
期刊介绍:
The International Journal for Computer Assisted Radiology and Surgery (IJCARS) is a peer-reviewed journal that provides a platform for closing the gap between medical and technical disciplines, and encourages interdisciplinary research and development activities in an international environment.