Micha Bischofberger, Stephan Böhringer, Erik Schkommodau
{"title":"用于外科手术3d导航的自动地标识别-一种用于无标记牙科手术导航系统的建议方法。","authors":"Micha Bischofberger, Stephan Böhringer, Erik Schkommodau","doi":"10.1515/bmt-2021-0307","DOIUrl":null,"url":null,"abstract":"<p><p>This paper proposes a conceptual method to calculate the pose of a stereo-vision camera relative to an artificial mandible without additional markers. The general method for marker-free navigation has four steps: 1) parallel image acquisition by a stereo-vision camera, 2) automatic identification of 2d point pairs (landmark pairs) in a left and a right image, 3) calculation of related 3d points in the joint camera coordinate system and 4) matching of 3d points generated to a preoperative 3d model (i.e., CT data based). To identify and compare landmarks in the acquired stereo images, well-known algorithms for landmark detection, description and matching were compared within the developed approach. Finally, the BRISK algorithm (Leutenegger S, Chli M, Siegwart RY. BRISK: Binary Robust invariant scalable keypoints. Proceedings of the IEEE International Conference on Computer Vision; 2011: 2548-2555) was used. The proposed method was implemented in MATLAB<sup>®</sup> and validated <i>in vitro</i> with one artificial mandible. The accuracy evaluation of the camera positions calculated resulted in an average deviation error of 1.45 mm ± 0.76 mm to the real camera displacement. This value was calculated using only stereo images with over 100 reconstructed landmark pairs each. This provides the basis for marker-free navigation.</p>","PeriodicalId":8900,"journal":{"name":"Biomedical Engineering / Biomedizinische Technik","volume":"67 5","pages":"411-417"},"PeriodicalIF":1.3000,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automatic landmark identification for surgical 3d-navigation - A proposed method for marker-free dental surgical navigation systems.\",\"authors\":\"Micha Bischofberger, Stephan Böhringer, Erik Schkommodau\",\"doi\":\"10.1515/bmt-2021-0307\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This paper proposes a conceptual method to calculate the pose of a stereo-vision camera relative to an artificial mandible without additional markers. The general method for marker-free navigation has four steps: 1) parallel image acquisition by a stereo-vision camera, 2) automatic identification of 2d point pairs (landmark pairs) in a left and a right image, 3) calculation of related 3d points in the joint camera coordinate system and 4) matching of 3d points generated to a preoperative 3d model (i.e., CT data based). To identify and compare landmarks in the acquired stereo images, well-known algorithms for landmark detection, description and matching were compared within the developed approach. Finally, the BRISK algorithm (Leutenegger S, Chli M, Siegwart RY. BRISK: Binary Robust invariant scalable keypoints. Proceedings of the IEEE International Conference on Computer Vision; 2011: 2548-2555) was used. The proposed method was implemented in MATLAB<sup>®</sup> and validated <i>in vitro</i> with one artificial mandible. The accuracy evaluation of the camera positions calculated resulted in an average deviation error of 1.45 mm ± 0.76 mm to the real camera displacement. This value was calculated using only stereo images with over 100 reconstructed landmark pairs each. This provides the basis for marker-free navigation.</p>\",\"PeriodicalId\":8900,\"journal\":{\"name\":\"Biomedical Engineering / Biomedizinische Technik\",\"volume\":\"67 5\",\"pages\":\"411-417\"},\"PeriodicalIF\":1.3000,\"publicationDate\":\"2022-07-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical Engineering / Biomedizinische Technik\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1515/bmt-2021-0307\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2022/10/26 0:00:00\",\"PubModel\":\"Print\",\"JCR\":\"Q4\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Engineering / Biomedizinische Technik","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1515/bmt-2021-0307","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/10/26 0:00:00","PubModel":"Print","JCR":"Q4","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
摘要
本文提出了一种不需要附加标记来计算立体视觉相机相对于人工下颌骨的姿态的概念方法。无标记导航的一般方法有四个步骤:1)由立体视觉相机获取平行图像,2)自动识别左右图像中的二维点对(地标对),3)在联合相机坐标系中计算相关的三维点,4)将生成的三维点与术前三维模型(即基于CT数据)进行匹配。为了识别和比较获得的立体图像中的地标,在开发的方法中比较了已知的地标检测,描述和匹配算法。Leutenegger S, Chli M, Siegwart RY. BRISK:二值鲁棒不变可伸缩关键点。IEEE计算机视觉国际会议论文集;2011: 2548-2555)。在MATLAB®中实现了该方法,并在一个人工下颌骨上进行了体外验证。计算得到的摄像机位置精度评价结果与摄像机实际位移的平均偏差为1.45 mm±0.76 mm。该值仅使用具有100多个重建地标对的立体图像来计算。这为无标记导航提供了基础。
Automatic landmark identification for surgical 3d-navigation - A proposed method for marker-free dental surgical navigation systems.
This paper proposes a conceptual method to calculate the pose of a stereo-vision camera relative to an artificial mandible without additional markers. The general method for marker-free navigation has four steps: 1) parallel image acquisition by a stereo-vision camera, 2) automatic identification of 2d point pairs (landmark pairs) in a left and a right image, 3) calculation of related 3d points in the joint camera coordinate system and 4) matching of 3d points generated to a preoperative 3d model (i.e., CT data based). To identify and compare landmarks in the acquired stereo images, well-known algorithms for landmark detection, description and matching were compared within the developed approach. Finally, the BRISK algorithm (Leutenegger S, Chli M, Siegwart RY. BRISK: Binary Robust invariant scalable keypoints. Proceedings of the IEEE International Conference on Computer Vision; 2011: 2548-2555) was used. The proposed method was implemented in MATLAB® and validated in vitro with one artificial mandible. The accuracy evaluation of the camera positions calculated resulted in an average deviation error of 1.45 mm ± 0.76 mm to the real camera displacement. This value was calculated using only stereo images with over 100 reconstructed landmark pairs each. This provides the basis for marker-free navigation.
期刊介绍:
Biomedical Engineering / Biomedizinische Technik (BMT) is a high-quality forum for the exchange of knowledge in the fields of biomedical engineering, medical information technology and biotechnology/bioengineering. As an established journal with a tradition of more than 60 years, BMT addresses engineers, natural scientists, and clinicians working in research, industry, or clinical practice.