{"title":"GeoCM-Pose: geometry-aware monocular dental 2D/3D registration benchmarked against reference-assisted methods.","authors":"Zhixian Qiu, Jingang Jiang, Jie Pan, Xinrui Cheng, Qunsong Qiu, Jiawei Zhang, Jingchao Wang, Guang Yu","doi":"10.1088/1361-6560/aeaa9e","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective.</i>To develop GeoCM-Pose, a geometry-aware monocular dental 2D/3D registration method that predicts metric model-to-camera 6DoF pose from one image under weak texture, repetitive anatomy and partial visibility.<i>Approach.</i>GeoCM-Pose comprises cross-modal adaptation (CMA) and geometry-aware pose regression (GAPR). CMA uses fixed-Gaussian frequency separation and a high-frequency structure-preservation module with multi-scale edge extraction, spatial-channel gating and cross-resolution refinement. GAPR uses a ResNet-50/U-Net to predict dense object-coordinate maps; hierarchical geometric feature aggregation and geometry-aware channel refinement feed decoupled unit-quaternion and translation heads. Joint 20-point pose-matching and dense-coordinate losses train the network. The study comprised 30<i>in vitro</i>training cases, five<i>in vivo</i>validation cases, five<i>in vivo</i>internal-test cases, 10 fully held-out Teeth3DS+ dental surface models and a 200-frame benchmark generated from a single three-dimensional dental model.<i>Main Results.</i>GAPR/V0 generated pose estimates for all 200 query frames, with median reprojection, rotation and translation-vector errors of 2.156 px, 1.252° and 0.653 mm, respectively, and a <5 px pass rate of 91.5% across all attempts. It used no inference-time reference-image bank. At R01, scale-invariant feature transform and ORB generated 85/200 and 89/200 valid estimates, with <5 px all-attempt pass rates of 40.5% and 40.0%; at R20, each generated 197/200 valid estimates, with pass rates of 98.0% and 95.5%. Thus, conventional performance increased with the available reference bank, whereas GAPR/V0 provided complete query coverage from a single image without inference-time reference images. Median GAPR/V0 inference latency, including image I/O, was 11.459 ms.<i>Significance.</i>GeoCM-Pose integrates CMA, dense object-coordinate supervision and metric pose regression for monocular dental 2D/3D registration. Further case-level evaluation using intraoral endoscopic images acquired from independent patient cases and additional image domains, together with robot-integrated experiments, is required to assess generalisation and system-level performance.</p>","PeriodicalId":20185,"journal":{"name":"Physics in medicine and biology","volume":" ","pages":""},"PeriodicalIF":3.1000,"publicationDate":"2026-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physics in medicine and biology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6560/aeaa9e","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective.To develop GeoCM-Pose, a geometry-aware monocular dental 2D/3D registration method that predicts metric model-to-camera 6DoF pose from one image under weak texture, repetitive anatomy and partial visibility.Approach.GeoCM-Pose comprises cross-modal adaptation (CMA) and geometry-aware pose regression (GAPR). CMA uses fixed-Gaussian frequency separation and a high-frequency structure-preservation module with multi-scale edge extraction, spatial-channel gating and cross-resolution refinement. GAPR uses a ResNet-50/U-Net to predict dense object-coordinate maps; hierarchical geometric feature aggregation and geometry-aware channel refinement feed decoupled unit-quaternion and translation heads. Joint 20-point pose-matching and dense-coordinate losses train the network. The study comprised 30in vitrotraining cases, fivein vivovalidation cases, fivein vivointernal-test cases, 10 fully held-out Teeth3DS+ dental surface models and a 200-frame benchmark generated from a single three-dimensional dental model.Main Results.GAPR/V0 generated pose estimates for all 200 query frames, with median reprojection, rotation and translation-vector errors of 2.156 px, 1.252° and 0.653 mm, respectively, and a <5 px pass rate of 91.5% across all attempts. It used no inference-time reference-image bank. At R01, scale-invariant feature transform and ORB generated 85/200 and 89/200 valid estimates, with <5 px all-attempt pass rates of 40.5% and 40.0%; at R20, each generated 197/200 valid estimates, with pass rates of 98.0% and 95.5%. Thus, conventional performance increased with the available reference bank, whereas GAPR/V0 provided complete query coverage from a single image without inference-time reference images. Median GAPR/V0 inference latency, including image I/O, was 11.459 ms.Significance.GeoCM-Pose integrates CMA, dense object-coordinate supervision and metric pose regression for monocular dental 2D/3D registration. Further case-level evaluation using intraoral endoscopic images acquired from independent patient cases and additional image domains, together with robot-integrated experiments, is required to assess generalisation and system-level performance.
目的:开发一种几何感知的单眼牙科二维/三维配准方法GeoCM-Pose,该方法可以在弱纹理、重复解剖和部分可见的情况下从一张图像中预测度量模型到相机的6DoF姿态。
;GeoCM-Pose包括跨模态自适应(CMA)和几何感知姿态回归(GAPR)。CMA采用固定高斯频率分离和多尺度边缘提取、空间通道门控和交叉分辨率细化的高频结构保持模块。GAPR使用ResNet-50/U-Net来预测密集的物体坐标地图;分层几何特征聚合和几何感知通道细化提供解耦的单位四元数和平移头。联合20点姿势匹配和密集坐标损失训练网络。本研究包括30个体外训练病例,5个体内验证病例,5个体内内测病例,10个全支撑Teeth3DS+牙面模型,以及由单个三维牙模型生成的200帧基准。GAPR/V0生成了所有200个查询帧的姿态估计,重投影、旋转和平移矢量的中位数误差分别为2.156 px、1.252°和0.653 mm
期刊介绍:
The development and application of theoretical, computational and experimental physics to medicine, physiology and biology. Topics covered are: therapy physics (including ionizing and non-ionizing radiation); biomedical imaging (e.g. x-ray, magnetic resonance, ultrasound, optical and nuclear imaging); image-guided interventions; image reconstruction and analysis (including kinetic modelling); artificial intelligence in biomedical physics and analysis; nanoparticles in imaging and therapy; radiobiology; radiation protection and patient dose monitoring; radiation dosimetry