VDVM: An automatic vertebrae detection and vertebral segment matching framework for C-arm X-ray image identification.

IF 1.7 3区 医学 Q3 INSTRUMENTS & INSTRUMENTATION
Ruyi Zhang, Yiwei Hu, Kai Zhang, Guanhua Lan, Liang Peng, Yabin Zhu, Wei Qian, Yudong Yao
{"title":"VDVM: An automatic vertebrae detection and vertebral segment matching framework for C-arm X-ray image identification.","authors":"Ruyi Zhang,&nbsp;Yiwei Hu,&nbsp;Kai Zhang,&nbsp;Guanhua Lan,&nbsp;Liang Peng,&nbsp;Yabin Zhu,&nbsp;Wei Qian,&nbsp;Yudong Yao","doi":"10.3233/XST-230025","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>C-arm fluoroscopy, as an effective diagnosis and treatment method for spine surgery, can help doctors perform surgery procedures more precisely. In clinical surgery, the surgeon often determines the specific surgical location by comparing C-arm X-ray images with digital radiography (DR) images. However, this heavily relies on the doctor's experience.</p><p><strong>Objective: </strong>In this study, we design a framework for automatic vertebrae detection as well as vertebral segment matching (VDVM) for the identification of vertebrae in C-arm X-ray images.</p><p><strong>Methods: </strong>The proposed VDVM framework is mainly divided into two parts: vertebra detection and vertebra matching. In the first part, a data preprocessing method is used to improve the image quality of C-arm X-ray images and DR images. The YOLOv3 model is then used to detect the vertebrae, and the vertebral regions are extracted based on their position. In the second part, the Mobile-Unet model is first used to segment the vertebrae contour of the C-arm X-ray image and DR image based on vertebral regions respectively. The inclination angle of the contour is then calculated using the minimum bounding rectangle and corrected accordingly. Finally, a multi-vertebra strategy is applied to measure the visual information fidelity for the vertebral region, and the vertebrae are matched based on the measured results.</p><p><strong>Results: </strong>We use 382 C-arm X-ray images and 203 full length X-ray images to train the vertebra detection model, and achieve a mAP of 0.87 in the test dataset of 31 C-arm X-ray images and 0.96 in the test dataset of 31 lumbar DR images. Finally, we achieve a vertebral segment matching accuracy of 0.733 on 31 C-arm X-ray images.</p><p><strong>Conclusions: </strong>A VDVM framework is proposed, which performs well for the detection of vertebrae and achieves good results in vertebral segment matching.</p>","PeriodicalId":49948,"journal":{"name":"Journal of X-Ray Science and Technology","volume":"31 5","pages":"935-949"},"PeriodicalIF":1.7000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of X-Ray Science and Technology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3233/XST-230025","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
引用次数: 0

Abstract

Background: C-arm fluoroscopy, as an effective diagnosis and treatment method for spine surgery, can help doctors perform surgery procedures more precisely. In clinical surgery, the surgeon often determines the specific surgical location by comparing C-arm X-ray images with digital radiography (DR) images. However, this heavily relies on the doctor's experience.

Objective: In this study, we design a framework for automatic vertebrae detection as well as vertebral segment matching (VDVM) for the identification of vertebrae in C-arm X-ray images.

Methods: The proposed VDVM framework is mainly divided into two parts: vertebra detection and vertebra matching. In the first part, a data preprocessing method is used to improve the image quality of C-arm X-ray images and DR images. The YOLOv3 model is then used to detect the vertebrae, and the vertebral regions are extracted based on their position. In the second part, the Mobile-Unet model is first used to segment the vertebrae contour of the C-arm X-ray image and DR image based on vertebral regions respectively. The inclination angle of the contour is then calculated using the minimum bounding rectangle and corrected accordingly. Finally, a multi-vertebra strategy is applied to measure the visual information fidelity for the vertebral region, and the vertebrae are matched based on the measured results.

Results: We use 382 C-arm X-ray images and 203 full length X-ray images to train the vertebra detection model, and achieve a mAP of 0.87 in the test dataset of 31 C-arm X-ray images and 0.96 in the test dataset of 31 lumbar DR images. Finally, we achieve a vertebral segment matching accuracy of 0.733 on 31 C-arm X-ray images.

Conclusions: A VDVM framework is proposed, which performs well for the detection of vertebrae and achieves good results in vertebral segment matching.

VDVM:用于c臂x射线图像识别的自动椎体检测和椎段匹配框架。
背景:c臂透视作为一种有效的脊柱外科诊疗手段,可以帮助医生更精确地进行手术操作。在临床手术中,外科医生通常通过比较c臂x线图像与数字x线图像(DR)来确定具体的手术位置。然而,这在很大程度上依赖于医生的经验。目的:在本研究中,我们设计了一个自动椎骨检测和椎段匹配(VDVM)框架,用于识别c臂x射线图像中的椎骨。方法:提出的VDVM框架主要分为两部分:椎体检测和椎体匹配。第一部分采用数据预处理方法提高c臂x射线图像和DR图像的图像质量。然后使用YOLOv3模型检测椎体,并根据其位置提取椎体区域。在第二部分中,首先利用Mobile-Unet模型分别对c臂x射线图像和基于椎体区域的DR图像进行椎体轮廓分割。然后使用最小边界矩形计算轮廓的倾斜角并进行相应的校正。最后,采用多椎体策略测量椎体区域的视觉信息保真度,并根据测量结果对椎体进行匹配。结果:我们使用382张c臂x线图像和203张全长x线图像来训练椎体检测模型,在31张c臂x线图像的测试数据集中实现了0.87的mAP,在31张腰椎DR图像的测试数据集中实现了0.96的mAP。最后,我们在31张c臂x射线图像上实现了0.733的椎段匹配精度。结论:提出了一种VDVM框架,该框架对椎体的检测效果较好,在椎段匹配方面取得了较好的效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.90
自引率
23.30%
发文量
150
审稿时长
3 months
期刊介绍: Research areas within the scope of the journal include: Interaction of x-rays with matter: x-ray phenomena, biological effects of radiation, radiation safety and optical constants X-ray sources: x-rays from synchrotrons, x-ray lasers, plasmas, and other sources, conventional or unconventional Optical elements: grazing incidence optics, multilayer mirrors, zone plates, gratings, other diffraction optics Optical instruments: interferometers, spectrometers, microscopes, telescopes, microprobes
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信