Self-calibrated surface acquisition for integrated positioning verification in medical applications
S. Jörissen, M. Bleier, A. Nüchter
{"title":"Self-calibrated surface acquisition for integrated positioning verification in medical applications","authors":"S. Jörissen, M. Bleier, A. Nüchter","doi":"10.2352/issn.2470-1173.2019.4.pmii-353","DOIUrl":null,"url":null,"abstract":"This paper presents a novel approach for a position verification system in medical applications. By replacing the already existing cross line laser projectors with galvoor MEMS-based projectors and utilizing the surveillance cameras, a self-calibration of the system is performed and surface acquisition for positioning verification is demonstrated. The functionality is shown by analyzing the radii of calibration spheres and determining the quality of the captured surface with respect to a reference model. The paper focuses on the demonstration with one pair of camera and projector but can also be extended to a multi-camera-projector system, as present in treatment rooms. Compared to other systems, this approach does not need external hardware and is thus space and cost efficient. Introduction Nowadays, a wide range of medical applications demand accurate patient positioning for a successful treatment. While the positioning for X-ray imaging allows tolerances of several millimeters since typically rather big areas are imaged, the required accuracy for CT-imaging and especially classical radiation therapy, Volumetric Arc Therapy (VMAT), Intensity-Modulated Radiation Therapy (IMRT) and 3D Conformal Radiation Therapy (3D CRT) for cancer treatment is much higher. The goal of radiation therapy is to damage the cancer cells as much as possible, while keeping the amount of radiation within the surrounding tissue to an absolute minimum. The de facto standard procedure for patient positioning in radiation therapy is as follows: An initial CT scan is performed to gather anatomical data for the treatment. Here, markers are placed on the patients skin, which are later used to align the patient with the orthogonal line lasers in the treatment room. In a previous step, those line lasers are calibrated to directly intersect in the linear accelerators (linacs) ”isocenter”, the point where the beams of the rotating linac intercept and therefore the radiation intensity is at its peak. The calibration of the isocenter is done performing the Winston-Lutz test. Once the isocenter is calibrated and the patient aligned, the treatment is started. Typically, the initial CT scans outcome is used for several radiation therapy sessions, so are the markers. Fig. 1 shows a typical treatment room with patient couch, gantry, red room lasers for positioning and a test phantom. The importance of precise patient positioning and the potential of optical surface imaging technologies for both positioning and respiratory gating is becoming more and more clear and was recently confirmed and discussed by publications such as [1], [2] and [3]. This paper provides a new method of verifying the patients Figure 1. Radiation-therapy room with gantry and positioning lasers (red) position with respect to the linacs isocenter. A typical treatment room already consists of multiple cameras for surveillance and line lasers for calibration, isocenter visualization and patient positioning. By replacing those static line lasers with galvoor MEMS-based laser projectors and combining the laser projectors with the cameras to active stereo systems, multiple applications are imaginable, while the main functionality of positioning the patient manually with respect to the laser crosses and thus, the isocenter, is still provided: 1. The extrinsic calibration of the system is performed automatically, making the handling easy and self-verifying. 2. The patient’s position is acquired by scanning the surface using a shape reconstruction method based on light sectioning. 3. The position can then be matched to the data from the CTscan, giving a translation vector for shifting the position of the patient by adjusting the treatment bench. 4. Additionally, respiratory gating can be performed to increase the efficiency of the therapy and thus, protecting the surrounding tissue during treatment. Since no CT-scan data or with the Winston-Lutz test aligned set of projectors was present and respiratory gating is still considered to be future work, this paper focuses on the first two applications and demonstrates the functionality by means of a test setup consisting of one camera-projector-pair. Although the proposed self-calibrating projector-camera setup is applicable for shape acquisition in general when used as a laser-line based structured light system, this paper only focuses IS&T International Symposium on Electronic Imaging 2019 Photography, Mobile, and Immersive Imaging 2019 353-1 https://doi.org/10.2352/ISSN.2470-1173.2019.4.PMII-353 © 2019, Society for Imaging Science and Technology","PeriodicalId":309050,"journal":{"name":"Photography, Mobile, and Immersive Imaging","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Photography, Mobile, and Immersive Imaging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2352/issn.2470-1173.2019.4.pmii-353","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This paper presents a novel approach for a position verification system in medical applications. By replacing the already existing cross line laser projectors with galvoor MEMS-based projectors and utilizing the surveillance cameras, a self-calibration of the system is performed and surface acquisition for positioning verification is demonstrated. The functionality is shown by analyzing the radii of calibration spheres and determining the quality of the captured surface with respect to a reference model. The paper focuses on the demonstration with one pair of camera and projector but can also be extended to a multi-camera-projector system, as present in treatment rooms. Compared to other systems, this approach does not need external hardware and is thus space and cost efficient. Introduction Nowadays, a wide range of medical applications demand accurate patient positioning for a successful treatment. While the positioning for X-ray imaging allows tolerances of several millimeters since typically rather big areas are imaged, the required accuracy for CT-imaging and especially classical radiation therapy, Volumetric Arc Therapy (VMAT), Intensity-Modulated Radiation Therapy (IMRT) and 3D Conformal Radiation Therapy (3D CRT) for cancer treatment is much higher. The goal of radiation therapy is to damage the cancer cells as much as possible, while keeping the amount of radiation within the surrounding tissue to an absolute minimum. The de facto standard procedure for patient positioning in radiation therapy is as follows: An initial CT scan is performed to gather anatomical data for the treatment. Here, markers are placed on the patients skin, which are later used to align the patient with the orthogonal line lasers in the treatment room. In a previous step, those line lasers are calibrated to directly intersect in the linear accelerators (linacs) ”isocenter”, the point where the beams of the rotating linac intercept and therefore the radiation intensity is at its peak. The calibration of the isocenter is done performing the Winston-Lutz test. Once the isocenter is calibrated and the patient aligned, the treatment is started. Typically, the initial CT scans outcome is used for several radiation therapy sessions, so are the markers. Fig. 1 shows a typical treatment room with patient couch, gantry, red room lasers for positioning and a test phantom. The importance of precise patient positioning and the potential of optical surface imaging technologies for both positioning and respiratory gating is becoming more and more clear and was recently confirmed and discussed by publications such as [1], [2] and [3]. This paper provides a new method of verifying the patients Figure 1. Radiation-therapy room with gantry and positioning lasers (red) position with respect to the linacs isocenter. A typical treatment room already consists of multiple cameras for surveillance and line lasers for calibration, isocenter visualization and patient positioning. By replacing those static line lasers with galvoor MEMS-based laser projectors and combining the laser projectors with the cameras to active stereo systems, multiple applications are imaginable, while the main functionality of positioning the patient manually with respect to the laser crosses and thus, the isocenter, is still provided: 1. The extrinsic calibration of the system is performed automatically, making the handling easy and self-verifying. 2. The patient’s position is acquired by scanning the surface using a shape reconstruction method based on light sectioning. 3. The position can then be matched to the data from the CTscan, giving a translation vector for shifting the position of the patient by adjusting the treatment bench. 4. Additionally, respiratory gating can be performed to increase the efficiency of the therapy and thus, protecting the surrounding tissue during treatment. Since no CT-scan data or with the Winston-Lutz test aligned set of projectors was present and respiratory gating is still considered to be future work, this paper focuses on the first two applications and demonstrates the functionality by means of a test setup consisting of one camera-projector-pair. Although the proposed self-calibrating projector-camera setup is applicable for shape acquisition in general when used as a laser-line based structured light system, this paper only focuses IS&T International Symposium on Electronic Imaging 2019 Photography, Mobile, and Immersive Imaging 2019 353-1 https://doi.org/10.2352/ISSN.2470-1173.2019.4.PMII-353 © 2019, Society for Imaging Science and Technology
自校准表面采集集成定位验证在医疗应用
本文提出了一种用于医学应用的位置验证系统的新方法。通过将现有的交叉线激光投影仪替换为基于galvoor mems的投影仪,并利用监控摄像头,对系统进行了自校准,并演示了用于定位验证的表面采集。通过分析标定球的半径和确定捕获表面相对于参考模型的质量来证明其功能。本文的重点是一对相机和投影仪的演示,但也可以扩展到一个多相机投影仪系统,如目前在治疗室。与其他系统相比,这种方法不需要外部硬件,因此节省了空间和成本。如今,广泛的医疗应用需要准确的病人定位成功的治疗。虽然x射线成像的定位允许几毫米的公差,因为通常相当大的区域被成像,但ct成像,特别是经典放射治疗,体积弧治疗(VMAT),调强放射治疗(IMRT)和3D适形放射治疗(3D CRT)对癌症治疗的精度要求要高得多。放射治疗的目标是尽可能地破坏癌细胞,同时将周围组织的辐射量降到最低。事实上,放射治疗中患者定位的标准程序如下:进行初始CT扫描以收集治疗所需的解剖学数据。在这里,标记被放置在患者的皮肤上,随后用于将患者与治疗室中的正交线激光对齐。在之前的步骤中,这些线激光器被校准成直接相交于直线加速器(linacs)的“等中心”,即旋转直线加速器光束的截距点,因此辐射强度达到峰值。等中心的校准是通过温斯顿-卢茨试验完成的。一旦等中心校准好,病人对齐好,治疗就开始了。通常,最初的CT扫描结果用于几次放射治疗,标记物也是如此。图1显示了一个典型的治疗室,包括病人沙发、龙门架、用于定位的红室激光器和测试幻影。精确的患者定位的重要性和光学表面成像技术在定位和呼吸门控方面的潜力正变得越来越清晰,最近被诸如[1],[2]和[3]等出版物证实和讨论。本文提供了一种新的验证患者的方法(图1)。放射治疗室与龙门和定位激光器(红色)的位置相对于直线等心。一个典型的治疗室已经由多个监控摄像机和用于校准、等中心可视化和患者定位的线激光器组成。通过用基于galvoor mems的激光投影仪取代那些静态线激光器,并将激光投影仪与摄像头结合到主动立体系统中,可以想象多种应用,同时仍然提供了手动定位患者相对于激光交叉的主要功能,因此,等中心:系统的外部校准是自动进行的,使操作方便和自验证。2. 使用基于光切片的形状重建方法通过扫描表面获得患者的位置。3.。然后,位置可以与ct扫描的数据相匹配,通过调整治疗台来移动患者的位置,从而提供一个平移向量。4. 此外,呼吸门控可以提高治疗效率,从而在治疗期间保护周围组织。由于没有ct扫描数据或与温斯顿-卢茨测试对齐的投影仪组存在,并且呼吸门控仍被认为是未来的工作,因此本文主要关注前两个应用,并通过由一个摄像机-投影仪对组成的测试设置来演示功能。虽然所提出的自校准投影仪相机设置一般适用于形状采集,当用作基于激光线的结构光系统时,本文仅关注IS&T 2019电子成像国际研讨会摄影,移动和沉浸式成像2019 353-1 https://doi.org/10.2352/ISSN.2470-1173.2019.4.PMII-353©2019,Society for Imaging Science and Technology
本文章由计算机程序翻译,如有差异,请以英文原文为准。