Attila Simkó , Mikael Bylund , Gustav Jönsson , Tommy Löfstedt , Anders Garpebring , Tufve Nyholm , Joakim Jonsson
{"title":"实现独立于磁共振造影剂的合成 CT 生成","authors":"Attila Simkó , Mikael Bylund , Gustav Jönsson , Tommy Löfstedt , Anders Garpebring , Tufve Nyholm , Joakim Jonsson","doi":"10.1016/j.zemedi.2023.07.001","DOIUrl":null,"url":null,"abstract":"<div><p>The use of synthetic CT (sCT) in the radiotherapy workflow would reduce costs and scan time while removing the uncertainties around working with both MR and CT modalities. The performance of deep learning (DL) solutions for sCT generation is steadily increasing, however most proposed methods were trained and validated on private datasets of a single contrast from a single scanner. Such solutions might not perform equally well on other datasets, limiting their general usability and therefore value. Additionally, functional evaluations of sCTs such as dosimetric comparisons with CT-based dose calculations better show the impact of the methods, but the evaluations are more labor intensive than pixel-wise metrics.</p><p>To improve the generalization of an sCT model, we propose to incorporate a pre-trained DL model to pre-process the input MR images by generating artificial proton density, <span><math><mrow><mi>T</mi><mn>1</mn></mrow></math></span> and <span><math><mrow><mi>T</mi><mn>2</mn></mrow></math></span> maps (<em>i.e.</em> contrast-independent quantitative maps), which are then used for sCT generation. Using a dataset of only <span><math><mrow><mi>T</mi><mn>2</mn><mi>w</mi></mrow></math></span> MR images, the robustness towards input MR contrasts of this approach is compared to a model that was trained using the MR images directly. We evaluate the generated sCTs using pixel-wise metrics and calculating mean radiological depths, as an approximation of the mean delivered dose.</p><p>On <span><math><mrow><mi>T</mi><mn>2</mn><mi>w</mi></mrow></math></span> images acquired with the same settings as the training dataset, there was no significant difference between the performance of the models. However, when evaluated on <span><math><mrow><mi>T</mi><mn>1</mn><mi>w</mi></mrow></math></span> images, and a wide range of other contrasts and scanners from both public and private datasets, our approach outperforms the baseline model.</p><p>Using a dataset of <span><math><mrow><mi>T</mi><mn>2</mn><mi>w</mi></mrow></math></span> MR images, our proposed model implements synthetic quantitative maps to generate sCT images, improving the generalization towards other contrasts. Our code and trained models are publicly available.</p></div>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0939388923000831/pdfft?md5=3e1f7674de1352aa91dfccab724c3a83&pid=1-s2.0-S0939388923000831-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Towards MR contrast independent synthetic CT generation\",\"authors\":\"Attila Simkó , Mikael Bylund , Gustav Jönsson , Tommy Löfstedt , Anders Garpebring , Tufve Nyholm , Joakim Jonsson\",\"doi\":\"10.1016/j.zemedi.2023.07.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The use of synthetic CT (sCT) in the radiotherapy workflow would reduce costs and scan time while removing the uncertainties around working with both MR and CT modalities. The performance of deep learning (DL) solutions for sCT generation is steadily increasing, however most proposed methods were trained and validated on private datasets of a single contrast from a single scanner. Such solutions might not perform equally well on other datasets, limiting their general usability and therefore value. Additionally, functional evaluations of sCTs such as dosimetric comparisons with CT-based dose calculations better show the impact of the methods, but the evaluations are more labor intensive than pixel-wise metrics.</p><p>To improve the generalization of an sCT model, we propose to incorporate a pre-trained DL model to pre-process the input MR images by generating artificial proton density, <span><math><mrow><mi>T</mi><mn>1</mn></mrow></math></span> and <span><math><mrow><mi>T</mi><mn>2</mn></mrow></math></span> maps (<em>i.e.</em> contrast-independent quantitative maps), which are then used for sCT generation. Using a dataset of only <span><math><mrow><mi>T</mi><mn>2</mn><mi>w</mi></mrow></math></span> MR images, the robustness towards input MR contrasts of this approach is compared to a model that was trained using the MR images directly. We evaluate the generated sCTs using pixel-wise metrics and calculating mean radiological depths, as an approximation of the mean delivered dose.</p><p>On <span><math><mrow><mi>T</mi><mn>2</mn><mi>w</mi></mrow></math></span> images acquired with the same settings as the training dataset, there was no significant difference between the performance of the models. However, when evaluated on <span><math><mrow><mi>T</mi><mn>1</mn><mi>w</mi></mrow></math></span> images, and a wide range of other contrasts and scanners from both public and private datasets, our approach outperforms the baseline model.</p><p>Using a dataset of <span><math><mrow><mi>T</mi><mn>2</mn><mi>w</mi></mrow></math></span> MR images, our proposed model implements synthetic quantitative maps to generate sCT images, improving the generalization towards other contrasts. Our code and trained models are publicly available.</p></div>\",\"PeriodicalId\":2,\"journal\":{\"name\":\"ACS Applied Bio Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0939388923000831/pdfft?md5=3e1f7674de1352aa91dfccab724c3a83&pid=1-s2.0-S0939388923000831-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Bio Materials\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0939388923000831\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, BIOMATERIALS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0939388923000831","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
Towards MR contrast independent synthetic CT generation
The use of synthetic CT (sCT) in the radiotherapy workflow would reduce costs and scan time while removing the uncertainties around working with both MR and CT modalities. The performance of deep learning (DL) solutions for sCT generation is steadily increasing, however most proposed methods were trained and validated on private datasets of a single contrast from a single scanner. Such solutions might not perform equally well on other datasets, limiting their general usability and therefore value. Additionally, functional evaluations of sCTs such as dosimetric comparisons with CT-based dose calculations better show the impact of the methods, but the evaluations are more labor intensive than pixel-wise metrics.
To improve the generalization of an sCT model, we propose to incorporate a pre-trained DL model to pre-process the input MR images by generating artificial proton density, and maps (i.e. contrast-independent quantitative maps), which are then used for sCT generation. Using a dataset of only MR images, the robustness towards input MR contrasts of this approach is compared to a model that was trained using the MR images directly. We evaluate the generated sCTs using pixel-wise metrics and calculating mean radiological depths, as an approximation of the mean delivered dose.
On images acquired with the same settings as the training dataset, there was no significant difference between the performance of the models. However, when evaluated on images, and a wide range of other contrasts and scanners from both public and private datasets, our approach outperforms the baseline model.
Using a dataset of MR images, our proposed model implements synthetic quantitative maps to generate sCT images, improving the generalization towards other contrasts. Our code and trained models are publicly available.