Assessment of video frame interpolation network to generate digital breast tomosynthesis projections

Arthur C. Costa, R. B. Vimieiro, L. Borges, B. Barufaldi, Andrew D. A. Maidment, M. Vieira
{"title":"Assessment of video frame interpolation network to generate digital breast tomosynthesis projections","authors":"Arthur C. Costa, R. B. Vimieiro, L. Borges, B. Barufaldi, Andrew D. A. Maidment, M. Vieira","doi":"10.1117/12.2625748","DOIUrl":null,"url":null,"abstract":"The angular range and number of projections are parameters that directly influence the image quality and the visibility of lesions in digital breast tomosynthesis (DBT). The medical field is taking advantage of the increasing performance of machine learning algorithms with the use of complex data-driven models, known as deep learning (DL) networks. The use of DL has also been highlighted in the tasks of video frame interpolation (VFI) for the synthesis of new images in order to increase the frame rate per second. In the present work, we use a residual refinement interpolation network (RRIN) to generate new synthetic DBT projections from pairs of real projections. We studied two different approaches: first, we increased the number of projections before reconstruction using the synthetic images, with the aim of improving the quality of the reconstructed slices without increasing the radiation dose to the patient. In the second, we investigated the effect of replacing existing projections with synthetic ones, with the objective of reducing the radiation dose and acquisition time. In the first approach, we used virtual phantoms to generate sets of DBT projections to train the network. We then evaluated the contrast-to-noise ratio (CNR) of simulated microcalcifications after reconstruction. The CNR was higher for all sets where supplementary images were added compared to those with only real images. In the second approach, we trained the network with clinical data and tested it with images acquired with a physical anthropomorphic breast phantom. Both the projections and the slices showed good similarity with the real ones, suggesting that the use of VFI networks to generate DBT projections is promising. However, further studies should be carried out to assess the feasibility of this approach.","PeriodicalId":92005,"journal":{"name":"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)","volume":"377 1","pages":"122861D - 122861D-8"},"PeriodicalIF":0.0000,"publicationDate":"2022-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2625748","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

The angular range and number of projections are parameters that directly influence the image quality and the visibility of lesions in digital breast tomosynthesis (DBT). The medical field is taking advantage of the increasing performance of machine learning algorithms with the use of complex data-driven models, known as deep learning (DL) networks. The use of DL has also been highlighted in the tasks of video frame interpolation (VFI) for the synthesis of new images in order to increase the frame rate per second. In the present work, we use a residual refinement interpolation network (RRIN) to generate new synthetic DBT projections from pairs of real projections. We studied two different approaches: first, we increased the number of projections before reconstruction using the synthetic images, with the aim of improving the quality of the reconstructed slices without increasing the radiation dose to the patient. In the second, we investigated the effect of replacing existing projections with synthetic ones, with the objective of reducing the radiation dose and acquisition time. In the first approach, we used virtual phantoms to generate sets of DBT projections to train the network. We then evaluated the contrast-to-noise ratio (CNR) of simulated microcalcifications after reconstruction. The CNR was higher for all sets where supplementary images were added compared to those with only real images. In the second approach, we trained the network with clinical data and tested it with images acquired with a physical anthropomorphic breast phantom. Both the projections and the slices showed good similarity with the real ones, suggesting that the use of VFI networks to generate DBT projections is promising. However, further studies should be carried out to assess the feasibility of this approach.
评估视频帧插值网络生成数字乳房断层合成投影
在数字乳腺断层合成(DBT)中,投影的角度范围和数量是直接影响图像质量和病变可见性的参数。医疗领域正在利用复杂的数据驱动模型(即深度学习(DL)网络)来提高机器学习算法的性能。在合成新图像的视频帧插值(VFI)任务中,为了提高每秒帧率,DL的使用也得到了强调。在本工作中,我们使用残差细化插值网络(RRIN)从对真实投影生成新的合成DBT投影。我们研究了两种不同的方法:第一,我们在使用合成图像重建之前增加投影的数量,目的是在不增加对患者的辐射剂量的情况下提高重建切片的质量。其次,我们研究了用合成投影代替现有投影的效果,目的是减少辐射剂量和获取时间。在第一种方法中,我们使用虚拟幻影来生成DBT投影集来训练网络。然后我们评估重建后模拟微钙化的对比噪声比(CNR)。与只添加真实图像的集合相比,添加了补充图像的所有集合的CNR都更高。在第二种方法中,我们用临床数据训练网络,并用物理拟人化乳房幻影获得的图像对其进行测试。投影和切片都显示出与真实图像的良好相似性,这表明使用VFI网络生成DBT投影是有希望的。但是,应该进行进一步的研究,以评估这种方法的可行性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信