利用混合神经网络一次生成腹主动脉瘤的腔网

R. Epifanov, R. Mullyadzhanov, Andrey A. Karpenko
{"title":"利用混合神经网络一次生成腹主动脉瘤的腔网","authors":"R. Epifanov, R. Mullyadzhanov, Andrey A. Karpenko","doi":"10.17816/dd626155","DOIUrl":null,"url":null,"abstract":"BACKGROUND: The majority of current algorithms for blood flow surface extraction in the context of hemomodeling of abdominal aortic aneurysms are derived through a segmentation step, rather than directly from CT scans [1]. This approach introduces a degree of complexity, as the segmentation neural network is trained without consideration of the fact that the blood flow is a simply-connected region. Consequently, post-processing may be required to fulfill the simple connectivity criterion. In addition, the blood flow surface obtained from the segmentation mask using marching cubes is too coarse and requires smoothing. To provide one-stage surface extraction, Voxel2Mesh [2] was the first to be proposed. Voxel2Mesh shows good performance in extracting relatively simple geometries, while for more complex ones, its modifications have been proposed in the literature [3, 4]. \nAIM: The study aimed to develop an algorithm for single-stage extraction of the lumen surface of an abdominal aortic aneurysm. \nMATERIALS AND METHODS: A total of 90 contrast-enhanced CT images and segmentation masks with blood flow region labeling were prepared and divided into three groups: 40, 20, and 30 images for training, validation, and testing, respectively. Affine and non-linear augmentations were applied to increase the effective training sample size. A hybrid neural network consisting of a voxel encoder, a voxel decoder, and a grid decoder was proposed for single-stage surface extraction. The architectural design of the encoder is based on the Atto-sized ConvNeXtV2 architecture. The voxel decoder is comprised of five blocks, beginning with an interpolation layer and concluding with two super-precision words with packet normalization layers and ReLU. The voxel decoder and encoder are linked by means of analogous connections to those observed in the Unet architecture. The grid decoder comprises four GraphSAGE convolutions, with GeLU intervening between each pair. It is connected to the voxel decoder. The input to the encoder is a computed tomography image, while the input to the grid decoder is an initial approximation of the surface in the form of a ball. The output of the voxel decorrelation is a segmentation mask, while the output of the mesh decorrelation is the extracted surface. A combination of voxel and mesh loss functions was employed for the purposes of training. The surface generated from the segmentation mask by the Marching Cubes algorithm was employed as the reference surface. The mesh loss function was regularized to set the necessary parameters for the generated mesh. The quality of the generated mesh was evaluated using the Dice coefficient, which compares the true segmentation mask with the rasterized generated surface. \nRESULTS: We proposed the first hybrid neural network with an encoder based on the state-of-the-art ConvNeXtV2 architecture for the direct generation of abdominal aortic aneurysm blood flow meshes. A 14.01% improvement in generation was achieved by the Dice metric, with a score of 85.32%, in comparison to Voxel2Mesh. The results demonstrate the potential for accurate lumen geometry generation, with metrics approaching those of the segmentation task. This eliminates the necessity for post-processing steps typically required for the latter. \nCONCLUSION: Shows promising results for accurately generating lumen geometry with performance similar to the segmentation task, eliminating the need for post-processing steps required for the latter.","PeriodicalId":34831,"journal":{"name":"Digital Diagnostics","volume":"143 3","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"One shot lumen mesh generation of abdominal aortic aneurysm by hybrid neural network\",\"authors\":\"R. Epifanov, R. Mullyadzhanov, Andrey A. Karpenko\",\"doi\":\"10.17816/dd626155\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"BACKGROUND: The majority of current algorithms for blood flow surface extraction in the context of hemomodeling of abdominal aortic aneurysms are derived through a segmentation step, rather than directly from CT scans [1]. This approach introduces a degree of complexity, as the segmentation neural network is trained without consideration of the fact that the blood flow is a simply-connected region. Consequently, post-processing may be required to fulfill the simple connectivity criterion. In addition, the blood flow surface obtained from the segmentation mask using marching cubes is too coarse and requires smoothing. To provide one-stage surface extraction, Voxel2Mesh [2] was the first to be proposed. Voxel2Mesh shows good performance in extracting relatively simple geometries, while for more complex ones, its modifications have been proposed in the literature [3, 4]. \\nAIM: The study aimed to develop an algorithm for single-stage extraction of the lumen surface of an abdominal aortic aneurysm. \\nMATERIALS AND METHODS: A total of 90 contrast-enhanced CT images and segmentation masks with blood flow region labeling were prepared and divided into three groups: 40, 20, and 30 images for training, validation, and testing, respectively. Affine and non-linear augmentations were applied to increase the effective training sample size. A hybrid neural network consisting of a voxel encoder, a voxel decoder, and a grid decoder was proposed for single-stage surface extraction. The architectural design of the encoder is based on the Atto-sized ConvNeXtV2 architecture. The voxel decoder is comprised of five blocks, beginning with an interpolation layer and concluding with two super-precision words with packet normalization layers and ReLU. The voxel decoder and encoder are linked by means of analogous connections to those observed in the Unet architecture. The grid decoder comprises four GraphSAGE convolutions, with GeLU intervening between each pair. It is connected to the voxel decoder. The input to the encoder is a computed tomography image, while the input to the grid decoder is an initial approximation of the surface in the form of a ball. The output of the voxel decorrelation is a segmentation mask, while the output of the mesh decorrelation is the extracted surface. A combination of voxel and mesh loss functions was employed for the purposes of training. The surface generated from the segmentation mask by the Marching Cubes algorithm was employed as the reference surface. The mesh loss function was regularized to set the necessary parameters for the generated mesh. The quality of the generated mesh was evaluated using the Dice coefficient, which compares the true segmentation mask with the rasterized generated surface. \\nRESULTS: We proposed the first hybrid neural network with an encoder based on the state-of-the-art ConvNeXtV2 architecture for the direct generation of abdominal aortic aneurysm blood flow meshes. A 14.01% improvement in generation was achieved by the Dice metric, with a score of 85.32%, in comparison to Voxel2Mesh. The results demonstrate the potential for accurate lumen geometry generation, with metrics approaching those of the segmentation task. This eliminates the necessity for post-processing steps typically required for the latter. \\nCONCLUSION: Shows promising results for accurately generating lumen geometry with performance similar to the segmentation task, eliminating the need for post-processing steps required for the latter.\",\"PeriodicalId\":34831,\"journal\":{\"name\":\"Digital Diagnostics\",\"volume\":\"143 3\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Diagnostics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.17816/dd626155\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Diagnostics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.17816/dd626155","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

背景:目前大多数用于腹主动脉瘤血液模型的血流表面提取算法都是通过分割步骤而不是直接从 CT 扫描中提取的[1]。这种方法带来了一定程度的复杂性,因为在训练分割神经网络时没有考虑到血流是一个简单连接的区域。因此,可能需要进行后处理以满足简单连接标准。此外,使用行进立方体从分割掩膜中获得的血流表面过于粗糙,需要进行平滑处理。为了提供单阶段表面提取,Voxel2Mesh [2] 最先被提出。Voxel2Mesh 在提取相对简单的几何图形时显示出良好的性能,而对于更复杂的几何图形,文献[3, 4]中提出了对其进行修改的方法。目的:本研究旨在开发一种单阶段提取腹主动脉瘤腔面的算法。材料与方法:共准备了 90 张对比增强 CT 图像和带有血流区域标记的分割掩膜,并分为三组:40、20 和 30 张图像,分别用于训练、验证和测试。为了增加有效的训练样本数量,采用了仿射和非线性增强技术。针对单级曲面提取,提出了一种由体素编码器、体素解码器和网格解码器组成的混合神经网络。编码器的架构设计基于 Atto-sized ConvNeXtV2 架构。体素解码器由五个区块组成,从插值层开始,最后是两个带有数据包归一化层和 ReLU 的超精密字。体素解码器和编码器通过与 Unet 架构类似的连接方式相连接。网格解码器包括四个 GraphSAGE 卷积,每对卷积之间有 GeLU。它与体素解码器相连。编码器的输入是计算机断层扫描图像,而网格解码器的输入是一个球形表面的初始近似值。体素去相关的输出是分割掩码,而网格去相关的输出是提取的表面。为了训练的目的,采用了体素和网格损失函数的组合。采用行进立方体算法从分割掩码生成的曲面作为参考曲面。对网格损失函数进行正则化处理,为生成的网格设置必要的参数。生成网格的质量使用 Dice 系数进行评估,该系数将真实的分割掩膜与光栅化生成的表面进行比较。结果:我们首次提出了基于最先进的 ConvNeXtV2 架构编码器的混合神经网络,用于直接生成腹主动脉瘤血流网格。与 Voxel2Mesh 相比,Dice 指标的生成率提高了 14.01%,得分率达到 85.32%。这些结果表明了精确生成管腔几何图形的潜力,其指标接近分割任务的指标。这消除了后处理步骤的必要性,而后处理步骤通常是必需的。结论:显示了精确生成腔体几何图形的良好效果,其性能与分割任务相似,省去了后者所需的后处理步骤。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
One shot lumen mesh generation of abdominal aortic aneurysm by hybrid neural network
BACKGROUND: The majority of current algorithms for blood flow surface extraction in the context of hemomodeling of abdominal aortic aneurysms are derived through a segmentation step, rather than directly from CT scans [1]. This approach introduces a degree of complexity, as the segmentation neural network is trained without consideration of the fact that the blood flow is a simply-connected region. Consequently, post-processing may be required to fulfill the simple connectivity criterion. In addition, the blood flow surface obtained from the segmentation mask using marching cubes is too coarse and requires smoothing. To provide one-stage surface extraction, Voxel2Mesh [2] was the first to be proposed. Voxel2Mesh shows good performance in extracting relatively simple geometries, while for more complex ones, its modifications have been proposed in the literature [3, 4]. AIM: The study aimed to develop an algorithm for single-stage extraction of the lumen surface of an abdominal aortic aneurysm. MATERIALS AND METHODS: A total of 90 contrast-enhanced CT images and segmentation masks with blood flow region labeling were prepared and divided into three groups: 40, 20, and 30 images for training, validation, and testing, respectively. Affine and non-linear augmentations were applied to increase the effective training sample size. A hybrid neural network consisting of a voxel encoder, a voxel decoder, and a grid decoder was proposed for single-stage surface extraction. The architectural design of the encoder is based on the Atto-sized ConvNeXtV2 architecture. The voxel decoder is comprised of five blocks, beginning with an interpolation layer and concluding with two super-precision words with packet normalization layers and ReLU. The voxel decoder and encoder are linked by means of analogous connections to those observed in the Unet architecture. The grid decoder comprises four GraphSAGE convolutions, with GeLU intervening between each pair. It is connected to the voxel decoder. The input to the encoder is a computed tomography image, while the input to the grid decoder is an initial approximation of the surface in the form of a ball. The output of the voxel decorrelation is a segmentation mask, while the output of the mesh decorrelation is the extracted surface. A combination of voxel and mesh loss functions was employed for the purposes of training. The surface generated from the segmentation mask by the Marching Cubes algorithm was employed as the reference surface. The mesh loss function was regularized to set the necessary parameters for the generated mesh. The quality of the generated mesh was evaluated using the Dice coefficient, which compares the true segmentation mask with the rasterized generated surface. RESULTS: We proposed the first hybrid neural network with an encoder based on the state-of-the-art ConvNeXtV2 architecture for the direct generation of abdominal aortic aneurysm blood flow meshes. A 14.01% improvement in generation was achieved by the Dice metric, with a score of 85.32%, in comparison to Voxel2Mesh. The results demonstrate the potential for accurate lumen geometry generation, with metrics approaching those of the segmentation task. This eliminates the necessity for post-processing steps typically required for the latter. CONCLUSION: Shows promising results for accurately generating lumen geometry with performance similar to the segmentation task, eliminating the need for post-processing steps required for the latter.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
1.30
自引率
0.00%
发文量
44
审稿时长
5 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信