Peng Chi , Jianmeng Sun , Ran Zhang , Weichao Yan , Likai Cui
{"title":"基于 GAN 的新型 2D-3D 图像融合框架增强了数字岩石重建功能","authors":"Peng Chi , Jianmeng Sun , Ran Zhang , Weichao Yan , Likai Cui","doi":"10.1016/j.advwatres.2024.104813","DOIUrl":null,"url":null,"abstract":"<div><p>Digital rock analysis has become increasingly crucial in earth sciences and geological engineering. However, the multiscale characteristics of rock pores often exceed the capabilities of single-resolution imaging, which is inadequate for a comprehensive description of their characteristics. To address this issue, we introduce a novel multiscale rock image fusion framework based on a generative adversarial network (GAN). This method employs a 3D super-resolution convolutional neural network-based generator and a 2D discriminator to integrate low-resolution 3D images with high-resolution 2D images. Compared to existing methods, our approach directly generates high-resolution 3D data, which offers better continuity. Once trained, the generator can upscale low-resolution inputs to produce corresponding high-resolution outputs, thus completing the feature fusion of images with different resolutions. Experiments were conducted using two distinct datasets, encompassing both pore structure analysis and permeability simulation. The results indicate that the fused and reconstructed digital rocks closely resemble genuine digital rocks in terms of pore structure and flow properties. We have also expanded its application and achieved the fusion of 3D CT images with 2D SEM images. Furthermore, as the impact of low-resolution data decreases with increasing resolution difference. Therefore, it is recommended to select an appropriate scaling factor for effective fusion.</p></div>","PeriodicalId":7614,"journal":{"name":"Advances in Water Resources","volume":"193 ","pages":"Article 104813"},"PeriodicalIF":4.0000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Digital rock reconstruction enhanced by a novel GAN-based 2D-3D image fusion framework\",\"authors\":\"Peng Chi , Jianmeng Sun , Ran Zhang , Weichao Yan , Likai Cui\",\"doi\":\"10.1016/j.advwatres.2024.104813\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Digital rock analysis has become increasingly crucial in earth sciences and geological engineering. However, the multiscale characteristics of rock pores often exceed the capabilities of single-resolution imaging, which is inadequate for a comprehensive description of their characteristics. To address this issue, we introduce a novel multiscale rock image fusion framework based on a generative adversarial network (GAN). This method employs a 3D super-resolution convolutional neural network-based generator and a 2D discriminator to integrate low-resolution 3D images with high-resolution 2D images. Compared to existing methods, our approach directly generates high-resolution 3D data, which offers better continuity. Once trained, the generator can upscale low-resolution inputs to produce corresponding high-resolution outputs, thus completing the feature fusion of images with different resolutions. Experiments were conducted using two distinct datasets, encompassing both pore structure analysis and permeability simulation. The results indicate that the fused and reconstructed digital rocks closely resemble genuine digital rocks in terms of pore structure and flow properties. We have also expanded its application and achieved the fusion of 3D CT images with 2D SEM images. Furthermore, as the impact of low-resolution data decreases with increasing resolution difference. Therefore, it is recommended to select an appropriate scaling factor for effective fusion.</p></div>\",\"PeriodicalId\":7614,\"journal\":{\"name\":\"Advances in Water Resources\",\"volume\":\"193 \",\"pages\":\"Article 104813\"},\"PeriodicalIF\":4.0000,\"publicationDate\":\"2024-09-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advances in Water Resources\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0309170824002008\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"WATER RESOURCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Water Resources","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0309170824002008","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"WATER RESOURCES","Score":null,"Total":0}
Digital rock reconstruction enhanced by a novel GAN-based 2D-3D image fusion framework
Digital rock analysis has become increasingly crucial in earth sciences and geological engineering. However, the multiscale characteristics of rock pores often exceed the capabilities of single-resolution imaging, which is inadequate for a comprehensive description of their characteristics. To address this issue, we introduce a novel multiscale rock image fusion framework based on a generative adversarial network (GAN). This method employs a 3D super-resolution convolutional neural network-based generator and a 2D discriminator to integrate low-resolution 3D images with high-resolution 2D images. Compared to existing methods, our approach directly generates high-resolution 3D data, which offers better continuity. Once trained, the generator can upscale low-resolution inputs to produce corresponding high-resolution outputs, thus completing the feature fusion of images with different resolutions. Experiments were conducted using two distinct datasets, encompassing both pore structure analysis and permeability simulation. The results indicate that the fused and reconstructed digital rocks closely resemble genuine digital rocks in terms of pore structure and flow properties. We have also expanded its application and achieved the fusion of 3D CT images with 2D SEM images. Furthermore, as the impact of low-resolution data decreases with increasing resolution difference. Therefore, it is recommended to select an appropriate scaling factor for effective fusion.
期刊介绍:
Advances in Water Resources provides a forum for the presentation of fundamental scientific advances in the understanding of water resources systems. The scope of Advances in Water Resources includes any combination of theoretical, computational, and experimental approaches used to advance fundamental understanding of surface or subsurface water resources systems or the interaction of these systems with the atmosphere, geosphere, biosphere, and human societies. Manuscripts involving case studies that do not attempt to reach broader conclusions, research on engineering design, applied hydraulics, or water quality and treatment, as well as applications of existing knowledge that do not advance fundamental understanding of hydrological processes, are not appropriate for Advances in Water Resources.
Examples of appropriate topical areas that will be considered include the following:
• Surface and subsurface hydrology
• Hydrometeorology
• Environmental fluid dynamics
• Ecohydrology and ecohydrodynamics
• Multiphase transport phenomena in porous media
• Fluid flow and species transport and reaction processes