Simulation and Evaluation of GAN-based Implementation of Infrared Texture Generation

Q4 Engineering
Yunyun Wu, Han Liu, Xia Kong, Min Deng, Youfeng Li
{"title":"Simulation and Evaluation of GAN-based Implementation of Infrared Texture Generation","authors":"Yunyun Wu, Han Liu, Xia Kong, Min Deng, Youfeng Li","doi":"10.25103/jestr.171.16","DOIUrl":null,"url":null,"abstract":"At present, the demand for the simulation technology of infrared view is markedly expanding. However, the related main research orientations are influenced by numerous factors. Thus, the availability of infrared images for special scenes is difficult to determine, and their practical applications are limited. This study proposed a method based on generative adversarial network (GAN) to reveal its influence on the generation of infrared texture and produce infrared texture in infrared view simulation. By combining the needs of texture generation in infrared simulation and the superiority of image style transfer in texture generation, three algorithms for style transfer based on GAN, namely, Algorithms I, II, and III, were introduced to establish pretrained models. Simulation results of the three models were then evaluated using histograms, structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), and the effects of colors of the infrared images in the texture generation were compared. The validity of these models was also verified. Results demonstrate that infrared images in a specified scene can be simulated without the need for a large number of training datasets, and the simulation images generated by transferring in black-and-white infrared style images are better than those in color infrared style images. The histogram evaluation index shows that Algorithm III is higher than Algorithms I and II by approximately 0.06. The SSIM evaluation index reveals that Algorithm II is higher than Algorithms I and II by 0.09 and 0.06 dB, respectively. The PSNR evaluation index indicates that Algorithm III is higher than Algorithms I and II by approximately 0.31 dB. Thus, this study provides a practical value in the field of infrared simulation technology.","PeriodicalId":15707,"journal":{"name":"Journal of Engineering Science and Technology Review","volume":"39 11","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Engineering Science and Technology Review","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.25103/jestr.171.16","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0

Abstract

At present, the demand for the simulation technology of infrared view is markedly expanding. However, the related main research orientations are influenced by numerous factors. Thus, the availability of infrared images for special scenes is difficult to determine, and their practical applications are limited. This study proposed a method based on generative adversarial network (GAN) to reveal its influence on the generation of infrared texture and produce infrared texture in infrared view simulation. By combining the needs of texture generation in infrared simulation and the superiority of image style transfer in texture generation, three algorithms for style transfer based on GAN, namely, Algorithms I, II, and III, were introduced to establish pretrained models. Simulation results of the three models were then evaluated using histograms, structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), and the effects of colors of the infrared images in the texture generation were compared. The validity of these models was also verified. Results demonstrate that infrared images in a specified scene can be simulated without the need for a large number of training datasets, and the simulation images generated by transferring in black-and-white infrared style images are better than those in color infrared style images. The histogram evaluation index shows that Algorithm III is higher than Algorithms I and II by approximately 0.06. The SSIM evaluation index reveals that Algorithm II is higher than Algorithms I and II by 0.09 and 0.06 dB, respectively. The PSNR evaluation index indicates that Algorithm III is higher than Algorithms I and II by approximately 0.31 dB. Thus, this study provides a practical value in the field of infrared simulation technology.
基于 GAN 的红外纹理生成仿真与评估
目前,对红外视景仿真技术的需求明显扩大。然而,相关的主要研究方向受到诸多因素的影响。因此,特殊场景红外图像的可用性难以确定,其实际应用也受到限制。本研究提出了一种基于生成对抗网络(GAN)的方法,揭示其对红外纹理生成的影响,并在红外视景模拟中生成红外纹理。结合红外仿真中纹理生成的需求和图像风格转移在纹理生成中的优越性,引入了三种基于 GAN 的风格转移算法,即算法 I、算法 II 和算法 III,建立了预训练模型。然后使用直方图、结构相似度(SSIM)和峰值信噪比(PSNR)评估了三种模型的仿真结果,并比较了红外图像的颜色对纹理生成的影响。这些模型的有效性也得到了验证。结果表明,无需大量的训练数据集就能模拟指定场景中的红外图像,而且在黑白红外风格图像中传输生成的模拟图像比在彩色红外风格图像中传输生成的模拟图像更好。直方图评价指标显示,算法 III 比算法 I 和算法 II 高约 0.06。SSIM 评估指数显示,算法 II 分别比算法 I 和 II 高 0.09 和 0.06 dB。PSNR 评估指数表明,算法 III 比算法 I 和 II 高约 0.31 dB。因此,本研究在红外模拟技术领域具有实用价值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
1.00
自引率
0.00%
发文量
66
审稿时长
24 weeks
期刊介绍: The Journal of Engineering Science and Technology Review (JESTR) is a peer reviewed international journal publishing high quality articles dediicated to all aspects of engineering. The Journal considers only manuscripts that have not been published (or submitted simultaneously), at any language, elsewhere. Contributions are in English. The Journal is published by the Eastern Macedonia and Thrace Institute of Technology (EMaTTech), located in Kavala, Greece. All articles published in JESTR are licensed under a CC BY-NC license. Copyright is by the publisher and the authors.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信