基于生成模型的红外时敏目标数据增强算法

Siyu Wang, Xiaogang Yang, Ruitao Lu, Qing-ge Li, Jiwei Fan, Zheng-jie Zhu
{"title":"基于生成模型的红外时敏目标数据增强算法","authors":"Siyu Wang, Xiaogang Yang, Ruitao Lu, Qing-ge Li, Jiwei Fan, Zheng-jie Zhu","doi":"10.1117/12.3000067","DOIUrl":null,"url":null,"abstract":"Currently, infrared time-sensitive target detection technology is widely used in military and civil applications such as air defense and early warning, maritime surveillance, and precision guidance, but some high-value target images are difficult and expensive to acquire. To address the problems such as the lack of infrared time-sensitive target image data and the lack of multi-scene multi-target data for training, this paper proposes an infrared time-sensitive target data enhancement algorithm based on a generative model, which is a two-stage model. Firstly, in the first stage, the visible images containing time-sensitive targets are converted to infrared images by a modal conversion model based on CUT networks. Then in the second stage a large number of random targets are generated from the converted IR images using an adversarial random sample generation model to achieve the data enhancement effect. The coordinate attention mechanism is also introduced into the generator module in the second stage, which effectively enhances the feature extraction capability of the network. Finally, modal conversion experiments and sample random generation experiments are conducted, and the results show the feasibility of the data enhancement method of generative model proposed in this paper in IR time-sensitive target data enhancement, which provides a strong data support for improving IR time-sensitive target detection algorithm.","PeriodicalId":298662,"journal":{"name":"Applied Optics and Photonics China","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Infrared time-sensitive target data augmentation algorithm based on generative model\",\"authors\":\"Siyu Wang, Xiaogang Yang, Ruitao Lu, Qing-ge Li, Jiwei Fan, Zheng-jie Zhu\",\"doi\":\"10.1117/12.3000067\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Currently, infrared time-sensitive target detection technology is widely used in military and civil applications such as air defense and early warning, maritime surveillance, and precision guidance, but some high-value target images are difficult and expensive to acquire. To address the problems such as the lack of infrared time-sensitive target image data and the lack of multi-scene multi-target data for training, this paper proposes an infrared time-sensitive target data enhancement algorithm based on a generative model, which is a two-stage model. Firstly, in the first stage, the visible images containing time-sensitive targets are converted to infrared images by a modal conversion model based on CUT networks. Then in the second stage a large number of random targets are generated from the converted IR images using an adversarial random sample generation model to achieve the data enhancement effect. The coordinate attention mechanism is also introduced into the generator module in the second stage, which effectively enhances the feature extraction capability of the network. Finally, modal conversion experiments and sample random generation experiments are conducted, and the results show the feasibility of the data enhancement method of generative model proposed in this paper in IR time-sensitive target data enhancement, which provides a strong data support for improving IR time-sensitive target detection algorithm.\",\"PeriodicalId\":298662,\"journal\":{\"name\":\"Applied Optics and Photonics China\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-12-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Optics and Photonics China\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.3000067\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Optics and Photonics China","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.3000067","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

目前,红外时敏目标探测技术已广泛应用于防空预警、海上监视、精确制导等军事和民用领域,但一些高价值目标图像获取难度大、成本高。针对红外时敏目标图像数据匮乏、缺乏多场景多目标数据训练等问题,本文提出了一种基于生成模型的红外时敏目标数据增强算法,该算法分为两个阶段。首先,在第一阶段,通过基于 CUT 网络的模态转换模型,将包含时间敏感目标的可见光图像转换为红外图像。然后在第二阶段,利用对抗随机样本生成模型从转换后的红外图像中生成大量随机目标,以达到数据增强效果。在第二阶段的生成模块中还引入了坐标注意机制,有效增强了网络的特征提取能力。最后,进行了模态转换实验和样本随机生成实验,结果表明本文提出的生成模型数据增强方法在红外时敏目标数据增强中的可行性,为改进红外时敏目标检测算法提供了有力的数据支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Infrared time-sensitive target data augmentation algorithm based on generative model
Currently, infrared time-sensitive target detection technology is widely used in military and civil applications such as air defense and early warning, maritime surveillance, and precision guidance, but some high-value target images are difficult and expensive to acquire. To address the problems such as the lack of infrared time-sensitive target image data and the lack of multi-scene multi-target data for training, this paper proposes an infrared time-sensitive target data enhancement algorithm based on a generative model, which is a two-stage model. Firstly, in the first stage, the visible images containing time-sensitive targets are converted to infrared images by a modal conversion model based on CUT networks. Then in the second stage a large number of random targets are generated from the converted IR images using an adversarial random sample generation model to achieve the data enhancement effect. The coordinate attention mechanism is also introduced into the generator module in the second stage, which effectively enhances the feature extraction capability of the network. Finally, modal conversion experiments and sample random generation experiments are conducted, and the results show the feasibility of the data enhancement method of generative model proposed in this paper in IR time-sensitive target data enhancement, which provides a strong data support for improving IR time-sensitive target detection algorithm.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信