基于深度可分卷积神经网络的智能电网监控视频去模糊重建

Songlin Zuo, Ming Wang, Y. Ni, Weijun Ren
{"title":"基于深度可分卷积神经网络的智能电网监控视频去模糊重建","authors":"Songlin Zuo, Ming Wang, Y. Ni, Weijun Ren","doi":"10.1109/ICSP54964.2022.9778689","DOIUrl":null,"url":null,"abstract":"To improve the definition of monitoring video in smart grid, a de-blurring reconstruction model of monitoring video in smart grid based on depth-wise separable convolutional neural network is proposed. Firstly, a multi-scale feature extraction convolutional neural network is used to extract rich feature information of the input video frames. Secondly, all support frames are aligned to the target frame from the two ends of the input video sequence in chronological order, and a time and space self-attention mechanism is used to fuse the support frame features to the target frame. Thirdly, an improved depth-wise separable residual network and pixel shuffle up-sampling network are constructed to perform high-definition reconstruction of the target frame after feature fusion. Finally, the model is trained with public datasets and video datasets of smart grid and is applied to the video de-blurring reconstruction of monitoring system of smart grid. The test results indicate that the proposed model can effectively improve the definition and visual effects of monitoring video, whose average values of the peak signal-to-noise ratio and structural similarity index reach 32.18dB and 0.9132 respectively.","PeriodicalId":363766,"journal":{"name":"2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP)","volume":"1 2","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deblurring Reconstruction of Monitoring Video in Smart Grid Based on Depth-wise Separable Convolutional Neural Network\",\"authors\":\"Songlin Zuo, Ming Wang, Y. Ni, Weijun Ren\",\"doi\":\"10.1109/ICSP54964.2022.9778689\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"To improve the definition of monitoring video in smart grid, a de-blurring reconstruction model of monitoring video in smart grid based on depth-wise separable convolutional neural network is proposed. Firstly, a multi-scale feature extraction convolutional neural network is used to extract rich feature information of the input video frames. Secondly, all support frames are aligned to the target frame from the two ends of the input video sequence in chronological order, and a time and space self-attention mechanism is used to fuse the support frame features to the target frame. Thirdly, an improved depth-wise separable residual network and pixel shuffle up-sampling network are constructed to perform high-definition reconstruction of the target frame after feature fusion. Finally, the model is trained with public datasets and video datasets of smart grid and is applied to the video de-blurring reconstruction of monitoring system of smart grid. The test results indicate that the proposed model can effectively improve the definition and visual effects of monitoring video, whose average values of the peak signal-to-noise ratio and structural similarity index reach 32.18dB and 0.9132 respectively.\",\"PeriodicalId\":363766,\"journal\":{\"name\":\"2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP)\",\"volume\":\"1 2\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-04-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSP54964.2022.9778689\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSP54964.2022.9778689","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为了提高智能电网监控视频的清晰度,提出了一种基于深度可分离卷积神经网络的智能电网监控视频去模糊重建模型。首先,利用多尺度特征提取卷积神经网络提取输入视频帧的丰富特征信息;其次,从输入视频序列的两端按时间顺序将所有支撑帧与目标帧对齐,并利用时空自关注机制将支撑帧特征与目标帧融合。第三,构建改进的深度可分残差网络和像素shuffle上采样网络,对特征融合后的目标帧进行高清重建。最后,利用智能电网的公共数据集和视频数据集对该模型进行训练,并将其应用于智能电网监控系统的视频去模糊重建。测试结果表明,该模型能有效提高监控视频的清晰度和视觉效果,峰值信噪比和结构相似指数的平均值分别达到32.18dB和0.9132。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deblurring Reconstruction of Monitoring Video in Smart Grid Based on Depth-wise Separable Convolutional Neural Network
To improve the definition of monitoring video in smart grid, a de-blurring reconstruction model of monitoring video in smart grid based on depth-wise separable convolutional neural network is proposed. Firstly, a multi-scale feature extraction convolutional neural network is used to extract rich feature information of the input video frames. Secondly, all support frames are aligned to the target frame from the two ends of the input video sequence in chronological order, and a time and space self-attention mechanism is used to fuse the support frame features to the target frame. Thirdly, an improved depth-wise separable residual network and pixel shuffle up-sampling network are constructed to perform high-definition reconstruction of the target frame after feature fusion. Finally, the model is trained with public datasets and video datasets of smart grid and is applied to the video de-blurring reconstruction of monitoring system of smart grid. The test results indicate that the proposed model can effectively improve the definition and visual effects of monitoring video, whose average values of the peak signal-to-noise ratio and structural similarity index reach 32.18dB and 0.9132 respectively.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信