基于深度多尺度特征融合的监控图像可见性增强

Mohit Singh, V. Laxmi, Parvez Faruki
{"title":"基于深度多尺度特征融合的监控图像可见性增强","authors":"Mohit Singh, V. Laxmi, Parvez Faruki","doi":"10.1109/ISEA-ISAP54304.2021.9689709","DOIUrl":null,"url":null,"abstract":"Visibility degradation is expected in adverse weather phenomena such as fog, mist, and haze. Object detection and identification in the surveillance feed are challenging in these weather conditions. Outdoor images can naturally be degraded, or one can intentionally degrade using smoke or bright light to hide identification. Haze, fog, and smoke are pixel-based degradation and can vary based on their thickness and distribution property in an image. In our proposed work, we explore the possibility of identifying and removal hazy pixels using the benefits of multi-scale feature-fusion and In-scale feature progression. We proposed a learning-based end-to-end network for single image dehazing. Our proposed architecture consists of three different modules: (1) Coarse Feature-fusion, (2) Fine Feature-fusion, and (3) Reconstruction module. The Coarse feature-fusion module learns broad contextual information, and the Fine feature-fusion module refines the coarse features by focusing on the channel and pixel-based information. Multi-scale feature fusion is used both in the coarse and fine module to benefit the network stage from the previous stage’s output. Extensive experimental results suggest that the proposed approach outperforms other state-of-the-art methods on synthetic homogeneous and non-homogeneous haze data and improves object detection and identification accuracy.","PeriodicalId":115117,"journal":{"name":"2021 4th International Conference on Security and Privacy (ISEA-ISAP)","volume":"80 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Visibility Enhancement in Surveillance images using Deep Multi-scale Feature Fusion\",\"authors\":\"Mohit Singh, V. Laxmi, Parvez Faruki\",\"doi\":\"10.1109/ISEA-ISAP54304.2021.9689709\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Visibility degradation is expected in adverse weather phenomena such as fog, mist, and haze. Object detection and identification in the surveillance feed are challenging in these weather conditions. Outdoor images can naturally be degraded, or one can intentionally degrade using smoke or bright light to hide identification. Haze, fog, and smoke are pixel-based degradation and can vary based on their thickness and distribution property in an image. In our proposed work, we explore the possibility of identifying and removal hazy pixels using the benefits of multi-scale feature-fusion and In-scale feature progression. We proposed a learning-based end-to-end network for single image dehazing. Our proposed architecture consists of three different modules: (1) Coarse Feature-fusion, (2) Fine Feature-fusion, and (3) Reconstruction module. The Coarse feature-fusion module learns broad contextual information, and the Fine feature-fusion module refines the coarse features by focusing on the channel and pixel-based information. Multi-scale feature fusion is used both in the coarse and fine module to benefit the network stage from the previous stage’s output. Extensive experimental results suggest that the proposed approach outperforms other state-of-the-art methods on synthetic homogeneous and non-homogeneous haze data and improves object detection and identification accuracy.\",\"PeriodicalId\":115117,\"journal\":{\"name\":\"2021 4th International Conference on Security and Privacy (ISEA-ISAP)\",\"volume\":\"80 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 4th International Conference on Security and Privacy (ISEA-ISAP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISEA-ISAP54304.2021.9689709\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 4th International Conference on Security and Privacy (ISEA-ISAP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISEA-ISAP54304.2021.9689709","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在雾、薄雾和雾霾等恶劣天气现象下,能见度会下降。在这种天气条件下,监控馈送中的目标检测和识别具有挑战性。户外图像可以自然地降级,或者可以故意使用烟雾或强光来隐藏身份。霾、雾和烟是基于像素的退化,可以根据它们在图像中的厚度和分布属性而变化。在我们提出的工作中,我们探索了利用多尺度特征融合和尺度内特征递进的优势来识别和去除模糊像素的可能性。我们提出了一种基于学习的端到端单幅图像去雾网络。我们提出的架构包括三个不同的模块:(1)粗特征融合,(2)细特征融合和(3)重构模块。粗特征融合模块学习广泛的上下文信息,细特征融合模块通过关注通道和基于像素的信息来细化粗特征。在粗、精两个模块中都使用了多尺度特征融合,使网络阶段从前一阶段的输出中受益。大量的实验结果表明,该方法在合成均匀和非均匀雾霾数据上优于其他最先进的方法,并提高了目标检测和识别精度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Visibility Enhancement in Surveillance images using Deep Multi-scale Feature Fusion
Visibility degradation is expected in adverse weather phenomena such as fog, mist, and haze. Object detection and identification in the surveillance feed are challenging in these weather conditions. Outdoor images can naturally be degraded, or one can intentionally degrade using smoke or bright light to hide identification. Haze, fog, and smoke are pixel-based degradation and can vary based on their thickness and distribution property in an image. In our proposed work, we explore the possibility of identifying and removal hazy pixels using the benefits of multi-scale feature-fusion and In-scale feature progression. We proposed a learning-based end-to-end network for single image dehazing. Our proposed architecture consists of three different modules: (1) Coarse Feature-fusion, (2) Fine Feature-fusion, and (3) Reconstruction module. The Coarse feature-fusion module learns broad contextual information, and the Fine feature-fusion module refines the coarse features by focusing on the channel and pixel-based information. Multi-scale feature fusion is used both in the coarse and fine module to benefit the network stage from the previous stage’s output. Extensive experimental results suggest that the proposed approach outperforms other state-of-the-art methods on synthetic homogeneous and non-homogeneous haze data and improves object detection and identification accuracy.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信