Deep Attention-Multistage GAN with Sparse Dense Fusion R-CNN for High-Resolution and Object Detection in Surveillance System

IF 0.9 Q4 OPTICS
Anu Yadav,  Ela Kumar
{"title":"Deep Attention-Multistage GAN with Sparse Dense Fusion R-CNN for High-Resolution and Object Detection in Surveillance System","authors":"Anu Yadav,&nbsp; Ela Kumar","doi":"10.3103/S1060992X2560003X","DOIUrl":null,"url":null,"abstract":"<p>Video surveillance utilization has developed significantly in sectors such as traffic monitoring, private institution protection, and landmark protection. Identifying an object in a captured surveillance image is difficult because of the poor excellence of the images. The quality of Low-Resolution (LR) images can be enhanced using an image Super-Resolution (SR) reconstruction method. Sophisticated Deep learning methods have been utilized in order to attain state-of-the-art performance in SR. Nevertheless, these techniques are typically prone to losing essential information and perform poorly on complex computations. To overcome these challenges, this research develop a deep Attention-Multistage Generative Adversarial Network (DA-MGAN) for image super-resolution and integrate SDR (Sparse Dense fusion R-CNN) with Non-Maximum Suppression (NMS) to enhance object detection accuracy in surveillance images. DA-MGAN is used to generate high-resolution surveillance images by utilizing attention mechanisms for improved feature extraction and integrating a multistage GAN that progressively enhances the image quality at each stage. After image resolution, Sparse Dense Fusion R-CNN (SDR) is used for object detection in super-resolved images to improve feature extraction through Sparse Dense Fusion. The R-CNN leverages these enhanced features to accurately detect and segment objects at the pixel level. Subsequently, Non-Maximum Suppression (NMS) was applied to improve localization by eliminating overlapping bounding boxes and minimizing false positives. This integrated method boosts overall detection precision and reliability in real time surveillance scenarios. The proposed model achieves a Super Resolution Error Rate (SRER) of 0.19%, a Bit Error Rate (BER) of 0.125%, a Packet Error Rate (PER) of 0.0990%, and a Deep End-to-End Image Metric (DEEIM) of 0.04963%, showcasing its superior performance. In contrast with existing methodologies, these results highlight the effectiveness of the suggested approach in reducing error rates and enhancing image quality metrics. As a result, these methods are ideally suited for real-time applications, particularly in high-resolution scenarios and object detection within surveillance systems.</p>","PeriodicalId":721,"journal":{"name":"Optical Memory and Neural Networks","volume":"34 4","pages":"566 - 580"},"PeriodicalIF":0.9000,"publicationDate":"2025-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optical Memory and Neural Networks","FirstCategoryId":"1085","ListUrlMain":"https://link.springer.com/article/10.3103/S1060992X2560003X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Video surveillance utilization has developed significantly in sectors such as traffic monitoring, private institution protection, and landmark protection. Identifying an object in a captured surveillance image is difficult because of the poor excellence of the images. The quality of Low-Resolution (LR) images can be enhanced using an image Super-Resolution (SR) reconstruction method. Sophisticated Deep learning methods have been utilized in order to attain state-of-the-art performance in SR. Nevertheless, these techniques are typically prone to losing essential information and perform poorly on complex computations. To overcome these challenges, this research develop a deep Attention-Multistage Generative Adversarial Network (DA-MGAN) for image super-resolution and integrate SDR (Sparse Dense fusion R-CNN) with Non-Maximum Suppression (NMS) to enhance object detection accuracy in surveillance images. DA-MGAN is used to generate high-resolution surveillance images by utilizing attention mechanisms for improved feature extraction and integrating a multistage GAN that progressively enhances the image quality at each stage. After image resolution, Sparse Dense Fusion R-CNN (SDR) is used for object detection in super-resolved images to improve feature extraction through Sparse Dense Fusion. The R-CNN leverages these enhanced features to accurately detect and segment objects at the pixel level. Subsequently, Non-Maximum Suppression (NMS) was applied to improve localization by eliminating overlapping bounding boxes and minimizing false positives. This integrated method boosts overall detection precision and reliability in real time surveillance scenarios. The proposed model achieves a Super Resolution Error Rate (SRER) of 0.19%, a Bit Error Rate (BER) of 0.125%, a Packet Error Rate (PER) of 0.0990%, and a Deep End-to-End Image Metric (DEEIM) of 0.04963%, showcasing its superior performance. In contrast with existing methodologies, these results highlight the effectiveness of the suggested approach in reducing error rates and enhancing image quality metrics. As a result, these methods are ideally suited for real-time applications, particularly in high-resolution scenarios and object detection within surveillance systems.

Abstract Image

深度注意-多阶段GAN与稀疏密集融合R-CNN用于监控系统的高分辨率和目标检测
视频监控在交通监控、私人机构保护和地标保护等领域的应用得到了显著发展。由于捕获的监控图像质量不佳,很难识别目标。采用图像超分辨率(SR)重建方法可以提高低分辨率(LR)图像的质量。为了在sr中获得最先进的性能,已经使用了复杂的深度学习方法。然而,这些技术通常容易丢失基本信息,并且在复杂的计算中表现不佳。为了克服这些挑战,本研究开发了一种用于图像超分辨率的深度注意-多阶段生成对抗网络(DA-MGAN),并将SDR(稀疏密集融合R-CNN)与非最大抑制(NMS)相结合,以提高监视图像中的目标检测精度。DA-MGAN通过利用注意力机制来改进特征提取,并集成多阶段GAN来逐步提高每阶段的图像质量,从而生成高分辨率的监控图像。图像分辨率完成后,利用SDR (Sparse Dense Fusion R-CNN)对超分辨率图像进行目标检测,通过Sparse Dense Fusion改进特征提取。R-CNN利用这些增强的功能来准确地检测和分割像素级的对象。随后,采用非最大抑制(NMS)方法,通过消除重叠的边界框和减少误报来改进定位。这种集成方法在实时监控场景中提高了整体检测精度和可靠性。该模型的超分辨错误率(SRER)为0.19%,误码率(BER)为0.125%,包错误率(PER)为0.0990%,深度端到端图像度量(DEEIM)为0.04963%,显示了其优越的性能。与现有的方法相比,这些结果突出了所建议的方法在降低错误率和提高图像质量指标方面的有效性。因此,这些方法非常适合实时应用,特别是在监控系统中的高分辨率场景和目标检测中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
1.50
自引率
11.10%
发文量
25
期刊介绍: The journal covers a wide range of issues in information optics such as optical memory, mechanisms for optical data recording and processing, photosensitive materials, optical, optoelectronic and holographic nanostructures, and many other related topics. Papers on memory systems using holographic and biological structures and concepts of brain operation are also included. The journal pays particular attention to research in the field of neural net systems that may lead to a new generation of computional technologies by endowing them with intelligence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书