End-to-end adaptive object detection with learnable Retinex for low-light city environment

IF 3 3区 材料科学 Q2 MATERIALS SCIENCE, CHARACTERIZATION & TESTING
Miao Yao, Yijing Lu, Jinteng Mou, Chen Yan, Dongjingdian Liu
{"title":"End-to-end adaptive object detection with learnable Retinex for low-light city environment","authors":"Miao Yao, Yijing Lu, Jinteng Mou, Chen Yan, Dongjingdian Liu","doi":"10.1080/10589759.2023.2274011","DOIUrl":null,"url":null,"abstract":"ABSTRACTIn the smart city context, efficient urban surveillance under low-light conditions is crucial. Accurate object detection in dimly lit areas is vital for safety and nighttime driving. However, subpar, poorly lit images due to environmental or equipment limitations pose a challenge, affecting precision in tasks like object detection and segmentation. Existing solutions often involve time-consuming, inefficient image preprocessing and lack strong theoretical support for low-light city image enhancement. To address these issue, we propose an end-to-end pipeline named LAR-YOLO that leverages convolutional network to extract a set of image transformation parameters, and implements the Retinex theory to proficiently elevate the quality of the image. Unlike conventional approaches, this innovative method eliminates the need for hand-crafted parameters and can adaptively enhance each low-light image. Additionally, due to a restricted quantity of training data, the detection model may not achieve an adequate level of expertise to enhance detection accuracy. To tackle this challenge, we introduce a cross-domain learning approach that supplements the low-light model with knowledge from normal light scenarios. Our proof-of-principle experiments and ablation studies utilising ExDark and VOC datasets demonstrate that our proposed method outperforms similar low-light object detection algorithms by approximately 13% in terms of accuracy.KEYWORDS: Object detectionsmart cityRetinex theorylow-light image processingcross-domain learning AcknowledgmentsThis work was supported by the National Natural Science Foundation of China under Grant Nos. 62272462 and 51904294.Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThis work was supported by the National Natural Science Foundation of China [51904294]; National Natural Science Foundation of China [62272462].","PeriodicalId":49746,"journal":{"name":"Nondestructive Testing and Evaluation","volume":"10 6","pages":"0"},"PeriodicalIF":3.0000,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nondestructive Testing and Evaluation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/10589759.2023.2274011","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, CHARACTERIZATION & TESTING","Score":null,"Total":0}
引用次数: 0

Abstract

ABSTRACTIn the smart city context, efficient urban surveillance under low-light conditions is crucial. Accurate object detection in dimly lit areas is vital for safety and nighttime driving. However, subpar, poorly lit images due to environmental or equipment limitations pose a challenge, affecting precision in tasks like object detection and segmentation. Existing solutions often involve time-consuming, inefficient image preprocessing and lack strong theoretical support for low-light city image enhancement. To address these issue, we propose an end-to-end pipeline named LAR-YOLO that leverages convolutional network to extract a set of image transformation parameters, and implements the Retinex theory to proficiently elevate the quality of the image. Unlike conventional approaches, this innovative method eliminates the need for hand-crafted parameters and can adaptively enhance each low-light image. Additionally, due to a restricted quantity of training data, the detection model may not achieve an adequate level of expertise to enhance detection accuracy. To tackle this challenge, we introduce a cross-domain learning approach that supplements the low-light model with knowledge from normal light scenarios. Our proof-of-principle experiments and ablation studies utilising ExDark and VOC datasets demonstrate that our proposed method outperforms similar low-light object detection algorithms by approximately 13% in terms of accuracy.KEYWORDS: Object detectionsmart cityRetinex theorylow-light image processingcross-domain learning AcknowledgmentsThis work was supported by the National Natural Science Foundation of China under Grant Nos. 62272462 and 51904294.Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThis work was supported by the National Natural Science Foundation of China [51904294]; National Natural Science Foundation of China [62272462].
基于可学习Retinex的低光城市环境端到端自适应目标检测
在智慧城市背景下,低光照条件下的高效城市监控至关重要。在光线昏暗的区域进行准确的目标检测对于安全和夜间驾驶至关重要。然而,由于环境或设备限制,光线不足的图像构成了挑战,影响了目标检测和分割等任务的精度。现有的解决方案往往耗时、低效的图像预处理,缺乏对低照度城市图像增强的有力理论支持。为了解决这些问题,我们提出了一个名为LAR-YOLO的端到端管道,该管道利用卷积网络提取一组图像变换参数,并实现Retinex理论来熟练地提升图像质量。与传统方法不同,这种创新的方法消除了手工制作参数的需要,并且可以自适应地增强每个低光图像。此外,由于训练数据的数量有限,检测模型可能无法达到足够的专业水平来提高检测准确性。为了应对这一挑战,我们引入了一种跨域学习方法,用正常光照场景的知识补充弱光模型。我们利用ExDark和VOC数据集进行的原理验证实验和烧蚀研究表明,我们提出的方法在精度方面比类似的低光物体检测算法高出约13%。关键词:目标检测,智慧城市,视网膜理论,微光图像处理,跨域学习。披露声明作者未报告潜在的利益冲突。基金资助:国家自然科学基金[51904294];国家自然科学基金资助项目[62272462]。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Nondestructive Testing and Evaluation
Nondestructive Testing and Evaluation 工程技术-材料科学:表征与测试
CiteScore
4.30
自引率
11.50%
发文量
57
审稿时长
4 months
期刊介绍: Nondestructive Testing and Evaluation publishes the results of research and development in the underlying theory, novel techniques and applications of nondestructive testing and evaluation in the form of letters, original papers and review articles. Articles concerning both the investigation of physical processes and the development of mechanical processes and techniques are welcomed. Studies of conventional techniques, including radiography, ultrasound, eddy currents, magnetic properties and magnetic particle inspection, thermal imaging and dye penetrant, will be considered in addition to more advanced approaches using, for example, lasers, squid magnetometers, interferometers, synchrotron and neutron beams and Compton scattering. Work on the development of conventional and novel transducers is particularly welcomed. In addition, articles are invited on general aspects of nondestructive testing and evaluation in education, training, validation and links with engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信