{"title":"LL-UNet++:UNet++ Based Nested Skip Connections Network for Low-Light Image Enhancement","authors":"Pengfei Shi;Xiwang Xu;Xinnan Fan;Xudong Yang;Yuanxue Xin","doi":"10.1109/TCI.2024.3378091","DOIUrl":null,"url":null,"abstract":"Enhancing low-light images presents several challenges, such as image darkness, severe color distortion, and noise. To address these issues, we propose a novel low-light image enhancement algorithm with nested skip connections based on UNet++. This design facilitates the propagation of finer features and improves information transmission, resulting in better enhancement of image brightness, reduction of color distortion, and retention of finer details. To eliminate noise potentially introduced by skip connections, we designed a specific residual block based on Instance Normalization (IN). IN can process each sample independently, allowing the model to better adapt to each image's specific lighting conditions and noise levels. In addition, we propose a new hybrid loss function that simultaneously emphasizes multiple critical attributes of an image, yielding superior enhancement results on multiple key metrics. The proposed algorithm achieves advanced performance on the LOL dataset, scoring 23.0047 and 0.8682 on the PSNR and SSIM metrics, respectively. Extensive experiments demonstrate the effectiveness and superiority of our proposed algorithm.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"10 ","pages":"510-521"},"PeriodicalIF":4.2000,"publicationDate":"2024-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10473166/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Enhancing low-light images presents several challenges, such as image darkness, severe color distortion, and noise. To address these issues, we propose a novel low-light image enhancement algorithm with nested skip connections based on UNet++. This design facilitates the propagation of finer features and improves information transmission, resulting in better enhancement of image brightness, reduction of color distortion, and retention of finer details. To eliminate noise potentially introduced by skip connections, we designed a specific residual block based on Instance Normalization (IN). IN can process each sample independently, allowing the model to better adapt to each image's specific lighting conditions and noise levels. In addition, we propose a new hybrid loss function that simultaneously emphasizes multiple critical attributes of an image, yielding superior enhancement results on multiple key metrics. The proposed algorithm achieves advanced performance on the LOL dataset, scoring 23.0047 and 0.8682 on the PSNR and SSIM metrics, respectively. Extensive experiments demonstrate the effectiveness and superiority of our proposed algorithm.
期刊介绍:
The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.