Zhongqiang Wang , Chengchao Wang , Yuanyuan Pu , Jinjiang Peng , Zhengpeng Zhao , Jinjing Gu
{"title":"Infrared and visible image fusion with multi-resolution enhancement and dynamic weighted","authors":"Zhongqiang Wang , Chengchao Wang , Yuanyuan Pu , Jinjiang Peng , Zhengpeng Zhao , Jinjing Gu","doi":"10.1016/j.optlastec.2025.112763","DOIUrl":null,"url":null,"abstract":"<div><div>Infrared and visible image fusion (IVIF) aims to generate fused images by combining intensity and detailed information from source images. Existing IVIF methods typically rely on manually defined loss function weights and lack dynamic adaptability to complex scenes. Additionally, single-resolution approaches are limited in capturing complementary information across multiple resolutions. In this study, we propose an adaptive loss-weights and multi-resolution enhancement framework for IVIF, improve adaptability to complex scenes by integrating fine-grained details and background textures. Our approach introduces a multi-resolution detail enhancement (MRDE) module that processes extracted features at three distinct scales to enhance texture details. We also present a holographic fusion strategy composed of two modules: the Structural Integration Module (SIM) and Multi-resolution Texture Fusion Modul (MTFM), which effectively integrate structural and texture information across resolutions. Moreover, we propose an adaptive weighting dynamic balancing loss function that adjusts the emphasis on texture and structure during training. Extensive experiments demonstrate that our method outperforms state-of-the-art IVIF techniques, achieving superior visual balance and improved quantitative performance.</div></div>","PeriodicalId":19511,"journal":{"name":"Optics and Laser Technology","volume":"188 ","pages":"Article 112763"},"PeriodicalIF":4.6000,"publicationDate":"2025-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Laser Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0030399225003512","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
Infrared and visible image fusion with multi-resolution enhancement and dynamic weighted
Infrared and visible image fusion (IVIF) aims to generate fused images by combining intensity and detailed information from source images. Existing IVIF methods typically rely on manually defined loss function weights and lack dynamic adaptability to complex scenes. Additionally, single-resolution approaches are limited in capturing complementary information across multiple resolutions. In this study, we propose an adaptive loss-weights and multi-resolution enhancement framework for IVIF, improve adaptability to complex scenes by integrating fine-grained details and background textures. Our approach introduces a multi-resolution detail enhancement (MRDE) module that processes extracted features at three distinct scales to enhance texture details. We also present a holographic fusion strategy composed of two modules: the Structural Integration Module (SIM) and Multi-resolution Texture Fusion Modul (MTFM), which effectively integrate structural and texture information across resolutions. Moreover, we propose an adaptive weighting dynamic balancing loss function that adjusts the emphasis on texture and structure during training. Extensive experiments demonstrate that our method outperforms state-of-the-art IVIF techniques, achieving superior visual balance and improved quantitative performance.
期刊介绍:
Optics & Laser Technology aims to provide a vehicle for the publication of a broad range of high quality research and review papers in those fields of scientific and engineering research appertaining to the development and application of the technology of optics and lasers. Papers describing original work in these areas are submitted to rigorous refereeing prior to acceptance for publication.
The scope of Optics & Laser Technology encompasses, but is not restricted to, the following areas:
•development in all types of lasers
•developments in optoelectronic devices and photonics
•developments in new photonics and optical concepts
•developments in conventional optics, optical instruments and components
•techniques of optical metrology, including interferometry and optical fibre sensors
•LIDAR and other non-contact optical measurement techniques, including optical methods in heat and fluid flow
•applications of lasers to materials processing, optical NDT display (including holography) and optical communication
•research and development in the field of laser safety including studies of hazards resulting from the applications of lasers (laser safety, hazards of laser fume)
•developments in optical computing and optical information processing
•developments in new optical materials
•developments in new optical characterization methods and techniques
•developments in quantum optics
•developments in light assisted micro and nanofabrication methods and techniques
•developments in nanophotonics and biophotonics
•developments in imaging processing and systems