Remote SensingPub Date : 2024-09-13DOI: 10.3390/rs16183402
Shiyue He, Yanjun Zhang, Lan Luo, Yuanxin Song
{"title":"Establishment of Remote Sensing Inversion Model and Its Application in Pollution Source Identification: A Case Study of East Lake in Wuhan","authors":"Shiyue He, Yanjun Zhang, Lan Luo, Yuanxin Song","doi":"10.3390/rs16183402","DOIUrl":"https://doi.org/10.3390/rs16183402","url":null,"abstract":"In remote watersheds or large water bodies, monitoring water quality parameters is often impractical due to high costs and time-consuming processes. To address this issue, a cost-effective methodology based on remote sensing was developed to predict water quality parameters over a large and operationally challenging area, especially focusing on East Lake. Sentinel-2 satellite image data were used as a proxy, and a multiple linear regression model was developed to quantify water quality parameters, namely chlorophyll-a, total nitrogen, total phosphorus, ammonia nitrogen and chemical oxygen demand. This model was then applied to East Lake to obtain the temporal and spatial distribution of these water quality parameters. By identifying the locations with the highest concentrations along the boundaries of East Lake, potential pollution sources could be inferred. The results demonstrate that the developed multiple linear regression model provided a satisfactory relationship between the measured and simulated water quality parameters. The coefficients of determination R2 of the multiple linear regression models for chlorophyll-a, total nitrogen, total phosphorus, ammonia nitrogen and chemical oxygen demand were 0.943, 0.781, 0.470, 0.624 and 0.777, respectively. The potential pollution source locations closely matched the officially published information on East Lake pollutant discharges. Therefore, using remote sensing imagery to establish a multiple linear regression model is a feasible approach for understanding the exceedance and distribution of various water quality parameters in East Lake.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"50 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-13DOI: 10.3390/rs16183407
Mengru Song, Yanjun Wang, Yongshun Han, Yiye Ji
{"title":"Estimation Model and Spatio-Temporal Analysis of Carbon Emissions from Energy Consumption with NPP-VIIRS-like Nighttime Light Images: A Case Study in the Pearl River Delta Urban Agglomeration of China","authors":"Mengru Song, Yanjun Wang, Yongshun Han, Yiye Ji","doi":"10.3390/rs16183407","DOIUrl":"https://doi.org/10.3390/rs16183407","url":null,"abstract":"Urbanization is growing at a rapid pace, and this is being reflected in the rising energy consumption from fossil fuels, which is contributing significantly to greenhouse gas impacts and carbon emissions (CE). Aiming at the problems of the time delay, inconsistency, uneven spatial coverage scale, and low precision of the current regional carbon emissions from energy consumption accounting statistics, this study builds a precise model for estimating the carbon emissions from regional energy consumption and analyzes the spatio-temporal characteristics. Firstly, in order to estimate the carbon emissions resulting from energy consumption, a fixed effects model was built using data on province energy consumption and NPP-VIIRS-like nighttime lighting data. Secondly, the PRD urban agglomeration was selected as the case study area to estimate the carbon emissions from 2012 to 2020 and predict the carbon emissions from 2021 to 2023. Then, their multi-scale spatial and temporal distribution characteristics were analyzed through trends and hotspots. Lastly, the influence factors of CE from 2012 to 2020 were examined with the OLS, GWR, GTWR, and MGWR models, as well as a ridge regression to enhance the MGWR model. The findings indicate that, from 2012 to 2020, the carbon emissions in the PRD urban agglomeration were characterized by the non-equilibrium feature of “high in the middle and low at both ends”; from 2021 to 2023, the central and eastern regions saw the majority of its high carbon emission areas, the east saw the region with the highest rate of growth, the east and the periphery of the high value area were home to the area of medium values, while the southern, central, and northern regions were home to the low value areas; carbon emissions were positively impacted by population, economics, land area, and energy, and they were negatively impacted by science, technology, and environmental factors. This study could provide technical support for the long-term time-series monitoring and remote sensing inversion of the carbon emissions from energy consumption in large-scale, complex urban agglomerations.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"2 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-13DOI: 10.3390/rs16183408
Bulusu Subrahmanyam, V. S. N. Murty, Sarah B. Hall, Corinne B. Trott
{"title":"Identification of Internal Tides in ECCO Estimates of Sea Surface Salinity in the Andaman Sea","authors":"Bulusu Subrahmanyam, V. S. N. Murty, Sarah B. Hall, Corinne B. Trott","doi":"10.3390/rs16183408","DOIUrl":"https://doi.org/10.3390/rs16183408","url":null,"abstract":"We used NASA’s high-resolution (1/48° or 2.3 km, hourly) Estimating the Circulation and Climate of the Ocean (ECCO) estimates of salinity at a 1 m depth from November 2011 to October 2012 to detect semi-diurnal and diurnal internal tides (ITs) in the Andaman Sea and determine their characteristics in three 2° × 2° boxes off the Myanmar coast (box A), central Andaman Sea (box B), and off the Thailand coast (box C). We also used observed salinity and temperature data for the above period at the BD12-moored buoy in the central Andaman Sea. ECCO salinity data were bandpass-filtered with 11–14 h and 22–26 h periods. Large variations in filtered ECCO salinity (~0.1 psu) in the boxes corresponded with near-surface imprints of propagating ITs. Observed data from the box B domain reveals strong salinity stratification (halocline) in the upper 40 m. Our analyses reveal that the shallow halocline affects the signatures of propagating semi-diurnal ITs reaching the surface, but diurnal ITs propagating in the halocline reach up to the surface and bring variability in ECCO salinity. In box A, the semi-diurnal IT characteristics are higher speeds (0.96 m/s) with larger wavelengths (45 km), that are closer to theoretical mode 2 estimates, but the diurnal ITs propagating in the box A domain, with a possible source over the shelf of Gulf of Martaban, attain lower values (0.45 m/s, 38 km). In box B, the propagation speed is lower (higher) for semi-diurnal (diurnal) ITs. Estimates for box C are closer to those for box A.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"734 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-13DOI: 10.3390/rs16183401
Lien Rodríguez-López, Lisandra Bravo Alvarez, Iongel Duran-Llacer, David E. Ruíz-Guirola, Samuel Montejo-Sánchez, Rebeca Martínez-Retureta, Ernesto López-Morales, Luc Bourrel, Frédéric Frappart, Roberto Urrutia
{"title":"Leveraging Machine Learning and Remote Sensing for Water Quality Analysis in Lake Ranco, Southern Chile","authors":"Lien Rodríguez-López, Lisandra Bravo Alvarez, Iongel Duran-Llacer, David E. Ruíz-Guirola, Samuel Montejo-Sánchez, Rebeca Martínez-Retureta, Ernesto López-Morales, Luc Bourrel, Frédéric Frappart, Roberto Urrutia","doi":"10.3390/rs16183401","DOIUrl":"https://doi.org/10.3390/rs16183401","url":null,"abstract":"This study examines the dynamics of limnological parameters of a South American lake located in southern Chile with the objective of predicting chlorophyll-a levels, which are a key indicator of algal biomass and water quality, by integrating combined remote sensing and machine learning techniques. Employing four advanced machine learning models (recurrent neural network (RNNs), long short-term memory (LSTM), recurrent gate unit (GRU), and temporal convolutional network (TCNs)), the research focuses on the estimation of chlorophyll-a concentrations at three sampling stations within Lake Ranco. The data span from 1987 to 2020 and are used in three different cases: using only in situ data (Case 1), using in situ and meteorological data (Case 2), using in situ, and meteorological and satellite data from Landsat and Sentinel missions (Case 3). In all cases, each machine learning model shows robust performance, with promising results in predicting chlorophyll-a concentrations. Among these models, LSTM stands out as the most effective, with the best metrics in the estimation, the best performance was Case 1, with R2 = 0.89, an RSME of 0.32 µg/L, an MAE 1.25 µg/L and an MSE 0.25 (µg/L)2, consistently outperforming the others according to the static metrics used for validation. This finding underscores the effectiveness of LSTM in capturing the complex temporal relationships inherent in the dataset. However, increasing the dataset in Case 3 shows a better performance of TCNs (R2 = 0.96; MSE = 0.33 (µg/L)2; RMSE = 0.13 µg/L; and MAE = 0.06 µg/L). The successful application of machine learning algorithms emphasizes their potential to elucidate the dynamics of algal biomass in Lake Ranco, located in the southern region of Chile. These results not only contribute to a deeper understanding of the lake ecosystem but also highlight the utility of advanced computational techniques in environmental research and management.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"38 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-13DOI: 10.3390/rs16183410
Xiaoyuan Zhang, Shudong Wang, Kai Liu, Xiankai Huang, Jinlian Shi, Xueke Li
{"title":"Projecting Response of Ecological Vulnerability to Future Climate Change and Human Policies in the Yellow River Basin, China","authors":"Xiaoyuan Zhang, Shudong Wang, Kai Liu, Xiankai Huang, Jinlian Shi, Xueke Li","doi":"10.3390/rs16183410","DOIUrl":"https://doi.org/10.3390/rs16183410","url":null,"abstract":"Exploring the dynamic response of land use and ecological vulnerability (EV) to future climate change and human ecological restoration policies is crucial for optimizing regional ecosystem services and formulating sustainable socioeconomic development strategies. This study comprehensively assesses future land use changes and EV in the Yellow River Basin (YRB), a climate-sensitive and ecologically fragile area, by integrating climate change, land management, and ecological protection policies under various scenarios. To achieve this, we developed an EV assessment framework combining a scenario weight matrix, Markov chain, Patch-generating Land Use Simulation model, and exposure–sensitivity–adaptation. We further explored the spatiotemporal variations of EV and their potential socioeconomic impacts at the watershed scale. Our results show significant geospatial variations in future EV under the three scenarios, with the northern region of the upstream area being the most severely affected. Under the ecological conservation management scenario and historical trend scenario, the ecological environment of the basin improves, with a decrease in very high vulnerability areas by 4.45% and 3.08%, respectively, due to the protection and restoration of ecological land. Conversely, under the urban development and construction scenario, intensified climate change and increased land use artificialization exacerbate EV, with medium and high vulnerability areas increasing by 1.86% and 7.78%, respectively. The population in high and very high vulnerability areas is projected to constitute 32.75–33.68% and 34.59–39.21% of the YRB’s total population in 2040 and 2060, respectively, and may continue to grow. Overall, our scenario analysis effectively demonstrates the positive impact of ecological protection on reducing EV and the negative impact of urban expansion and economic development on increasing EV. Our work offers new insights into land resource allocation and the development of ecological restoration policies.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"7 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200463","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Research on Multiscale Atmospheric Chaos Based on Infrared Remote-Sensing and Reanalysis Data","authors":"Zhong Wang, Shengli Sun, Wenjun Xu, Rui Chen, Yijun Ma, Gaorui Liu","doi":"10.3390/rs16183376","DOIUrl":"https://doi.org/10.3390/rs16183376","url":null,"abstract":"The atmosphere is a complex nonlinear system, with the information of its temperature, water vapor, pressure, and cloud being crucial aspects of remote-sensing data analysis. There exist intricate interactions among these internal components, such as convection, radiation, and humidity exchange. Atmospheric phenomena span multiple spatial and temporal scales, from small-scale thunderstorms to large-scale events like El Niño. The dynamic interactions across different scales, along with external disturbances to the atmospheric system, such as variations in solar radiation and Earth surface conditions, contribute to the chaotic nature of the atmosphere, making long-term predictions challenging. Grasping the intrinsic chaotic dynamics is essential for advancing atmospheric analysis, which holds profound implications for enhancing meteorological forecasts, mitigating disaster risks, and safeguarding ecological systems. To validate the chaotic nature of the atmosphere, this paper reviewed the definitions and main features of chaotic systems, elucidated the method of phase space reconstruction centered on Takens’ theorem, and categorized the qualitative and quantitative methods for determining the chaotic nature of time series data. Among quantitative methods, the Wolf method is used to calculate the Largest Lyapunov Exponents, while the G–P method is used to calculate the correlation dimensions. A new method named Improved Saturated Correlation Dimension method was proposed to address the subjectivity and noise sensitivity inherent in the traditional G–P method. Subsequently, the Largest Lyapunov Exponents and saturated correlation dimensions were utilized to conduct a quantitative analysis of FY-4A and Himawari-8 remote-sensing infrared observation data, and ERA5 reanalysis data. For both short-term remote-sensing data and long-term reanalysis data, the results showed that more than 99.91% of the regional points have corresponding sequences with positive Largest Lyapunov exponents and all the regional points have correlation dimensions that tended to saturate at values greater than 1 with increasing embedding dimensions, thereby proving that the atmospheric system exhibits chaotic properties on both short and long temporal scales, with extreme sensitivity to initial conditions. This conclusion provided a theoretical foundation for the short-term prediction of atmospheric infrared radiation field variables and the detection of weak, time-sensitive signals in complex atmospheric environments.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"165 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-11DOI: 10.3390/rs16183374
Angelly de Jesus Pugliese Viloria, Andrea Folini, Daniela Carrion, Maria Antonia Brovelli
{"title":"Hazard Susceptibility Mapping with Machine and Deep Learning: A Literature Review","authors":"Angelly de Jesus Pugliese Viloria, Andrea Folini, Daniela Carrion, Maria Antonia Brovelli","doi":"10.3390/rs16183374","DOIUrl":"https://doi.org/10.3390/rs16183374","url":null,"abstract":"With the increase in climate-change-related hazardous events alongside population concentration in urban centres, it is important to provide resilient cities with tools for understanding and eventually preparing for such events. Machine learning (ML) and deep learning (DL) techniques have increasingly been employed to model susceptibility of hazardous events. This study consists of a systematic review of the ML/DL techniques applied to model the susceptibility of air pollution, urban heat islands, floods, and landslides, with the aim of providing a comprehensive source of reference both for techniques and modelling approaches. A total of 1454 articles published between 2020 and 2023 were systematically selected from the Scopus and Web of Science search engines based on search queries and selection criteria. ML/DL techniques were extracted from the selected articles and categorised using ad hoc classification. Consequently, a general approach for modelling the susceptibility of hazardous events was consolidated, covering the data preprocessing, feature selection, modelling, model interpretation, and susceptibility map validation, along with examples of related global/continental data. The most frequently employed techniques across various hazards include random forest, artificial neural networks, and support vector machines. This review also provides, per hazard, the definition, data requirements, and insights into the ML/DL techniques used, including examples of both state-of-the-art and novel modelling approaches.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"13 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-11DOI: 10.3390/rs16183371
Mohammad Kakooei, Yasser Baleghi
{"title":"Mapping Building Heights at Large Scales Using Sentinel-1 Radar Imagery and Nighttime Light Data","authors":"Mohammad Kakooei, Yasser Baleghi","doi":"10.3390/rs16183371","DOIUrl":"https://doi.org/10.3390/rs16183371","url":null,"abstract":"Human settlement areas significantly impact the environment, leading to changes in both natural and built environments. Comprehensive information on human settlements, particularly in urban areas, is crucial for effective sustainable development planning. However, urban land use investigations are often limited to two-dimensional building footprint maps, neglecting the three-dimensional aspect of building structures. This paper addresses this issue to contribute to Sustainable Development Goal 11, which focuses on making human settlements inclusive, safe, and sustainable. In this study, Sentinel-1 data are used as the primary source to estimate building heights. One challenge addressed is the issue of multiple backscattering in Sentinel-1’s signal, particularly in densely populated areas with high-rise buildings. To mitigate this, firstly, Sentinel-1 data from different directions, orbit paths, and polarizations are utilized. Combining ascending and descending orbits significantly improves estimation accuracy, and incorporating a higher number of paths provides additional information. However, Sentinel-1 data alone are not sufficiently rich at a global scale across different orbits and polarizations. Secondly, to enhance the accuracy further, Sentinel-1 data are corrected using nighttime light data as additional information, which shows promising results in addressing multiple backscattering issues. Finally, a deep learning model is trained to generate building height maps using these features, achieving a mean absolute error of around 2 m and a mean square error of approximately 13. The generalizability of this method is demonstrated in several cities with diverse built-up structures, including London, Berlin, and others. Finally, a building height map of Iran is generated and evaluated against surveyed buildings, showcasing its large-scale mapping capability.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"46 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200473","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-11DOI: 10.3390/rs16183380
Zongqing Cao, Bing Liu, Jianchao Yang, Ke Tan, Zheng Dai, Xingyu Lu, Hong Gu
{"title":"Contrastive Transformer Network for Track Segment Association with Two-Stage Online Method","authors":"Zongqing Cao, Bing Liu, Jianchao Yang, Ke Tan, Zheng Dai, Xingyu Lu, Hong Gu","doi":"10.3390/rs16183380","DOIUrl":"https://doi.org/10.3390/rs16183380","url":null,"abstract":"Interrupted and multi-source track segment association (TSA) are two key challenges in target trajectory research within radar data processing. Traditional methods often rely on simplistic assumptions about target motion and statistical techniques for track association, leading to problems such as unrealistic assumptions, susceptibility to noise, and suboptimal performance limits. This study proposes a unified framework to address the challenges of associating interrupted and multi-source track segments by measuring trajectory similarity. We present TSA-cTFER, a novel network utilizing contrastive learning and TransFormer Encoder to accurately assess trajectory similarity through learned Representations by computing distances between high-dimensional feature vectors. Additionally, we tackle dynamic association scenarios with a two-stage online algorithm designed to manage tracks that appear or disappear at any time. This algorithm categorizes track pairs into easy and hard groups, employing tailored association strategies to achieve precise and robust associations in dynamic environments. Experimental results on real-world datasets demonstrate that our proposed TSA-cTFER network with the two-stage online algorithm outperforms existing methods, achieving 94.59% accuracy in interrupted track segment association tasks and 94.83% in multi-source track segment association tasks.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"6 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Remote SensingPub Date : 2024-09-11DOI: 10.3390/rs16183370
Shuying Li, Muyi Han, Yuemei Qin, Qiang Li
{"title":"Self-Attention Progressive Network for Infrared and Visible Image Fusion","authors":"Shuying Li, Muyi Han, Yuemei Qin, Qiang Li","doi":"10.3390/rs16183370","DOIUrl":"https://doi.org/10.3390/rs16183370","url":null,"abstract":"Visible and infrared image fusion is a strategy that effectively extracts and fuses information from different sources. However, most existing methods largely neglect the issue of lighting imbalance, which makes the same fusion models inapplicable to different scenes. Several methods obtain low-level features from visible and infrared images at an early stage of input or shallow feature extraction. However, these methods do not explore how low-level features provide a foundation for recognizing and utilizing the complementarity and common information between the two types of images. As a result, the complementarity and common information between the images is not fully analyzed and discussed. To address these issues, we propose a Self-Attention Progressive Network for the fusion of infrared and visible images in this paper. Firstly, we construct a Lighting-Aware Sub-Network to analyze lighting distribution, and introduce intensity loss to measure the probability of scene illumination. This approach enhances the model’s adaptability to lighting conditions. Secondly, we introduce self-attention learning to design a multi-state joint feature extraction module (MSJFEM) that fully utilizes the contextual information among input keys. It guides the learning of a dynamic attention matrix to strengthen the capacity for visual representation. Finally, we design a Difference-Aware Propagation Module (DAPM) to extract and integrate edge details from the source images while supplementing differential information. The experiments across three benchmark datasets reveal that the proposed approach exhibits satisfactory performance compared to existing methods.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":"400 1","pages":""},"PeriodicalIF":5.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200469","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}