Shaopeng Li , Bo Jiang , Shunlin Liang , Xiongxin Xiao , Jianghai Peng , Hui Liang , Jiakun Han , Xiuwan Yin
{"title":"Estimation of surface all-wave net radiation from MODIS data using deep residual neural network based on limited samples","authors":"Shaopeng Li , Bo Jiang , Shunlin Liang , Xiongxin Xiao , Jianghai Peng , Hui Liang , Jiakun Han , Xiuwan Yin","doi":"10.1016/j.isprsjprs.2025.04.035","DOIUrl":null,"url":null,"abstract":"<div><div>Deep learning methods have demonstrated significant success in estimating land surface parameters from satellite data. However, these methods often require large sample sizes for optimal performance, which can be difficult to obtain. This study introduces a novel framework that combines transfer learning (TL) and data augmentation (DA) to improve the performance of a deep learning model, the residual neural network (ResNet), in estimating daily all-wave net radiation (<em>R<sub>n_daily</sub></em>) from Moderate Resolution Imaging Spectroradiometer (MODIS) top-of-atmosphere (TOA) observations using limited samples. The framework involves two main steps: first, constructing a robust base model using augmented training samples generated through image rotation in the source region; and second, fine-tuning this base model in target regions with limited local samples. The framework was tested in three regions: the Continental United States (US), Mainland China (MC), and the tropical zone (TR), all with limited ground measurement data. The US was selected as the source region due to its relatively better sample conditions. The results showed that: (1) the ResNet model trained in the US using augmented samples achieved a validated R<sup>2</sup> of 0.95, RMSE of 14.31, and bias of −0.28 Wm<sup>−2</sup>, which outperformed the multi-layer perceptron (MLP) and ResNet models trained with original samples by reducing the validated RMSEs of 2.77 Wm<sup>−2</sup> and 0.80 Wm<sup>−2</sup>, respectively; (2) the transferred base model also performed the best in MC and TR, with R<sup>2</sup> values of 0.86 and 0.66, RMSEs of 22.22 and 25.25 Wm<sup>−2</sup>, and biases of 0.22 Wm<sup>−2</sup> and −0.21 Wm<sup>−2</sup>, respectively, leading to a decrease in validated RMSE by 3.20, 1.87, and 1.14 Wm<sup>−2</sup> for MC and by 2.32, 1.12, and 0.55 Wm<sup>−2</sup> for TR compared to the MLP and ResNet model trained directly and the ResNet model trained using the augmented samples in these regions, respectively; and (3) the more comprehensive the pre-training sample, the better the framework’s performance in the target domain. However, challenges related to cloud cover and input window size need to be carefully addressed when applying the new framework. Overall, the results highlight the effectiveness of the proposed framework and provide a promising approach for applying deep learning methods with limited samples.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"225 ","pages":"Pages 131-143"},"PeriodicalIF":10.6000,"publicationDate":"2025-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271625001777","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Deep learning methods have demonstrated significant success in estimating land surface parameters from satellite data. However, these methods often require large sample sizes for optimal performance, which can be difficult to obtain. This study introduces a novel framework that combines transfer learning (TL) and data augmentation (DA) to improve the performance of a deep learning model, the residual neural network (ResNet), in estimating daily all-wave net radiation (Rn_daily) from Moderate Resolution Imaging Spectroradiometer (MODIS) top-of-atmosphere (TOA) observations using limited samples. The framework involves two main steps: first, constructing a robust base model using augmented training samples generated through image rotation in the source region; and second, fine-tuning this base model in target regions with limited local samples. The framework was tested in three regions: the Continental United States (US), Mainland China (MC), and the tropical zone (TR), all with limited ground measurement data. The US was selected as the source region due to its relatively better sample conditions. The results showed that: (1) the ResNet model trained in the US using augmented samples achieved a validated R2 of 0.95, RMSE of 14.31, and bias of −0.28 Wm−2, which outperformed the multi-layer perceptron (MLP) and ResNet models trained with original samples by reducing the validated RMSEs of 2.77 Wm−2 and 0.80 Wm−2, respectively; (2) the transferred base model also performed the best in MC and TR, with R2 values of 0.86 and 0.66, RMSEs of 22.22 and 25.25 Wm−2, and biases of 0.22 Wm−2 and −0.21 Wm−2, respectively, leading to a decrease in validated RMSE by 3.20, 1.87, and 1.14 Wm−2 for MC and by 2.32, 1.12, and 0.55 Wm−2 for TR compared to the MLP and ResNet model trained directly and the ResNet model trained using the augmented samples in these regions, respectively; and (3) the more comprehensive the pre-training sample, the better the framework’s performance in the target domain. However, challenges related to cloud cover and input window size need to be carefully addressed when applying the new framework. Overall, the results highlight the effectiveness of the proposed framework and provide a promising approach for applying deep learning methods with limited samples.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.