{"title":"Multiscale Attention-UNet-Based Near-Real-Time Precipitation Estimation From FY-4A/AGRI and Doppler Radar Observations","authors":"Dongling Wang;Shanmin Yang;Xiaojie Li;Jing Peng;Hongjiang Ma;Xi Wu","doi":"10.1109/JSTARS.2024.3488854","DOIUrl":null,"url":null,"abstract":"Extreme precipitation events greatly threaten people's daily lives and safety, making accurate and timely precipitation estimation especially critical. However, common methods like radar and satellite remote sensing have limitations due to coverage and environmental factors. Existing deep learning models struggle with complex scenarios and multisource data correlations. These make the precipitation estimation tasks challenging. This article proposes a Multiscale Dual Cross-Attention UNet (MS-DCA-UNet) model for near-real-time precipitation estimation. It integrates Doppler weather radar and FY-4A satellite data to overcome single-source data limitations. To narrow the semantic gap among the encoder feature maps, the MS-DCA-UNet model introduces a dual-cross attention (DCA) module at the skip connections of the backbone network U-Net. The DCA module mainly employs a channel cross-attention and a spatial cross-attention to capture remote dependencies and enable multiscale feature fusion. A multiscale convolution module is designed to reduce the risk of the model falling into local optima. It is a multibranch upsampling strategy that runs parallel to the decoder. Experimental results show that the Critical Success Index (CSI), Root Mean Square Error (RMSE), and Pearson's Correlation Coefficient (CC) of MS-DCA-UNet are 0.6033, 0.5949 mm/h, and 0.8460, respectively, with the hourly CMPAS precipitation as the benchmark. These outperform the other comparisons, such as FY-4A QPE, GPM IMERG, U-Net, Attention-UNet, and DCA-UNet on the CSI, RMSE, and CC metrics. MS-DCA-UNet reduces the RMSE of Attention-UNet, UNet, and DCA-UNet by a margin of 34.68% (0.5949 mm/h versus 0.9107 mm/h), 10.24% (0.5949 mm/h versus 0.6628 mm/h), 6.96% (0.5949 mm/h versus 0.6394 mm/h), respectively.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"17 ","pages":"19998-20011"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10740264","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10740264/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Extreme precipitation events greatly threaten people's daily lives and safety, making accurate and timely precipitation estimation especially critical. However, common methods like radar and satellite remote sensing have limitations due to coverage and environmental factors. Existing deep learning models struggle with complex scenarios and multisource data correlations. These make the precipitation estimation tasks challenging. This article proposes a Multiscale Dual Cross-Attention UNet (MS-DCA-UNet) model for near-real-time precipitation estimation. It integrates Doppler weather radar and FY-4A satellite data to overcome single-source data limitations. To narrow the semantic gap among the encoder feature maps, the MS-DCA-UNet model introduces a dual-cross attention (DCA) module at the skip connections of the backbone network U-Net. The DCA module mainly employs a channel cross-attention and a spatial cross-attention to capture remote dependencies and enable multiscale feature fusion. A multiscale convolution module is designed to reduce the risk of the model falling into local optima. It is a multibranch upsampling strategy that runs parallel to the decoder. Experimental results show that the Critical Success Index (CSI), Root Mean Square Error (RMSE), and Pearson's Correlation Coefficient (CC) of MS-DCA-UNet are 0.6033, 0.5949 mm/h, and 0.8460, respectively, with the hourly CMPAS precipitation as the benchmark. These outperform the other comparisons, such as FY-4A QPE, GPM IMERG, U-Net, Attention-UNet, and DCA-UNet on the CSI, RMSE, and CC metrics. MS-DCA-UNet reduces the RMSE of Attention-UNet, UNet, and DCA-UNet by a margin of 34.68% (0.5949 mm/h versus 0.9107 mm/h), 10.24% (0.5949 mm/h versus 0.6628 mm/h), 6.96% (0.5949 mm/h versus 0.6394 mm/h), respectively.
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.