Zhixiang Yin , Penghai Wu , Xinyan Li , Zhen Hao , Xiaoshuang Ma , Ruirui Fan , Chun Liu , Feng Ling
{"title":"通过融合 Sentinel-1 和 Sentinel-2 图像,利用特征协作 CNN 模型绘制超分辨率水体地图","authors":"Zhixiang Yin , Penghai Wu , Xinyan Li , Zhen Hao , Xiaoshuang Ma , Ruirui Fan , Chun Liu , Feng Ling","doi":"10.1016/j.jag.2024.104176","DOIUrl":null,"url":null,"abstract":"<div><p>Mapping water bodies from remotely sensed imagery is crucial for understanding hydrological and biogeochemical processes. The identification of water extent is mainly dependent on optical and synthetic aperture radar (SAR) images. However, the use of remote sensing for water body mapping is often undermined by the mixed pixel dilemma inherent to traditional hard classification approaches. At the same time, the presence of clouds in optical imagery and speckle noise in SAR imagery, coupled with the difficulty in differentiating between water-like surfaces and actual water bodies, significantly compromise the accuracy of water body identification. This paper proposes a DEEP feature collaborative convolutional neural network (CNN) for Water Super-Resolution Mapping based on Optical and SAR images (DeepOSWSRM), which collaboratively leverages Sentinel-1 and Sentinel-2 imagery to address the challenges of missing data and mixed pixels. The Sentinel-1 image provides complementary water distribution information for the cloudy areas of the Sentinel-2 image, while the Sentinel-2 image enhances the perception capabilities for small water bodies in the Sentinel-1 image. Using PlanetScope imagery as the true reference data, the effectiveness of the proposed method was assessed through two experimental scenarios: one utilizing synthetic coarse-resolution imagery degraded from Sentinel-1 and Sentinel-2 data and another using actual Sentinel-1 and Sentinel-2 data, encompassing both simulated and real cloud conditions. A comparative analysis was conducted against three state-of-the-art CNN-based water mapping methods and two CNN SRM methods. The findings demonstrate that the proposed DeepOSWSRM method successfully produces accurate, fine-resolution water body maps, with its performance mainly benefiting from the fusion of SAR and optical images.</p></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"134 ","pages":"Article 104176"},"PeriodicalIF":7.6000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1569843224005326/pdfft?md5=25f45d51bb309a51f91d833bf10382d5&pid=1-s2.0-S1569843224005326-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Super-resolution water body mapping with a feature collaborative CNN model by fusing Sentinel-1 and Sentinel-2 images\",\"authors\":\"Zhixiang Yin , Penghai Wu , Xinyan Li , Zhen Hao , Xiaoshuang Ma , Ruirui Fan , Chun Liu , Feng Ling\",\"doi\":\"10.1016/j.jag.2024.104176\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Mapping water bodies from remotely sensed imagery is crucial for understanding hydrological and biogeochemical processes. The identification of water extent is mainly dependent on optical and synthetic aperture radar (SAR) images. However, the use of remote sensing for water body mapping is often undermined by the mixed pixel dilemma inherent to traditional hard classification approaches. At the same time, the presence of clouds in optical imagery and speckle noise in SAR imagery, coupled with the difficulty in differentiating between water-like surfaces and actual water bodies, significantly compromise the accuracy of water body identification. This paper proposes a DEEP feature collaborative convolutional neural network (CNN) for Water Super-Resolution Mapping based on Optical and SAR images (DeepOSWSRM), which collaboratively leverages Sentinel-1 and Sentinel-2 imagery to address the challenges of missing data and mixed pixels. The Sentinel-1 image provides complementary water distribution information for the cloudy areas of the Sentinel-2 image, while the Sentinel-2 image enhances the perception capabilities for small water bodies in the Sentinel-1 image. Using PlanetScope imagery as the true reference data, the effectiveness of the proposed method was assessed through two experimental scenarios: one utilizing synthetic coarse-resolution imagery degraded from Sentinel-1 and Sentinel-2 data and another using actual Sentinel-1 and Sentinel-2 data, encompassing both simulated and real cloud conditions. A comparative analysis was conducted against three state-of-the-art CNN-based water mapping methods and two CNN SRM methods. The findings demonstrate that the proposed DeepOSWSRM method successfully produces accurate, fine-resolution water body maps, with its performance mainly benefiting from the fusion of SAR and optical images.</p></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"134 \",\"pages\":\"Article 104176\"},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2024-09-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1569843224005326/pdfft?md5=25f45d51bb309a51f91d833bf10382d5&pid=1-s2.0-S1569843224005326-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224005326\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224005326","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
Super-resolution water body mapping with a feature collaborative CNN model by fusing Sentinel-1 and Sentinel-2 images
Mapping water bodies from remotely sensed imagery is crucial for understanding hydrological and biogeochemical processes. The identification of water extent is mainly dependent on optical and synthetic aperture radar (SAR) images. However, the use of remote sensing for water body mapping is often undermined by the mixed pixel dilemma inherent to traditional hard classification approaches. At the same time, the presence of clouds in optical imagery and speckle noise in SAR imagery, coupled with the difficulty in differentiating between water-like surfaces and actual water bodies, significantly compromise the accuracy of water body identification. This paper proposes a DEEP feature collaborative convolutional neural network (CNN) for Water Super-Resolution Mapping based on Optical and SAR images (DeepOSWSRM), which collaboratively leverages Sentinel-1 and Sentinel-2 imagery to address the challenges of missing data and mixed pixels. The Sentinel-1 image provides complementary water distribution information for the cloudy areas of the Sentinel-2 image, while the Sentinel-2 image enhances the perception capabilities for small water bodies in the Sentinel-1 image. Using PlanetScope imagery as the true reference data, the effectiveness of the proposed method was assessed through two experimental scenarios: one utilizing synthetic coarse-resolution imagery degraded from Sentinel-1 and Sentinel-2 data and another using actual Sentinel-1 and Sentinel-2 data, encompassing both simulated and real cloud conditions. A comparative analysis was conducted against three state-of-the-art CNN-based water mapping methods and two CNN SRM methods. The findings demonstrate that the proposed DeepOSWSRM method successfully produces accurate, fine-resolution water body maps, with its performance mainly benefiting from the fusion of SAR and optical images.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.