Pengfei Tang , Shanchuan Guo , Lu Qie , Xingang Zhang , Hong Fang , Liang Wan , Jocelyn Chanussot , Peijun Du
{"title":"使用跨模态样本转移和深度学习的哨兵时间序列测绘潮坪地形","authors":"Pengfei Tang , Shanchuan Guo , Lu Qie , Xingang Zhang , Hong Fang , Liang Wan , Jocelyn Chanussot , Peijun Du","doi":"10.1016/j.isprsjprs.2025.04.017","DOIUrl":null,"url":null,"abstract":"<div><div>Tidal flats are crucial components of coastal geomorphic systems, where the ocean meets the land. Timely and accurate topographic maps of tidal flats are essential for sustainable coastal management and development. Although satellite imagery-based inversion methods offer a cost-effective solution for constructing large-scale intertidal topography, their accuracy remains heavily dependent on the availability and quality of satellite data. Frequent cloudy and rainy weather in coastal areas presents significant challenges for extracting waterlines from optical images. To address these challenges, this study developed an integrated framework that leverages the complementary strengths of optical and Synthetic Aperture Radar (SAR) imagery, providing an innovative solution to accurately map tidal flat topographies at high spatial resolution. By utilizing the high-precision spatiotemporal distribution results of tidal flats extracted from optical images and integrating tidal constraints and temporal conditions, a cross-modal sample transfer strategy for Optical-SAR imagery was designed, which automatically generates a pseudo-sample library for SAR images. To optimize the automatic extraction of tidal flats in complex SAR imagery environments, we constructed a hybrid semantic segmentation network, UCTCNet. UCTCNet combines the local feature extraction capabilities of convolutional neural networks with the global information focus provided by attention mechanisms. ICESat-2 data was used as altimetry input based on the relationship between tidal flat elevations and inundation frequencies, which was combined with derived inundation frequency maps, low-tide imagery, and spectral indices to accurately invert tidal flat elevations using a random forest algorithm. Experimental results showed that the UCTCNet model demonstrated high potential in processing single-channel, high-noise, weak-feature Sentinel-1 SAR imagery, achieving an IoU of over 0.90, indicating strong performance in extracting high-level semantic features of tidal flats. The elevation inversion framework was validated along the entire coastal region of Jiangsu, China, for multi-temporal and multi-scene analysis. Further validation using generated topographic maps from unmanned aerial vehicle photogrammetry showed superior performance (RMSE = 0.24 m) compared to existing public tidal flat elevation data. The framework was also applied to derive DEMs from 2019 to 2023, revealing significant spatial and elevation changes in the North Jiangsu Radial Sand Ridges. The results further demonstrated the influence of various features, including inundation frequency maps, low-tide imagery, and spectral indices, on elevation inversion accuracy. The integration of S1 SAR data not only improved inversion accuracy but also helped address the limitations associated with discrete frequency data. These findings demonstrate that our proposed framework offers novel insights into high-resolution, large-scale mapping of tidal flat topography.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"225 ","pages":"Pages 69-87"},"PeriodicalIF":10.6000,"publicationDate":"2025-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Tidal flat topography mapping with Sentinel time series using cross-modal sample transfer and deep learning\",\"authors\":\"Pengfei Tang , Shanchuan Guo , Lu Qie , Xingang Zhang , Hong Fang , Liang Wan , Jocelyn Chanussot , Peijun Du\",\"doi\":\"10.1016/j.isprsjprs.2025.04.017\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Tidal flats are crucial components of coastal geomorphic systems, where the ocean meets the land. Timely and accurate topographic maps of tidal flats are essential for sustainable coastal management and development. Although satellite imagery-based inversion methods offer a cost-effective solution for constructing large-scale intertidal topography, their accuracy remains heavily dependent on the availability and quality of satellite data. Frequent cloudy and rainy weather in coastal areas presents significant challenges for extracting waterlines from optical images. To address these challenges, this study developed an integrated framework that leverages the complementary strengths of optical and Synthetic Aperture Radar (SAR) imagery, providing an innovative solution to accurately map tidal flat topographies at high spatial resolution. By utilizing the high-precision spatiotemporal distribution results of tidal flats extracted from optical images and integrating tidal constraints and temporal conditions, a cross-modal sample transfer strategy for Optical-SAR imagery was designed, which automatically generates a pseudo-sample library for SAR images. To optimize the automatic extraction of tidal flats in complex SAR imagery environments, we constructed a hybrid semantic segmentation network, UCTCNet. UCTCNet combines the local feature extraction capabilities of convolutional neural networks with the global information focus provided by attention mechanisms. ICESat-2 data was used as altimetry input based on the relationship between tidal flat elevations and inundation frequencies, which was combined with derived inundation frequency maps, low-tide imagery, and spectral indices to accurately invert tidal flat elevations using a random forest algorithm. Experimental results showed that the UCTCNet model demonstrated high potential in processing single-channel, high-noise, weak-feature Sentinel-1 SAR imagery, achieving an IoU of over 0.90, indicating strong performance in extracting high-level semantic features of tidal flats. The elevation inversion framework was validated along the entire coastal region of Jiangsu, China, for multi-temporal and multi-scene analysis. Further validation using generated topographic maps from unmanned aerial vehicle photogrammetry showed superior performance (RMSE = 0.24 m) compared to existing public tidal flat elevation data. The framework was also applied to derive DEMs from 2019 to 2023, revealing significant spatial and elevation changes in the North Jiangsu Radial Sand Ridges. The results further demonstrated the influence of various features, including inundation frequency maps, low-tide imagery, and spectral indices, on elevation inversion accuracy. The integration of S1 SAR data not only improved inversion accuracy but also helped address the limitations associated with discrete frequency data. These findings demonstrate that our proposed framework offers novel insights into high-resolution, large-scale mapping of tidal flat topography.</div></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":\"225 \",\"pages\":\"Pages 69-87\"},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2025-04-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924271625001558\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271625001558","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
Tidal flat topography mapping with Sentinel time series using cross-modal sample transfer and deep learning
Tidal flats are crucial components of coastal geomorphic systems, where the ocean meets the land. Timely and accurate topographic maps of tidal flats are essential for sustainable coastal management and development. Although satellite imagery-based inversion methods offer a cost-effective solution for constructing large-scale intertidal topography, their accuracy remains heavily dependent on the availability and quality of satellite data. Frequent cloudy and rainy weather in coastal areas presents significant challenges for extracting waterlines from optical images. To address these challenges, this study developed an integrated framework that leverages the complementary strengths of optical and Synthetic Aperture Radar (SAR) imagery, providing an innovative solution to accurately map tidal flat topographies at high spatial resolution. By utilizing the high-precision spatiotemporal distribution results of tidal flats extracted from optical images and integrating tidal constraints and temporal conditions, a cross-modal sample transfer strategy for Optical-SAR imagery was designed, which automatically generates a pseudo-sample library for SAR images. To optimize the automatic extraction of tidal flats in complex SAR imagery environments, we constructed a hybrid semantic segmentation network, UCTCNet. UCTCNet combines the local feature extraction capabilities of convolutional neural networks with the global information focus provided by attention mechanisms. ICESat-2 data was used as altimetry input based on the relationship between tidal flat elevations and inundation frequencies, which was combined with derived inundation frequency maps, low-tide imagery, and spectral indices to accurately invert tidal flat elevations using a random forest algorithm. Experimental results showed that the UCTCNet model demonstrated high potential in processing single-channel, high-noise, weak-feature Sentinel-1 SAR imagery, achieving an IoU of over 0.90, indicating strong performance in extracting high-level semantic features of tidal flats. The elevation inversion framework was validated along the entire coastal region of Jiangsu, China, for multi-temporal and multi-scene analysis. Further validation using generated topographic maps from unmanned aerial vehicle photogrammetry showed superior performance (RMSE = 0.24 m) compared to existing public tidal flat elevation data. The framework was also applied to derive DEMs from 2019 to 2023, revealing significant spatial and elevation changes in the North Jiangsu Radial Sand Ridges. The results further demonstrated the influence of various features, including inundation frequency maps, low-tide imagery, and spectral indices, on elevation inversion accuracy. The integration of S1 SAR data not only improved inversion accuracy but also helped address the limitations associated with discrete frequency data. These findings demonstrate that our proposed framework offers novel insights into high-resolution, large-scale mapping of tidal flat topography.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.