使用跨模态样本转移和深度学习的哨兵时间序列测绘潮坪地形

IF 10.6 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL
Pengfei Tang , Shanchuan Guo , Lu Qie , Xingang Zhang , Hong Fang , Liang Wan , Jocelyn Chanussot , Peijun Du
{"title":"使用跨模态样本转移和深度学习的哨兵时间序列测绘潮坪地形","authors":"Pengfei Tang ,&nbsp;Shanchuan Guo ,&nbsp;Lu Qie ,&nbsp;Xingang Zhang ,&nbsp;Hong Fang ,&nbsp;Liang Wan ,&nbsp;Jocelyn Chanussot ,&nbsp;Peijun Du","doi":"10.1016/j.isprsjprs.2025.04.017","DOIUrl":null,"url":null,"abstract":"<div><div>Tidal flats are crucial components of coastal geomorphic systems, where the ocean meets the land. Timely and accurate topographic maps of tidal flats are essential for sustainable coastal management and development. Although satellite imagery-based inversion methods offer a cost-effective solution for constructing large-scale intertidal topography, their accuracy remains heavily dependent on the availability and quality of satellite data. Frequent cloudy and rainy weather in coastal areas presents significant challenges for extracting waterlines from optical images. To address these challenges, this study developed an integrated framework that leverages the complementary strengths of optical and Synthetic Aperture Radar (SAR) imagery, providing an innovative solution to accurately map tidal flat topographies at high spatial resolution. By utilizing the high-precision spatiotemporal distribution results of tidal flats extracted from optical images and integrating tidal constraints and temporal conditions, a cross-modal sample transfer strategy for Optical-SAR imagery was designed, which automatically generates a pseudo-sample library for SAR images. To optimize the automatic extraction of tidal flats in complex SAR imagery environments, we constructed a hybrid semantic segmentation network, UCTCNet. UCTCNet combines the local feature extraction capabilities of convolutional neural networks with the global information focus provided by attention mechanisms. ICESat-2 data was used as altimetry input based on the relationship between tidal flat elevations and inundation frequencies, which was combined with derived inundation frequency maps, low-tide imagery, and spectral indices to accurately invert tidal flat elevations using a random forest algorithm. Experimental results showed that the UCTCNet model demonstrated high potential in processing single-channel, high-noise, weak-feature Sentinel-1 SAR imagery, achieving an IoU of over 0.90, indicating strong performance in extracting high-level semantic features of tidal flats. The elevation inversion framework was validated along the entire coastal region of Jiangsu, China, for multi-temporal and multi-scene analysis. Further validation using generated topographic maps from unmanned aerial vehicle photogrammetry showed superior performance (RMSE = 0.24 m) compared to existing public tidal flat elevation data. The framework was also applied to derive DEMs from 2019 to 2023, revealing significant spatial and elevation changes in the North Jiangsu Radial Sand Ridges. The results further demonstrated the influence of various features, including inundation frequency maps, low-tide imagery, and spectral indices, on elevation inversion accuracy. The integration of S1 SAR data not only improved inversion accuracy but also helped address the limitations associated with discrete frequency data. These findings demonstrate that our proposed framework offers novel insights into high-resolution, large-scale mapping of tidal flat topography.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"225 ","pages":"Pages 69-87"},"PeriodicalIF":10.6000,"publicationDate":"2025-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Tidal flat topography mapping with Sentinel time series using cross-modal sample transfer and deep learning\",\"authors\":\"Pengfei Tang ,&nbsp;Shanchuan Guo ,&nbsp;Lu Qie ,&nbsp;Xingang Zhang ,&nbsp;Hong Fang ,&nbsp;Liang Wan ,&nbsp;Jocelyn Chanussot ,&nbsp;Peijun Du\",\"doi\":\"10.1016/j.isprsjprs.2025.04.017\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Tidal flats are crucial components of coastal geomorphic systems, where the ocean meets the land. Timely and accurate topographic maps of tidal flats are essential for sustainable coastal management and development. Although satellite imagery-based inversion methods offer a cost-effective solution for constructing large-scale intertidal topography, their accuracy remains heavily dependent on the availability and quality of satellite data. Frequent cloudy and rainy weather in coastal areas presents significant challenges for extracting waterlines from optical images. To address these challenges, this study developed an integrated framework that leverages the complementary strengths of optical and Synthetic Aperture Radar (SAR) imagery, providing an innovative solution to accurately map tidal flat topographies at high spatial resolution. By utilizing the high-precision spatiotemporal distribution results of tidal flats extracted from optical images and integrating tidal constraints and temporal conditions, a cross-modal sample transfer strategy for Optical-SAR imagery was designed, which automatically generates a pseudo-sample library for SAR images. To optimize the automatic extraction of tidal flats in complex SAR imagery environments, we constructed a hybrid semantic segmentation network, UCTCNet. UCTCNet combines the local feature extraction capabilities of convolutional neural networks with the global information focus provided by attention mechanisms. ICESat-2 data was used as altimetry input based on the relationship between tidal flat elevations and inundation frequencies, which was combined with derived inundation frequency maps, low-tide imagery, and spectral indices to accurately invert tidal flat elevations using a random forest algorithm. Experimental results showed that the UCTCNet model demonstrated high potential in processing single-channel, high-noise, weak-feature Sentinel-1 SAR imagery, achieving an IoU of over 0.90, indicating strong performance in extracting high-level semantic features of tidal flats. The elevation inversion framework was validated along the entire coastal region of Jiangsu, China, for multi-temporal and multi-scene analysis. Further validation using generated topographic maps from unmanned aerial vehicle photogrammetry showed superior performance (RMSE = 0.24 m) compared to existing public tidal flat elevation data. The framework was also applied to derive DEMs from 2019 to 2023, revealing significant spatial and elevation changes in the North Jiangsu Radial Sand Ridges. The results further demonstrated the influence of various features, including inundation frequency maps, low-tide imagery, and spectral indices, on elevation inversion accuracy. The integration of S1 SAR data not only improved inversion accuracy but also helped address the limitations associated with discrete frequency data. These findings demonstrate that our proposed framework offers novel insights into high-resolution, large-scale mapping of tidal flat topography.</div></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":\"225 \",\"pages\":\"Pages 69-87\"},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2025-04-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924271625001558\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271625001558","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

潮滩是海岸地貌系统的重要组成部分,是海洋与陆地的交汇处。及时和准确的潮滩地形图对可持续的沿海管理和发展至关重要。尽管基于卫星图像的反演方法为构建大尺度潮间带地形提供了一种经济有效的解决方案,但其精度仍然严重依赖于卫星数据的可用性和质量。沿海地区多云多雨天气频繁,对从光学图像中提取水线提出了重大挑战。为了应对这些挑战,本研究开发了一个综合框架,利用光学和合成孔径雷达(SAR)图像的互补优势,提供了一个创新的解决方案,以高空间分辨率精确绘制潮滩地形。利用从光学影像中提取的高精度潮滩时空分布结果,综合潮汐约束条件和时间条件,设计了一种光学-SAR影像跨模态样本转移策略,自动生成SAR影像伪样本库。为了优化复杂SAR图像环境下潮汐滩的自动提取,我们构建了一个混合语义分割网络UCTCNet。UCTCNet结合了卷积神经网络的局部特征提取能力和注意机制提供的全局信息焦点。基于潮滩高程与淹没频率的关系,利用ICESat-2数据作为高程输入,结合衍生的淹没频率图、低潮影像和光谱指数,利用随机森林算法精确反演潮滩高程。实验结果表明,UCTCNet模型在处理单通道、高噪声、弱特征的Sentinel-1 SAR图像方面表现出很高的潜力,IoU超过0.90,表明该模型在提取潮滩高级语义特征方面具有较强的性能。在整个江苏沿海地区对高程反演框架进行了多时相、多场景的验证。使用无人机摄影测量生成的地形图进行进一步验证,与现有的公共潮坪高程数据相比,显示出优越的性能(RMSE = 0.24 m)。该框架还应用于2019 - 2023年的dem,揭示了苏北辐射状砂脊的显著空间和高程变化。结果进一步证明了淹没频率图、低潮影像和光谱指数等各种特征对高程反演精度的影响。S1 SAR数据的整合不仅提高了反演精度,而且有助于解决离散频率数据的局限性。这些发现表明,我们提出的框架为高分辨率、大规模的潮坪地形测绘提供了新的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Tidal flat topography mapping with Sentinel time series using cross-modal sample transfer and deep learning
Tidal flats are crucial components of coastal geomorphic systems, where the ocean meets the land. Timely and accurate topographic maps of tidal flats are essential for sustainable coastal management and development. Although satellite imagery-based inversion methods offer a cost-effective solution for constructing large-scale intertidal topography, their accuracy remains heavily dependent on the availability and quality of satellite data. Frequent cloudy and rainy weather in coastal areas presents significant challenges for extracting waterlines from optical images. To address these challenges, this study developed an integrated framework that leverages the complementary strengths of optical and Synthetic Aperture Radar (SAR) imagery, providing an innovative solution to accurately map tidal flat topographies at high spatial resolution. By utilizing the high-precision spatiotemporal distribution results of tidal flats extracted from optical images and integrating tidal constraints and temporal conditions, a cross-modal sample transfer strategy for Optical-SAR imagery was designed, which automatically generates a pseudo-sample library for SAR images. To optimize the automatic extraction of tidal flats in complex SAR imagery environments, we constructed a hybrid semantic segmentation network, UCTCNet. UCTCNet combines the local feature extraction capabilities of convolutional neural networks with the global information focus provided by attention mechanisms. ICESat-2 data was used as altimetry input based on the relationship between tidal flat elevations and inundation frequencies, which was combined with derived inundation frequency maps, low-tide imagery, and spectral indices to accurately invert tidal flat elevations using a random forest algorithm. Experimental results showed that the UCTCNet model demonstrated high potential in processing single-channel, high-noise, weak-feature Sentinel-1 SAR imagery, achieving an IoU of over 0.90, indicating strong performance in extracting high-level semantic features of tidal flats. The elevation inversion framework was validated along the entire coastal region of Jiangsu, China, for multi-temporal and multi-scene analysis. Further validation using generated topographic maps from unmanned aerial vehicle photogrammetry showed superior performance (RMSE = 0.24 m) compared to existing public tidal flat elevation data. The framework was also applied to derive DEMs from 2019 to 2023, revealing significant spatial and elevation changes in the North Jiangsu Radial Sand Ridges. The results further demonstrated the influence of various features, including inundation frequency maps, low-tide imagery, and spectral indices, on elevation inversion accuracy. The integration of S1 SAR data not only improved inversion accuracy but also helped address the limitations associated with discrete frequency data. These findings demonstrate that our proposed framework offers novel insights into high-resolution, large-scale mapping of tidal flat topography.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ISPRS Journal of Photogrammetry and Remote Sensing
ISPRS Journal of Photogrammetry and Remote Sensing 工程技术-成像科学与照相技术
CiteScore
21.00
自引率
6.30%
发文量
273
审稿时长
40 days
期刊介绍: The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive. P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields. In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信