Daixin Zhao , Konrad Heidler , Milad Asgarimehr , Conrad M. Albrecht , Jens Wickert , Xiao Xiang Zhu , Lichao Mou
{"title":"Multimodal GNSS-R self-supervised learning as a generalist Earth surface monitor","authors":"Daixin Zhao , Konrad Heidler , Milad Asgarimehr , Conrad M. Albrecht , Jens Wickert , Xiao Xiang Zhu , Lichao Mou","doi":"10.1016/j.jag.2025.104658","DOIUrl":null,"url":null,"abstract":"<div><div>The increasing frequency of climate extremes and natural disasters demands rapid and scalable Earth surface scans for effective action. Emerging as a novel remote sensing technique, spaceborne global navigation satellite system reflectometry (GNSS-R) plays an increasingly vital role in monitoring Earth’s surface parameters. Recent studies leverage the growing volume of GNSS-R measurements with data-driven approaches to enhance retrieval products over both ocean and land. Yet, these models are typically trained using supervised learning, which requires extensive feature engineering and application-specific annotations. To address these limitations, we propose the first GNSS-R self-supervised learning framework as a generalist Earth surface monitor (GEM). Our model is pretrained on multimodal observables, i.e., delay-Doppler maps (DDMs) and auxiliary parametric data, to learn cross-modal representations from GNSS-R data. To validate the effectiveness of the proposed approach, we fine-tune the pretrained model on various downstream retrieval tasks, including ocean wind speed retrieval, surface soil moisture estimation, and vegetation water content prediction. The results demonstrate that our framework generalizes well across these tasks, providing a versatile solution for GNSS-R-based Earth surface monitoring and facilitating further exploration of novel use cases.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"142 ","pages":"Article 104658"},"PeriodicalIF":7.6000,"publicationDate":"2025-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S156984322500305X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
引用次数: 0
Abstract
The increasing frequency of climate extremes and natural disasters demands rapid and scalable Earth surface scans for effective action. Emerging as a novel remote sensing technique, spaceborne global navigation satellite system reflectometry (GNSS-R) plays an increasingly vital role in monitoring Earth’s surface parameters. Recent studies leverage the growing volume of GNSS-R measurements with data-driven approaches to enhance retrieval products over both ocean and land. Yet, these models are typically trained using supervised learning, which requires extensive feature engineering and application-specific annotations. To address these limitations, we propose the first GNSS-R self-supervised learning framework as a generalist Earth surface monitor (GEM). Our model is pretrained on multimodal observables, i.e., delay-Doppler maps (DDMs) and auxiliary parametric data, to learn cross-modal representations from GNSS-R data. To validate the effectiveness of the proposed approach, we fine-tune the pretrained model on various downstream retrieval tasks, including ocean wind speed retrieval, surface soil moisture estimation, and vegetation water content prediction. The results demonstrate that our framework generalizes well across these tasks, providing a versatile solution for GNSS-R-based Earth surface monitoring and facilitating further exploration of novel use cases.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.