基于Google Earth Engine的Sentinel-1地表水制图深度学习方法

Timothy Mayer , Ate Poortinga , Biplov Bhandari , Andrea P. Nicolau , Kel Markert , Nyein Soe Thwal , Amanda Markert , Arjen Haag , John Kilbride , Farrukh Chishtie , Amit Wadhwa , Nicholas Clinton , David Saah
{"title":"基于Google Earth Engine的Sentinel-1地表水制图深度学习方法","authors":"Timothy Mayer ,&nbsp;Ate Poortinga ,&nbsp;Biplov Bhandari ,&nbsp;Andrea P. Nicolau ,&nbsp;Kel Markert ,&nbsp;Nyein Soe Thwal ,&nbsp;Amanda Markert ,&nbsp;Arjen Haag ,&nbsp;John Kilbride ,&nbsp;Farrukh Chishtie ,&nbsp;Amit Wadhwa ,&nbsp;Nicholas Clinton ,&nbsp;David Saah","doi":"10.1016/j.ophoto.2021.100005","DOIUrl":null,"url":null,"abstract":"<div><p>Satellite remote sensing plays an important role in mapping the location and extent of surface water. A variety of approaches are available for mapping surface water, but deep learning approaches are not commonplace as they are ‘data hungry’ and require large amounts of computational resources. However, with the availability of various satellite sensors and rapid development in cloud computing, the remote sensing scientific community is adapting modern deep learning approaches. The new integration of cloud-based Google AI platform and Google Earth Engine enables users to deploy calculations at scale. In this paper, we investigate two methods of automatic data labeling: 1. the Joint Research Centre (JRC) surface water maps; 2. an Edge-Otsu dynamic threshold approach. We deployed a U-Net convolutional neural network to map surface water from Sentinel-1 Synthetic Aperture Radar (SAR) data and tested the model performance using different hyperparameter tuning combinations to identify the optimal learning rate and loss function. The performance was then evaluated using an independent validation data set. We tested 12 models overall and found that the models utilizing the JRC data labels showed a better model performance, with F1-scores ranging from 0.972 to 0.986 for the training test and validation efforts. Additionally, an independently sampled high-resolution data set was used to further evaluate model performance. From this independent validation effort we observed models leveraging JRC data labels produced F1-Scores ranging from 0.9130.922. A pairwise comparison of models, through varying input data, learning rates, and loss functions constituents, revealed the JRC Adjusted Binary Cross Entropy Dice model to be statistically different than the 66 other model combinations and displayed the highest relative evaluations metrics including accuracy, precision score, Cohen Kappa coefficient, and F1-score. These results are in the same range as many of the conventional methods. We observed that the integration of Google AI Platform into Google Earth Engine can be a powerful tool to deploy deep-learning algorithms at scale and that automatic data labeling can be an effective strategy in the development of deep-learning models, however independent data validation remains an important step in model evaluation.</p></div>","PeriodicalId":100730,"journal":{"name":"ISPRS Open Journal of Photogrammetry and Remote Sensing","volume":"2 ","pages":"Article 100005"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667393221000053/pdfft?md5=89bd0904ac557bdf32d929ccca7af5da&pid=1-s2.0-S2667393221000053-main.pdf","citationCount":"25","resultStr":"{\"title\":\"Deep learning approach for Sentinel-1 surface water mapping leveraging Google Earth Engine\",\"authors\":\"Timothy Mayer ,&nbsp;Ate Poortinga ,&nbsp;Biplov Bhandari ,&nbsp;Andrea P. Nicolau ,&nbsp;Kel Markert ,&nbsp;Nyein Soe Thwal ,&nbsp;Amanda Markert ,&nbsp;Arjen Haag ,&nbsp;John Kilbride ,&nbsp;Farrukh Chishtie ,&nbsp;Amit Wadhwa ,&nbsp;Nicholas Clinton ,&nbsp;David Saah\",\"doi\":\"10.1016/j.ophoto.2021.100005\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Satellite remote sensing plays an important role in mapping the location and extent of surface water. A variety of approaches are available for mapping surface water, but deep learning approaches are not commonplace as they are ‘data hungry’ and require large amounts of computational resources. However, with the availability of various satellite sensors and rapid development in cloud computing, the remote sensing scientific community is adapting modern deep learning approaches. The new integration of cloud-based Google AI platform and Google Earth Engine enables users to deploy calculations at scale. In this paper, we investigate two methods of automatic data labeling: 1. the Joint Research Centre (JRC) surface water maps; 2. an Edge-Otsu dynamic threshold approach. We deployed a U-Net convolutional neural network to map surface water from Sentinel-1 Synthetic Aperture Radar (SAR) data and tested the model performance using different hyperparameter tuning combinations to identify the optimal learning rate and loss function. The performance was then evaluated using an independent validation data set. We tested 12 models overall and found that the models utilizing the JRC data labels showed a better model performance, with F1-scores ranging from 0.972 to 0.986 for the training test and validation efforts. Additionally, an independently sampled high-resolution data set was used to further evaluate model performance. From this independent validation effort we observed models leveraging JRC data labels produced F1-Scores ranging from 0.9130.922. A pairwise comparison of models, through varying input data, learning rates, and loss functions constituents, revealed the JRC Adjusted Binary Cross Entropy Dice model to be statistically different than the 66 other model combinations and displayed the highest relative evaluations metrics including accuracy, precision score, Cohen Kappa coefficient, and F1-score. These results are in the same range as many of the conventional methods. We observed that the integration of Google AI Platform into Google Earth Engine can be a powerful tool to deploy deep-learning algorithms at scale and that automatic data labeling can be an effective strategy in the development of deep-learning models, however independent data validation remains an important step in model evaluation.</p></div>\",\"PeriodicalId\":100730,\"journal\":{\"name\":\"ISPRS Open Journal of Photogrammetry and Remote Sensing\",\"volume\":\"2 \",\"pages\":\"Article 100005\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2667393221000053/pdfft?md5=89bd0904ac557bdf32d929ccca7af5da&pid=1-s2.0-S2667393221000053-main.pdf\",\"citationCount\":\"25\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Open Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2667393221000053\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Open Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2667393221000053","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 25

摘要

卫星遥感在绘制地表水的位置和范围方面起着重要作用。有多种方法可用于绘制地表水,但深度学习方法并不常见,因为它们“数据饥渴”,需要大量的计算资源。然而,随着各种卫星传感器的可用性和云计算的快速发展,遥感科学界正在适应现代深度学习方法。基于云的谷歌人工智能平台和谷歌地球引擎的新集成使用户能够大规模部署计算。本文主要研究了两种数据自动标注方法:1.数据自动标注;联合研究中心的地表水地图;2. Edge-Otsu动态阈值方法。我们部署了一个U-Net卷积神经网络,从Sentinel-1合成孔径雷达(SAR)数据中绘制地表水图,并使用不同的超参数调谐组合来测试模型的性能,以确定最佳学习率和损失函数。然后使用独立的验证数据集对性能进行评估。我们对12个模型进行了整体测试,发现使用JRC数据标签的模型表现出更好的模型性能,在训练测试和验证方面的f1得分在0.972到0.986之间。此外,使用独立采样的高分辨率数据集进一步评估模型性能。从这个独立的验证工作中,我们观察到利用JRC数据标签的模型产生了F1-Scores,范围从0.9130.922。通过不同的输入数据、学习率和损失函数组成对模型进行两两比较,发现JRC调整二进制交叉熵骰子模型在统计上与其他66种模型组合不同,并显示出最高的相对评价指标,包括准确性、精度分数、科恩卡帕系数和f1分数。这些结果与许多传统方法在相同的范围内。我们观察到,将Google AI平台集成到Google Earth Engine中可以成为大规模部署深度学习算法的强大工具,自动数据标记可以成为开发深度学习模型的有效策略,但是独立数据验证仍然是模型评估的重要步骤。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep learning approach for Sentinel-1 surface water mapping leveraging Google Earth Engine

Satellite remote sensing plays an important role in mapping the location and extent of surface water. A variety of approaches are available for mapping surface water, but deep learning approaches are not commonplace as they are ‘data hungry’ and require large amounts of computational resources. However, with the availability of various satellite sensors and rapid development in cloud computing, the remote sensing scientific community is adapting modern deep learning approaches. The new integration of cloud-based Google AI platform and Google Earth Engine enables users to deploy calculations at scale. In this paper, we investigate two methods of automatic data labeling: 1. the Joint Research Centre (JRC) surface water maps; 2. an Edge-Otsu dynamic threshold approach. We deployed a U-Net convolutional neural network to map surface water from Sentinel-1 Synthetic Aperture Radar (SAR) data and tested the model performance using different hyperparameter tuning combinations to identify the optimal learning rate and loss function. The performance was then evaluated using an independent validation data set. We tested 12 models overall and found that the models utilizing the JRC data labels showed a better model performance, with F1-scores ranging from 0.972 to 0.986 for the training test and validation efforts. Additionally, an independently sampled high-resolution data set was used to further evaluate model performance. From this independent validation effort we observed models leveraging JRC data labels produced F1-Scores ranging from 0.9130.922. A pairwise comparison of models, through varying input data, learning rates, and loss functions constituents, revealed the JRC Adjusted Binary Cross Entropy Dice model to be statistically different than the 66 other model combinations and displayed the highest relative evaluations metrics including accuracy, precision score, Cohen Kappa coefficient, and F1-score. These results are in the same range as many of the conventional methods. We observed that the integration of Google AI Platform into Google Earth Engine can be a powerful tool to deploy deep-learning algorithms at scale and that automatic data labeling can be an effective strategy in the development of deep-learning models, however independent data validation remains an important step in model evaluation.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
5.10
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信