Building up a data engine for global urban mapping

IF 11.1 1区 地球科学 Q1 ENVIRONMENTAL SCIENCES
Yuhan Zhou , Qihao Weng
{"title":"Building up a data engine for global urban mapping","authors":"Yuhan Zhou ,&nbsp;Qihao Weng","doi":"10.1016/j.rse.2024.114242","DOIUrl":null,"url":null,"abstract":"<div><p>Global urban mapping is vital for understanding various environmental challenges and supporting Sustainable Development Goal 11. Although deep learning models present a potential unified solution, their effectiveness is intrinsically tied to the quality and diversity of the training data, which often present limitations in existing research. To overcome these limitations, this paper introduced a data engine tailored to generate high-quality and diverse training samples at the global scale. This semi-automatic procedure operated in two stages. The initial stage focused on the generation of globally-distributed accurate samples by harmonizing existing open-source datasets. The subsequent stage broadened the sample coverage to the global scale by leveraging published global data products and OpenStreetMap data, ensuring the sample's diversity. Using the dataset generated by the data engine, we trained a Global Urban Mapper (GUM), achieving superior global testing results, outperforming the second-best product (i.e., GISA-10) by 2.89% in Overall Accuracy (OA) and 5.92% in mean Intersection over Union (mIoU). The advancements can primarily be ascribed to the superior quality and heterogeneity of the data generated by the proposed data engine, providing a precise and diverse set of samples for the deep learning model to assimilate. The proposed data engine, built exclusively on open-source data, offers promising prospects for global mapping tasks beyond urban land cover. We will release GUM and the associated preprocessing code in <span>https://github.com/LauraChow77/GlobalUrbanMapper</span><svg><path></path></svg>, which will empower users to map specific areas of interest worldwide, thereby facilitating timely urban assessment and monitoring.</p></div>","PeriodicalId":417,"journal":{"name":"Remote Sensing of Environment","volume":null,"pages":null},"PeriodicalIF":11.1000,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0034425724002608/pdfft?md5=dcc3beb49c0bb8e6364869c6b4c08920&pid=1-s2.0-S0034425724002608-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Remote Sensing of Environment","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0034425724002608","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Global urban mapping is vital for understanding various environmental challenges and supporting Sustainable Development Goal 11. Although deep learning models present a potential unified solution, their effectiveness is intrinsically tied to the quality and diversity of the training data, which often present limitations in existing research. To overcome these limitations, this paper introduced a data engine tailored to generate high-quality and diverse training samples at the global scale. This semi-automatic procedure operated in two stages. The initial stage focused on the generation of globally-distributed accurate samples by harmonizing existing open-source datasets. The subsequent stage broadened the sample coverage to the global scale by leveraging published global data products and OpenStreetMap data, ensuring the sample's diversity. Using the dataset generated by the data engine, we trained a Global Urban Mapper (GUM), achieving superior global testing results, outperforming the second-best product (i.e., GISA-10) by 2.89% in Overall Accuracy (OA) and 5.92% in mean Intersection over Union (mIoU). The advancements can primarily be ascribed to the superior quality and heterogeneity of the data generated by the proposed data engine, providing a precise and diverse set of samples for the deep learning model to assimilate. The proposed data engine, built exclusively on open-source data, offers promising prospects for global mapping tasks beyond urban land cover. We will release GUM and the associated preprocessing code in https://github.com/LauraChow77/GlobalUrbanMapper, which will empower users to map specific areas of interest worldwide, thereby facilitating timely urban assessment and monitoring.

为全球城市制图建立数据引擎
全球城市地图对于了解各种环境挑战和支持可持续发展目标 11 至关重要。虽然深度学习模型提供了一种潜在的统一解决方案,但其有效性与训练数据的质量和多样性有着内在联系,而这在现有研究中往往存在局限性。为了克服这些局限性,本文引入了一个数据引擎,专门用于在全球范围内生成高质量和多样化的训练样本。这种半自动程序分两个阶段运行。第一阶段的重点是通过协调现有的开源数据集,生成全球分布的精确样本。随后的阶段利用已发布的全球数据产品和 OpenStreetMap 数据,将样本覆盖范围扩大到全球范围,确保样本的多样性。利用数据引擎生成的数据集,我们训练了全球城市映射器(GUM),取得了优异的全球测试结果,在总体准确率(OA)和平均交叉点超过联盟率(mIoU)方面分别比排名第二的产品(即 GISA-10)高出 2.89% 和 5.92%。这些进步主要归功于所提出的数据引擎生成的数据质量上乘、异质性高,为深度学习模型提供了一组精确而多样的样本。拟议的数据引擎完全基于开源数据构建,为城市土地覆盖以外的全球制图任务提供了广阔的前景。我们将在 https://github.com/LauraChow77/GlobalUrbanMapper 上发布 GUM 和相关的预处理代码,这将使用户有能力绘制全球范围内特定区域的地图,从而促进及时的城市评估和监测。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Remote Sensing of Environment
Remote Sensing of Environment 环境科学-成像科学与照相技术
CiteScore
25.10
自引率
8.90%
发文量
455
审稿时长
53 days
期刊介绍: Remote Sensing of Environment (RSE) serves the Earth observation community by disseminating results on the theory, science, applications, and technology that contribute to advancing the field of remote sensing. With a thoroughly interdisciplinary approach, RSE encompasses terrestrial, oceanic, and atmospheric sensing. The journal emphasizes biophysical and quantitative approaches to remote sensing at local to global scales, covering a diverse range of applications and techniques. RSE serves as a vital platform for the exchange of knowledge and advancements in the dynamic field of remote sensing.
文献相关原料
公司名称 产品信息 采购帮参考价格
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信