基于检测变压器的高分辨率卫星影像森林外树木制图方法

IF 5.8 2区 环境科学与生态学 Q1 ECOLOGY
Tao Jiang , Maximilian Freudenberg , Christoph Kleinn , Timo Lüddecke , Alexander Ecker , Nils Nölke
{"title":"基于检测变压器的高分辨率卫星影像森林外树木制图方法","authors":"Tao Jiang ,&nbsp;Maximilian Freudenberg ,&nbsp;Christoph Kleinn ,&nbsp;Timo Lüddecke ,&nbsp;Alexander Ecker ,&nbsp;Nils Nölke","doi":"10.1016/j.ecoinf.2025.103114","DOIUrl":null,"url":null,"abstract":"<div><div>High-resolution satellite imagery is a crucial data source for comprehensive trees outside forests (TOF) mapping at various spatial scales. Accurate identification of individual trees in satellite imagery remains challenging due to the heterogeneous nature of tree crowns, spectral similarities with other vegetation and the necessity to process large areas. The emergence of deep learning techniques, such as detection transformer models (DETR), offers new ways to analyse images more efficiently and accurately. In this study, we proposed an end-to-end approach for large-area TOF detection based on an established detection transformer architecture, specifically DETR with Improved deNoising anchOr boxes (DINO). We labelled 23,643 tree crowns with bounding boxes in 330 WorldView-3 image patches from the megacity of Bengaluru, India. Using this dataset, we trained and tested DINO for individual tree detection. In addition, we adopted a two-level tiling scheme and developed an R-tree-based Box Merging method to adapt to large images and remove redundant predictions more efficiently. Comparative analyses underscore the superior detection performance of DINO with a SWIN transformer as backbone, exhibiting an F1 score of 74% and an AP of 76%, surpassing other models such as Faster RCNN, YOLO, RetinaNet, DETR, Deformable-DETR, and DINO-Res50. For further validation we evaluated the proposed detection approach in two additional locations, Delhi and Shanghai, with varying image quality, achieving F1 scores of 87% and 73%, respectively. Our work advances remote sensing applications by providing a robust solution for large-scale TOF mapping and management.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"87 ","pages":"Article 103114"},"PeriodicalIF":5.8000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Detection transformer-based approach for mapping trees outside forests on high resolution satellite imagery\",\"authors\":\"Tao Jiang ,&nbsp;Maximilian Freudenberg ,&nbsp;Christoph Kleinn ,&nbsp;Timo Lüddecke ,&nbsp;Alexander Ecker ,&nbsp;Nils Nölke\",\"doi\":\"10.1016/j.ecoinf.2025.103114\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>High-resolution satellite imagery is a crucial data source for comprehensive trees outside forests (TOF) mapping at various spatial scales. Accurate identification of individual trees in satellite imagery remains challenging due to the heterogeneous nature of tree crowns, spectral similarities with other vegetation and the necessity to process large areas. The emergence of deep learning techniques, such as detection transformer models (DETR), offers new ways to analyse images more efficiently and accurately. In this study, we proposed an end-to-end approach for large-area TOF detection based on an established detection transformer architecture, specifically DETR with Improved deNoising anchOr boxes (DINO). We labelled 23,643 tree crowns with bounding boxes in 330 WorldView-3 image patches from the megacity of Bengaluru, India. Using this dataset, we trained and tested DINO for individual tree detection. In addition, we adopted a two-level tiling scheme and developed an R-tree-based Box Merging method to adapt to large images and remove redundant predictions more efficiently. Comparative analyses underscore the superior detection performance of DINO with a SWIN transformer as backbone, exhibiting an F1 score of 74% and an AP of 76%, surpassing other models such as Faster RCNN, YOLO, RetinaNet, DETR, Deformable-DETR, and DINO-Res50. For further validation we evaluated the proposed detection approach in two additional locations, Delhi and Shanghai, with varying image quality, achieving F1 scores of 87% and 73%, respectively. Our work advances remote sensing applications by providing a robust solution for large-scale TOF mapping and management.</div></div>\",\"PeriodicalId\":51024,\"journal\":{\"name\":\"Ecological Informatics\",\"volume\":\"87 \",\"pages\":\"Article 103114\"},\"PeriodicalIF\":5.8000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ecological Informatics\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1574954125001232\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954125001232","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

高分辨率卫星影像是不同空间尺度林外树木综合制图的重要数据来源。由于树冠的异质性、与其他植被的光谱相似性以及处理大面积植被的必要性,在卫星图像中准确识别单个树木仍然具有挑战性。深度学习技术的出现,如检测变压器模型(DETR),提供了更有效、更准确地分析图像的新方法。在这项研究中,我们提出了一种基于已建立的检测变压器架构的大面积TOF检测的端到端方法,特别是带有改进去噪锚盒(DINO)的DETR。我们用边界框标记了来自印度班加罗尔的330个WorldView-3图像补丁中的23,643个树冠。使用该数据集,我们训练并测试了DINO对单个树的检测。此外,我们采用了两级平铺方案,并开发了一种基于r树的Box merged方法,以更有效地适应大图像并去除冗余预测。对比分析表明,以SWIN变压器为主干的DINO具有优越的检测性能,其F1得分为74%,AP为76%,超过了Faster RCNN、YOLO、RetinaNet、DETR、deform -DETR和DINO- res50等其他模型。为了进一步验证,我们在另外两个不同图像质量的地点(德里和上海)评估了所提出的检测方法,分别获得了87%和73%的F1分数。我们的工作通过为大规模TOF测绘和管理提供强大的解决方案来推进遥感应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Detection transformer-based approach for mapping trees outside forests on high resolution satellite imagery
High-resolution satellite imagery is a crucial data source for comprehensive trees outside forests (TOF) mapping at various spatial scales. Accurate identification of individual trees in satellite imagery remains challenging due to the heterogeneous nature of tree crowns, spectral similarities with other vegetation and the necessity to process large areas. The emergence of deep learning techniques, such as detection transformer models (DETR), offers new ways to analyse images more efficiently and accurately. In this study, we proposed an end-to-end approach for large-area TOF detection based on an established detection transformer architecture, specifically DETR with Improved deNoising anchOr boxes (DINO). We labelled 23,643 tree crowns with bounding boxes in 330 WorldView-3 image patches from the megacity of Bengaluru, India. Using this dataset, we trained and tested DINO for individual tree detection. In addition, we adopted a two-level tiling scheme and developed an R-tree-based Box Merging method to adapt to large images and remove redundant predictions more efficiently. Comparative analyses underscore the superior detection performance of DINO with a SWIN transformer as backbone, exhibiting an F1 score of 74% and an AP of 76%, surpassing other models such as Faster RCNN, YOLO, RetinaNet, DETR, Deformable-DETR, and DINO-Res50. For further validation we evaluated the proposed detection approach in two additional locations, Delhi and Shanghai, with varying image quality, achieving F1 scores of 87% and 73%, respectively. Our work advances remote sensing applications by providing a robust solution for large-scale TOF mapping and management.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Ecological Informatics
Ecological Informatics 环境科学-生态学
CiteScore
8.30
自引率
11.80%
发文量
346
审稿时长
46 days
期刊介绍: The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change. The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信