Anis Ur Rahman, Einari Heinaro, Mete Ahishali, Samuli Junttila
{"title":"基于混合自关注U-Nets的航空图像死树检测与分割双任务学习","authors":"Anis Ur Rahman, Einari Heinaro, Mete Ahishali, Samuli Junttila","doi":"10.1016/j.jag.2025.104851","DOIUrl":null,"url":null,"abstract":"<div><div>Mapping standing dead trees is critical for assessing forest health, monitoring biodiversity, and mitigating wildfire risks, for which aerial imagery has proven useful. However, dense canopy structures, spectral overlaps between living and dead vegetation, and over-segmentation errors limit the reliability of existing methods. This study introduces a hybrid post-processing framework that refines deep learning-based tree segmentation by integrating watershed algorithms with adaptive filtering to enhance instance separation and boundary precision. Leveraging a dual-task learning architecture with a Self-Attention U-Net, the framework simultaneously predicts segmentation masks, centroid heatmaps, and hybrid boundary maps, optimizing for both pixel-level accuracy and instance-level detection. Tested on high-resolution aerial imagery from boreal forests, the framework, compared to the U-Net baseline, improved instance-level segmentation accuracy by 41.5% (Tree IoU of 0.3810 vs. 0.2694) and reduced positional errors by 57% (centroid error of 3.70 pixels vs. 5.10 pixels), demonstrating robust performance in the densely vegetated boreal forest regions tested. By balancing detection accuracy (F1-score of 0.5895) and over-segmentation artifacts, the method enabled the accurate identification of individual dead trees, which is critical for ecological monitoring. The framework’s computational efficiency supports scalable applications, such as wall-to-wall tree mortality mapping over large geographic regions using aerial or satellite imagery. These capabilities directly benefit wildfire risk assessment, carbon stock estimation, and precision forestry. This work advances tools for large-scale ecological conservation and climate resilience planning.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"144 ","pages":"Article 104851"},"PeriodicalIF":8.6000,"publicationDate":"2025-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual-task learning for dead tree detection and segmentation with hybrid self-attention U-Nets in aerial imagery\",\"authors\":\"Anis Ur Rahman, Einari Heinaro, Mete Ahishali, Samuli Junttila\",\"doi\":\"10.1016/j.jag.2025.104851\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Mapping standing dead trees is critical for assessing forest health, monitoring biodiversity, and mitigating wildfire risks, for which aerial imagery has proven useful. However, dense canopy structures, spectral overlaps between living and dead vegetation, and over-segmentation errors limit the reliability of existing methods. This study introduces a hybrid post-processing framework that refines deep learning-based tree segmentation by integrating watershed algorithms with adaptive filtering to enhance instance separation and boundary precision. Leveraging a dual-task learning architecture with a Self-Attention U-Net, the framework simultaneously predicts segmentation masks, centroid heatmaps, and hybrid boundary maps, optimizing for both pixel-level accuracy and instance-level detection. Tested on high-resolution aerial imagery from boreal forests, the framework, compared to the U-Net baseline, improved instance-level segmentation accuracy by 41.5% (Tree IoU of 0.3810 vs. 0.2694) and reduced positional errors by 57% (centroid error of 3.70 pixels vs. 5.10 pixels), demonstrating robust performance in the densely vegetated boreal forest regions tested. By balancing detection accuracy (F1-score of 0.5895) and over-segmentation artifacts, the method enabled the accurate identification of individual dead trees, which is critical for ecological monitoring. The framework’s computational efficiency supports scalable applications, such as wall-to-wall tree mortality mapping over large geographic regions using aerial or satellite imagery. These capabilities directly benefit wildfire risk assessment, carbon stock estimation, and precision forestry. This work advances tools for large-scale ecological conservation and climate resilience planning.</div></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"144 \",\"pages\":\"Article 104851\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2025-09-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843225004984\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843225004984","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
Dual-task learning for dead tree detection and segmentation with hybrid self-attention U-Nets in aerial imagery
Mapping standing dead trees is critical for assessing forest health, monitoring biodiversity, and mitigating wildfire risks, for which aerial imagery has proven useful. However, dense canopy structures, spectral overlaps between living and dead vegetation, and over-segmentation errors limit the reliability of existing methods. This study introduces a hybrid post-processing framework that refines deep learning-based tree segmentation by integrating watershed algorithms with adaptive filtering to enhance instance separation and boundary precision. Leveraging a dual-task learning architecture with a Self-Attention U-Net, the framework simultaneously predicts segmentation masks, centroid heatmaps, and hybrid boundary maps, optimizing for both pixel-level accuracy and instance-level detection. Tested on high-resolution aerial imagery from boreal forests, the framework, compared to the U-Net baseline, improved instance-level segmentation accuracy by 41.5% (Tree IoU of 0.3810 vs. 0.2694) and reduced positional errors by 57% (centroid error of 3.70 pixels vs. 5.10 pixels), demonstrating robust performance in the densely vegetated boreal forest regions tested. By balancing detection accuracy (F1-score of 0.5895) and over-segmentation artifacts, the method enabled the accurate identification of individual dead trees, which is critical for ecological monitoring. The framework’s computational efficiency supports scalable applications, such as wall-to-wall tree mortality mapping over large geographic regions using aerial or satellite imagery. These capabilities directly benefit wildfire risk assessment, carbon stock estimation, and precision forestry. This work advances tools for large-scale ecological conservation and climate resilience planning.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.