Hadi Yazdi , Kai Zhe Boey , Thomas Rötzer , Frank Petzold , Qiguan Shu , Ferdinand Ludwig
{"title":"利用图结构数据和神经网络自动进行树种分类","authors":"Hadi Yazdi , Kai Zhe Boey , Thomas Rötzer , Frank Petzold , Qiguan Shu , Ferdinand Ludwig","doi":"10.1016/j.ecoinf.2024.102874","DOIUrl":null,"url":null,"abstract":"<div><div>The classification of tree species in urban contexts is pivotal in assessing ecosystem services and fostering sustainable urban development. This paper explores using graph neural networks (GNNs) on graph structure data derived from quantitative structure models (QSMs) and tree structural measurement for appropriate species classification. The study addresses gaps in existing methods by integrating relationships between tree components, such as branches and cylinders, and considering the entire tree structure in a novel graph data format. The results demonstrate the efficacy of GNNs, particularly the Gated Graph Convolutional Network (GatedGCN), in appropriately classifying urban tree species. It gained an overall classification accuracy and weighted F1 score of 0.84. An analysis of confusion matrices revealed similarities in visual characteristics among several species, including <em>A. platanoides</em> and <em>T. cordata</em>, which pose significant challenges in accurately distinguishing between them. However, certain species, such as <em>A. hippocastanum</em> and <em>P. nigra var. italica</em>, have proved easier to classify than others. Furthermore, the results highlight the importance of relationships between different tree components in species recognition, such as the ratio between branch radius and parent branch radius, the factors often overlooked by previous methods. This underscores the novelty and effectiveness of the proposed approach in this study. Future research could explore integrating additional data sources, such as Leaf Area Density (LAD) calculated from LiDAR and hyperspectral data, to enhance classification accuracy. In conclusion, the evaluation results of the GatedGCN model demonstrated its effectiveness in classifying tree species using a novel data structure format derived from QSM tree characteristics. Advancing urban tree species classification through such methods can enhance future urban tree management using automated AI and robotics solutions.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"84 ","pages":"Article 102874"},"PeriodicalIF":5.8000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automated classification of tree species using graph structure data and neural networks\",\"authors\":\"Hadi Yazdi , Kai Zhe Boey , Thomas Rötzer , Frank Petzold , Qiguan Shu , Ferdinand Ludwig\",\"doi\":\"10.1016/j.ecoinf.2024.102874\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The classification of tree species in urban contexts is pivotal in assessing ecosystem services and fostering sustainable urban development. This paper explores using graph neural networks (GNNs) on graph structure data derived from quantitative structure models (QSMs) and tree structural measurement for appropriate species classification. The study addresses gaps in existing methods by integrating relationships between tree components, such as branches and cylinders, and considering the entire tree structure in a novel graph data format. The results demonstrate the efficacy of GNNs, particularly the Gated Graph Convolutional Network (GatedGCN), in appropriately classifying urban tree species. It gained an overall classification accuracy and weighted F1 score of 0.84. An analysis of confusion matrices revealed similarities in visual characteristics among several species, including <em>A. platanoides</em> and <em>T. cordata</em>, which pose significant challenges in accurately distinguishing between them. However, certain species, such as <em>A. hippocastanum</em> and <em>P. nigra var. italica</em>, have proved easier to classify than others. Furthermore, the results highlight the importance of relationships between different tree components in species recognition, such as the ratio between branch radius and parent branch radius, the factors often overlooked by previous methods. This underscores the novelty and effectiveness of the proposed approach in this study. Future research could explore integrating additional data sources, such as Leaf Area Density (LAD) calculated from LiDAR and hyperspectral data, to enhance classification accuracy. In conclusion, the evaluation results of the GatedGCN model demonstrated its effectiveness in classifying tree species using a novel data structure format derived from QSM tree characteristics. Advancing urban tree species classification through such methods can enhance future urban tree management using automated AI and robotics solutions.</div></div>\",\"PeriodicalId\":51024,\"journal\":{\"name\":\"Ecological Informatics\",\"volume\":\"84 \",\"pages\":\"Article 102874\"},\"PeriodicalIF\":5.8000,\"publicationDate\":\"2024-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ecological Informatics\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1574954124004163\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124004163","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
城市环境中的树种分类对于评估生态系统服务和促进城市可持续发展至关重要。本文探讨了在定量结构模型(QSM)和树木结构测量得出的图形结构数据上使用图神经网络(GNN)进行适当的树种分类。该研究通过整合树枝和圆柱体等树木组成部分之间的关系,并以新颖的图数据格式考虑整个树木结构,弥补了现有方法的不足。研究结果证明了 GNN,特别是门控图卷积网络(GatedGCN)在对城市树种进行适当分类方面的功效。它的总体分类准确率和加权 F1 得分为 0.84。对混淆矩阵的分析表明,包括 A. platanoides 和 T. cordata 在内的多个树种的视觉特征具有相似性,这给准确区分它们带来了巨大挑战。不过,某些物种(如海马草和黑叶桉变种)被证明比其他物种更容易分类。此外,研究结果还强调了不同树体成分之间的关系在物种识别中的重要性,如树枝半径与母枝半径之间的比率,而这些因素往往被以前的方法所忽视。这凸显了本研究提出的方法的新颖性和有效性。未来的研究可以探索整合其他数据源,如通过激光雷达和高光谱数据计算的叶面积密度(LAD),以提高分类的准确性。总之,GatedGCN 模型的评估结果表明,该模型能有效地利用源自 QSM 树木特征的新型数据结构格式进行树种分类。通过这种方法推进城市树种分类,可以利用自动化人工智能和机器人解决方案加强未来的城市树木管理。
Automated classification of tree species using graph structure data and neural networks
The classification of tree species in urban contexts is pivotal in assessing ecosystem services and fostering sustainable urban development. This paper explores using graph neural networks (GNNs) on graph structure data derived from quantitative structure models (QSMs) and tree structural measurement for appropriate species classification. The study addresses gaps in existing methods by integrating relationships between tree components, such as branches and cylinders, and considering the entire tree structure in a novel graph data format. The results demonstrate the efficacy of GNNs, particularly the Gated Graph Convolutional Network (GatedGCN), in appropriately classifying urban tree species. It gained an overall classification accuracy and weighted F1 score of 0.84. An analysis of confusion matrices revealed similarities in visual characteristics among several species, including A. platanoides and T. cordata, which pose significant challenges in accurately distinguishing between them. However, certain species, such as A. hippocastanum and P. nigra var. italica, have proved easier to classify than others. Furthermore, the results highlight the importance of relationships between different tree components in species recognition, such as the ratio between branch radius and parent branch radius, the factors often overlooked by previous methods. This underscores the novelty and effectiveness of the proposed approach in this study. Future research could explore integrating additional data sources, such as Leaf Area Density (LAD) calculated from LiDAR and hyperspectral data, to enhance classification accuracy. In conclusion, the evaluation results of the GatedGCN model demonstrated its effectiveness in classifying tree species using a novel data structure format derived from QSM tree characteristics. Advancing urban tree species classification through such methods can enhance future urban tree management using automated AI and robotics solutions.
期刊介绍:
The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change.
The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.