利用无人机技术和自监督分割技术测量观赏树树冠属性,以实现精准喷洒

IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY
{"title":"利用无人机技术和自监督分割技术测量观赏树树冠属性,以实现精准喷洒","authors":"","doi":"10.1016/j.compag.2024.109359","DOIUrl":null,"url":null,"abstract":"<div><p>Tree canopy attributes or characteristics, such as canopy volume and density, are important parameters for calculating the precise quantity of agrochemicals required in each tree. Assessing the agrochemical needs in a nursery can help growers effectively estimate expenses, mitigate the risks of overuse or underuse, enhance resource utilization, and promote sustainable agricultural practices. This study aimed to develop an unmanned aerial vehicle (UAV)-based system to measure tree canopy attributes like tree height, tree count, canopy area and canopy volume using an image processing and self-supervised zero-shot segmentation approach. A high-resolution red-green-blue (RGB) sensor mounted on a drone captured three aerial image datasets, D1 and D2 from the first experimental plot and D3 from the second experimental plot. The acquired aerial images were stitched together and processed to generate a digital surface model (DSM) and a digital terrain model (DTM). A self-supervised zero-shot segmentation model, Segment Anything Model (SAM), was applied for tree segmentation and counting. The tree canopy area was calculated by segmenting individual trees and applying a conversion factor to convert pixelwise areas into square meters. Height calculation was done using elevation data of each pixel from DSM-DTM imagery within SAM-derived bounding box coordinates, and the highest pixel was considered as the height of the tree. The drone-calculated heights of 24 randomly selected trees were compared with manually measured heights in all datasets. The results showed an average absolute error of 2.43% in D1, 7.09% in D2 and 12.58% in D3. The Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) were noted to be 0.09 m and 0.23 m in D1, 0.13 m and 0.25 m in D2, and 0.16 m and 0.21 m in D3, respectively. In D3, manual area and volume calculations were performed for validation. The RMSE and MAE for area calculation were calculated as 0.18 m<sup>2</sup> and 0.15 m<sup>2</sup>, respectively, and the RMSE and MAE for volume measurements were calculated as 0.33 m<sup>3</sup> and 0.26 m<sup>3</sup> respectively, which indicated the level of agreement between manual and drone measurements. Using canopy volume information, calculated by summing pixel heights within each tree’s bounding box and multiplying by the ground sample distance (GSD) of 0.025 m per pixel, the average quantity of agrochemicals needed for a Maple tree was estimated at 0.20 L. These results underscore the high potential of this method for accurate canopy characteristic calculations and precision spray applications in the ornamental industry.</p></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Measuring ornamental tree canopy attributes for precision spraying using drone technology and self-supervised segmentation\",\"authors\":\"\",\"doi\":\"10.1016/j.compag.2024.109359\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Tree canopy attributes or characteristics, such as canopy volume and density, are important parameters for calculating the precise quantity of agrochemicals required in each tree. Assessing the agrochemical needs in a nursery can help growers effectively estimate expenses, mitigate the risks of overuse or underuse, enhance resource utilization, and promote sustainable agricultural practices. This study aimed to develop an unmanned aerial vehicle (UAV)-based system to measure tree canopy attributes like tree height, tree count, canopy area and canopy volume using an image processing and self-supervised zero-shot segmentation approach. A high-resolution red-green-blue (RGB) sensor mounted on a drone captured three aerial image datasets, D1 and D2 from the first experimental plot and D3 from the second experimental plot. The acquired aerial images were stitched together and processed to generate a digital surface model (DSM) and a digital terrain model (DTM). A self-supervised zero-shot segmentation model, Segment Anything Model (SAM), was applied for tree segmentation and counting. The tree canopy area was calculated by segmenting individual trees and applying a conversion factor to convert pixelwise areas into square meters. Height calculation was done using elevation data of each pixel from DSM-DTM imagery within SAM-derived bounding box coordinates, and the highest pixel was considered as the height of the tree. The drone-calculated heights of 24 randomly selected trees were compared with manually measured heights in all datasets. The results showed an average absolute error of 2.43% in D1, 7.09% in D2 and 12.58% in D3. The Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) were noted to be 0.09 m and 0.23 m in D1, 0.13 m and 0.25 m in D2, and 0.16 m and 0.21 m in D3, respectively. In D3, manual area and volume calculations were performed for validation. The RMSE and MAE for area calculation were calculated as 0.18 m<sup>2</sup> and 0.15 m<sup>2</sup>, respectively, and the RMSE and MAE for volume measurements were calculated as 0.33 m<sup>3</sup> and 0.26 m<sup>3</sup> respectively, which indicated the level of agreement between manual and drone measurements. Using canopy volume information, calculated by summing pixel heights within each tree’s bounding box and multiplying by the ground sample distance (GSD) of 0.025 m per pixel, the average quantity of agrochemicals needed for a Maple tree was estimated at 0.20 L. These results underscore the high potential of this method for accurate canopy characteristic calculations and precision spray applications in the ornamental industry.</p></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2024-08-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169924007506\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924007506","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

树冠属性或特征(如树冠体积和密度)是计算每棵树所需农用化学品精确数量的重要参数。评估苗圃的农用化学品需求可以帮助种植者有效地估算费用,降低过度使用或使用不足的风险,提高资源利用率,促进可持续农业实践。本研究旨在开发一种基于无人机(UAV)的系统,利用图像处理和自我监督零镜头分割方法测量树冠属性,如树高、树数、树冠面积和树冠体积。安装在无人机上的高分辨率红-绿-蓝(RGB)传感器捕获了三个航空图像数据集,D1 和 D2 来自第一个实验地块,D3 来自第二个实验地块。获取的航空图像经过拼接和处理,生成了数字地表模型(DSM)和数字地形模型(DTM)。采用自监督零镜头分割模型 Segment Anything Model (SAM) 进行树木分割和计数。树冠面积是通过分割单棵树木并应用转换系数将像素面积转换为平方米计算得出的。高度计算是利用 DSM-DTM 图像中每个像素的高程数据在 SAM 导出的边界框坐标内进行的,最高像素被视为树木的高度。将随机选取的 24 棵树的无人机计算高度与所有数据集中的人工测量高度进行了比较。结果显示,D1 的平均绝对误差为 2.43%,D2 为 7.09%,D3 为 12.58%。平均绝对误差(MAE)和均方根误差(RMSE)在 D1 中分别为 0.09 米和 0.23 米,在 D2 中分别为 0.13 米和 0.25 米,在 D3 中分别为 0.16 米和 0.21 米。在 D3 中,进行了人工面积和体积计算以进行验证。经计算,面积计算的均方根误差(RMSE)和均方根误差(MAE)分别为 0.18 m2 和 0.15 m2,体积测量的均方根误差(RMSE)和均方根误差(MAE)分别为 0.33 m3 和 0.26 m3,这表明人工测量与无人机测量的一致性水平较高。利用树冠体积信息,将每棵树边界框内的像素高度相加,再乘以每个像素 0.025 米的地面采样距离 (GSD),估算出一棵枫树所需的农用化学品平均用量为 0.20 升。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Measuring ornamental tree canopy attributes for precision spraying using drone technology and self-supervised segmentation

Tree canopy attributes or characteristics, such as canopy volume and density, are important parameters for calculating the precise quantity of agrochemicals required in each tree. Assessing the agrochemical needs in a nursery can help growers effectively estimate expenses, mitigate the risks of overuse or underuse, enhance resource utilization, and promote sustainable agricultural practices. This study aimed to develop an unmanned aerial vehicle (UAV)-based system to measure tree canopy attributes like tree height, tree count, canopy area and canopy volume using an image processing and self-supervised zero-shot segmentation approach. A high-resolution red-green-blue (RGB) sensor mounted on a drone captured three aerial image datasets, D1 and D2 from the first experimental plot and D3 from the second experimental plot. The acquired aerial images were stitched together and processed to generate a digital surface model (DSM) and a digital terrain model (DTM). A self-supervised zero-shot segmentation model, Segment Anything Model (SAM), was applied for tree segmentation and counting. The tree canopy area was calculated by segmenting individual trees and applying a conversion factor to convert pixelwise areas into square meters. Height calculation was done using elevation data of each pixel from DSM-DTM imagery within SAM-derived bounding box coordinates, and the highest pixel was considered as the height of the tree. The drone-calculated heights of 24 randomly selected trees were compared with manually measured heights in all datasets. The results showed an average absolute error of 2.43% in D1, 7.09% in D2 and 12.58% in D3. The Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) were noted to be 0.09 m and 0.23 m in D1, 0.13 m and 0.25 m in D2, and 0.16 m and 0.21 m in D3, respectively. In D3, manual area and volume calculations were performed for validation. The RMSE and MAE for area calculation were calculated as 0.18 m2 and 0.15 m2, respectively, and the RMSE and MAE for volume measurements were calculated as 0.33 m3 and 0.26 m3 respectively, which indicated the level of agreement between manual and drone measurements. Using canopy volume information, calculated by summing pixel heights within each tree’s bounding box and multiplying by the ground sample distance (GSD) of 0.025 m per pixel, the average quantity of agrochemicals needed for a Maple tree was estimated at 0.20 L. These results underscore the high potential of this method for accurate canopy characteristic calculations and precision spray applications in the ornamental industry.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信