Combining OBIA, CNN, and UAV imagery for automated detection and mapping of individual olive trees

IF 6.3 Q1 AGRICULTURAL ENGINEERING
{"title":"Combining OBIA, CNN, and UAV imagery for automated detection and mapping of individual olive trees","authors":"","doi":"10.1016/j.atech.2024.100546","DOIUrl":null,"url":null,"abstract":"<div><p>The identification of individual trees is an important research topic in forestry, remote sensing and computer vision. It represents a tool for effectively and efficiently managing and maintaining forests and orchards. However, this task is not as simple as it seems; tree detection and counting can be time consuming, cost-prohibitive and accuracy-limited, especially if performed manually on a large scale.The availability of very high-resolution UAV imagery with remote sensing can make the counting process easier, faster and more precise. With the development of technology, this process can be made more automated by using intelligent algorithms such as CNN.</p><p>This work presents an OBIA-CNN (Object Based Image Analysis-Convolution Neural Network) approach that combines CNNs with OBIA to automatically detect and count olive trees from Phantom4 advanced drone imagery. Initially, The CNN-based classifier was created, trained, validated, and applied to generate the Olive trees probability maps on the ortho-photo. The post-classification refinement based on OBIA was then conducted. A super-pixel segmentation and the Excess Green index were performed and a detailed accuracy analysis has been carried out to establish the suitability of the proposed method.</p><p>The application to a RGB ortho-mosaic of an olive grove, in the east region of Morocco was successful using a manually elaborated training dataset of 4500 images of 24×24 pixels. Finally, the CNN detected and counted 2934 olive trees on the ortho-photo, achieving an overall accuracy of 97 % and 99 % after the OBIA refinement. The results of the proposed OBIA-CNN method were also compared with the classification results of using the Template matching technique, CNN method alone, and OBIA analysis alone to evaluate the performance of the approach. Our findings suggest the use of very high resolution images with object-based deep learning is promising for automatic detection and counting of olive trees to support the accurate and sustainable agricultural monitoring.</p></div>","PeriodicalId":74813,"journal":{"name":"Smart agricultural technology","volume":null,"pages":null},"PeriodicalIF":6.3000,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772375524001515/pdfft?md5=2aaac2e04ec6af0d19b6c72cbbca5b6d&pid=1-s2.0-S2772375524001515-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Smart agricultural technology","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772375524001515","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURAL ENGINEERING","Score":null,"Total":0}
引用次数: 0

Abstract

The identification of individual trees is an important research topic in forestry, remote sensing and computer vision. It represents a tool for effectively and efficiently managing and maintaining forests and orchards. However, this task is not as simple as it seems; tree detection and counting can be time consuming, cost-prohibitive and accuracy-limited, especially if performed manually on a large scale.The availability of very high-resolution UAV imagery with remote sensing can make the counting process easier, faster and more precise. With the development of technology, this process can be made more automated by using intelligent algorithms such as CNN.

This work presents an OBIA-CNN (Object Based Image Analysis-Convolution Neural Network) approach that combines CNNs with OBIA to automatically detect and count olive trees from Phantom4 advanced drone imagery. Initially, The CNN-based classifier was created, trained, validated, and applied to generate the Olive trees probability maps on the ortho-photo. The post-classification refinement based on OBIA was then conducted. A super-pixel segmentation and the Excess Green index were performed and a detailed accuracy analysis has been carried out to establish the suitability of the proposed method.

The application to a RGB ortho-mosaic of an olive grove, in the east region of Morocco was successful using a manually elaborated training dataset of 4500 images of 24×24 pixels. Finally, the CNN detected and counted 2934 olive trees on the ortho-photo, achieving an overall accuracy of 97 % and 99 % after the OBIA refinement. The results of the proposed OBIA-CNN method were also compared with the classification results of using the Template matching technique, CNN method alone, and OBIA analysis alone to evaluate the performance of the approach. Our findings suggest the use of very high resolution images with object-based deep learning is promising for automatic detection and counting of olive trees to support the accurate and sustainable agricultural monitoring.

结合 OBIA、CNN 和无人机图像,自动检测和绘制橄榄树个体地图
单棵树木的识别是林业、遥感和计算机视觉领域的一个重要研究课题。它是切实有效地管理和维护森林和果园的工具。然而,这项任务并不像看起来那么简单;树木检测和计数可能会耗费大量时间、成本高昂且精度有限,尤其是在大规模人工操作的情况下。随着技术的发展,通过使用 CNN 等智能算法,可以使这一过程更加自动化。本作品介绍了一种 OBIA-CNN(基于对象的图像分析-卷积神经网络)方法,该方法将 CNN 与 OBIA 相结合,从 Phantom4 高级无人机图像中自动检测和计数橄榄树。首先,创建、训练、验证并应用基于 CNN 的分类器,以生成正射影像上的橄榄树概率图。然后,基于 OBIA 进行分类后细化。对摩洛哥东部地区橄榄树林的 RGB 正射影像拼接图进行了应用,并成功地使用了由 4500 幅 24×24 像素图像组成的人工精心制作的训练数据集。最后,CNN 在正射影像上检测并计算出 2934 棵橄榄树,总体准确率达到 97%,经过 OBIA 改进后达到 99%。我们还将所提出的 OBIA-CNN 方法的结果与使用模板匹配技术、单独使用 CNN 方法和单独使用 OBIA 分析的分类结果进行了比较,以评估该方法的性能。我们的研究结果表明,利用高分辨率图像和基于对象的深度学习技术自动检测和计算橄榄树数量,为准确和可持续的农业监测提供支持是大有可为的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.20
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信