Maize tassel number and tasseling stage monitoring based on near-ground and UAV RGB images by improved YoloV8

IF 5.4 2区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY
Xun Yu, Dameng Yin, Honggen Xu, Francisco Pinto Espinosa, Urs Schmidhalter, Chenwei Nie, Yi Bai, Sindhuja Sankaran, Bo Ming, Ningbo Cui, Wenbin Wu, Xiuliang Jin
{"title":"Maize tassel number and tasseling stage monitoring based on near-ground and UAV RGB images by improved YoloV8","authors":"Xun Yu, Dameng Yin, Honggen Xu, Francisco Pinto Espinosa, Urs Schmidhalter, Chenwei Nie, Yi Bai, Sindhuja Sankaran, Bo Ming, Ningbo Cui, Wenbin Wu, Xiuliang Jin","doi":"10.1007/s11119-024-10135-y","DOIUrl":null,"url":null,"abstract":"<p>The monitoring of the tassel number and tasseling time reflects the maize growth and is necessary for crop management. However, it mainly depends on field observations, which is very labor intensive and may be biased by human errors. Tassel detection remains challenging due to the varying appearance of tassels across maize varieties, tasseling stages, and spatial resolutions. Moreover, the capability of the deep learning model for monitoring tassel number change and the time of entering tasseling stage has not been explored. In this study, we propose a novel approach for fast tassel detection using PConv (Partial Convolution) within YoloV8 series, named PConv-YoloV8 series. Compared to seven state-of-the-art deep learning methods, PConv-YoloV8 × 6 best trades off detection accuracy with the number of parameters (Parameters = 52.50 MB, AP = 0.950, R<sup>2</sup> = 0.92, rRMSE = 9.08%). The potential of PConv-YoloV8 × 6 to provide an accurate detection of tassels in complex situations from near-ground and UAV images were comprehensively studied. PConv-YoloV8 × 6 maintained an excellent detection accuracy for maize at different tasseling stages (AP = 0.826–0.972, R<sup>2</sup> = 0.83–0.92, RMSE = 1.94–3.01, rRMSE = 21.06%-7.09%), for different varieties (AP = 0.901–0.978, R<sup>2</sup> = 0.77–0.97, RMSE = 1.39–3.16, rRMSE = 11.72%-5.06%), at different resolutions (AP = 0.921–0.956, R<sup>2</sup> = 0.84–0.93, rRMSE = 8.72%-17.71%), and on UAV images with different resolutions (AP = 0.918–0.968, R<sup>2</sup> = 0.98–0.99, rRMSE = 6.43%-12.76%), which proved the robustness of the model. The tasseling number and the time of entering tasseling stage detected from images were basically consistent with the trends observed in the manually labeled results. This study provides an effective method to monitor the tassel number and the time of entering the tasseling stage. A new maize tassel detection dataset (18260 tassels in 729 near-ground images and 20835 tassels in 144 UAV images) is created. Future studies will focus on making more lightweight models and achieving real-time detection capabilities.</p>","PeriodicalId":20423,"journal":{"name":"Precision Agriculture","volume":"35 1","pages":""},"PeriodicalIF":5.4000,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Precision Agriculture","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.1007/s11119-024-10135-y","RegionNum":2,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

The monitoring of the tassel number and tasseling time reflects the maize growth and is necessary for crop management. However, it mainly depends on field observations, which is very labor intensive and may be biased by human errors. Tassel detection remains challenging due to the varying appearance of tassels across maize varieties, tasseling stages, and spatial resolutions. Moreover, the capability of the deep learning model for monitoring tassel number change and the time of entering tasseling stage has not been explored. In this study, we propose a novel approach for fast tassel detection using PConv (Partial Convolution) within YoloV8 series, named PConv-YoloV8 series. Compared to seven state-of-the-art deep learning methods, PConv-YoloV8 × 6 best trades off detection accuracy with the number of parameters (Parameters = 52.50 MB, AP = 0.950, R2 = 0.92, rRMSE = 9.08%). The potential of PConv-YoloV8 × 6 to provide an accurate detection of tassels in complex situations from near-ground and UAV images were comprehensively studied. PConv-YoloV8 × 6 maintained an excellent detection accuracy for maize at different tasseling stages (AP = 0.826–0.972, R2 = 0.83–0.92, RMSE = 1.94–3.01, rRMSE = 21.06%-7.09%), for different varieties (AP = 0.901–0.978, R2 = 0.77–0.97, RMSE = 1.39–3.16, rRMSE = 11.72%-5.06%), at different resolutions (AP = 0.921–0.956, R2 = 0.84–0.93, rRMSE = 8.72%-17.71%), and on UAV images with different resolutions (AP = 0.918–0.968, R2 = 0.98–0.99, rRMSE = 6.43%-12.76%), which proved the robustness of the model. The tasseling number and the time of entering tasseling stage detected from images were basically consistent with the trends observed in the manually labeled results. This study provides an effective method to monitor the tassel number and the time of entering the tasseling stage. A new maize tassel detection dataset (18260 tassels in 729 near-ground images and 20835 tassels in 144 UAV images) is created. Future studies will focus on making more lightweight models and achieving real-time detection capabilities.

Abstract Image

利用改进型 YoloV8,基于近地和无人机 RGB 图像监测玉米穗数和抽穗期
对抽穗数量和抽穗时间的监测反映了玉米的生长情况,对作物管理十分必要。然而,这主要依赖于实地观察,非常耗费人力,而且可能因人为误差而产生偏差。由于不同玉米品种、抽穗期和空间分辨率的玉米穗外观各不相同,因此玉米穗检测仍然具有挑战性。此外,深度学习模型在监测抽穗数量变化和进入抽穗期时间方面的能力尚未得到探索。在本研究中,我们提出了一种在 YoloV8 系列中使用 PConv(部分卷积)快速检测抽穗的新方法,命名为 PConv-YoloV8 系列。与七种最先进的深度学习方法相比,PConv-YoloV8 × 6 在检测精度与参数数量之间实现了最佳平衡(参数 = 52.50 MB,AP = 0.950,R2 = 0.92,rRMSE = 9.08%)。我们全面研究了 PConv-YoloV8 × 6 在复杂情况下从近地图像和无人机图像中准确检测流苏的潜力。PConv-YoloV8 × 6 对不同抽穗期的玉米(AP = 0.826-0.972, R2 = 0.83-0.92, RMSE = 1.94-3.01, rRMSE = 21.06%-7.09% )、不同品种(AP = 0.901-0.978, R2 = 0.77-0.97, RMSE = 1.39-3.16,rRMSE=11.72%-5.06%)、不同分辨率(AP=0.921-0.956,R2=0.84-0.93,rRMSE=8.72%-17.71%)以及不同分辨率的无人机图像(AP=0.918-0.968,R2=0.98-0.99,rRMSE=6.43%-12.76%),证明了该模型的鲁棒性。从图像中检测到的抽穗数量和进入抽穗期的时间与人工标注结果中观察到的趋势基本一致。这项研究为监测抽穗数量和进入抽穗期的时间提供了一种有效的方法。建立了一个新的玉米抽穗检测数据集(729 张近地面图像中的 18260 个抽穗和 144 张无人机图像中的 20835 个抽穗)。今后的研究将侧重于制作更轻便的模型和实现实时检测能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Precision Agriculture
Precision Agriculture 农林科学-农业综合
CiteScore
12.30
自引率
8.10%
发文量
103
审稿时长
>24 weeks
期刊介绍: Precision Agriculture promotes the most innovative results coming from the research in the field of precision agriculture. It provides an effective forum for disseminating original and fundamental research and experience in the rapidly advancing area of precision farming. There are many topics in the field of precision agriculture; therefore, the topics that are addressed include, but are not limited to: Natural Resources Variability: Soil and landscape variability, digital elevation models, soil mapping, geostatistics, geographic information systems, microclimate, weather forecasting, remote sensing, management units, scale, etc. Managing Variability: Sampling techniques, site-specific nutrient and crop protection chemical recommendation, crop quality, tillage, seed density, seed variety, yield mapping, remote sensing, record keeping systems, data interpretation and use, crops (corn, wheat, sugar beets, potatoes, peanut, cotton, vegetables, etc.), management scale, etc. Engineering Technology: Computers, positioning systems, DGPS, machinery, tillage, planting, nutrient and crop protection implements, manure, irrigation, fertigation, yield monitor and mapping, soil physical and chemical characteristic sensors, weed/pest mapping, etc. Profitability: MEY, net returns, BMPs, optimum recommendations, crop quality, technology cost, sustainability, social impacts, marketing, cooperatives, farm scale, crop type, etc. Environment: Nutrient, crop protection chemicals, sediments, leaching, runoff, practices, field, watershed, on/off farm, artificial drainage, ground water, surface water, etc. Technology Transfer: Skill needs, education, training, outreach, methods, surveys, agri-business, producers, distance education, Internet, simulations models, decision support systems, expert systems, on-farm experimentation, partnerships, quality of rural life, etc.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信