Xun Yu, Dameng Yin, Honggen Xu, Francisco Pinto Espinosa, Urs Schmidhalter, Chenwei Nie, Yi Bai, Sindhuja Sankaran, Bo Ming, Ningbo Cui, Wenbin Wu, Xiuliang Jin
{"title":"Maize tassel number and tasseling stage monitoring based on near-ground and UAV RGB images by improved YoloV8","authors":"Xun Yu, Dameng Yin, Honggen Xu, Francisco Pinto Espinosa, Urs Schmidhalter, Chenwei Nie, Yi Bai, Sindhuja Sankaran, Bo Ming, Ningbo Cui, Wenbin Wu, Xiuliang Jin","doi":"10.1007/s11119-024-10135-y","DOIUrl":null,"url":null,"abstract":"<p>The monitoring of the tassel number and tasseling time reflects the maize growth and is necessary for crop management. However, it mainly depends on field observations, which is very labor intensive and may be biased by human errors. Tassel detection remains challenging due to the varying appearance of tassels across maize varieties, tasseling stages, and spatial resolutions. Moreover, the capability of the deep learning model for monitoring tassel number change and the time of entering tasseling stage has not been explored. In this study, we propose a novel approach for fast tassel detection using PConv (Partial Convolution) within YoloV8 series, named PConv-YoloV8 series. Compared to seven state-of-the-art deep learning methods, PConv-YoloV8 × 6 best trades off detection accuracy with the number of parameters (Parameters = 52.50 MB, AP = 0.950, R<sup>2</sup> = 0.92, rRMSE = 9.08%). The potential of PConv-YoloV8 × 6 to provide an accurate detection of tassels in complex situations from near-ground and UAV images were comprehensively studied. PConv-YoloV8 × 6 maintained an excellent detection accuracy for maize at different tasseling stages (AP = 0.826–0.972, R<sup>2</sup> = 0.83–0.92, RMSE = 1.94–3.01, rRMSE = 21.06%-7.09%), for different varieties (AP = 0.901–0.978, R<sup>2</sup> = 0.77–0.97, RMSE = 1.39–3.16, rRMSE = 11.72%-5.06%), at different resolutions (AP = 0.921–0.956, R<sup>2</sup> = 0.84–0.93, rRMSE = 8.72%-17.71%), and on UAV images with different resolutions (AP = 0.918–0.968, R<sup>2</sup> = 0.98–0.99, rRMSE = 6.43%-12.76%), which proved the robustness of the model. The tasseling number and the time of entering tasseling stage detected from images were basically consistent with the trends observed in the manually labeled results. This study provides an effective method to monitor the tassel number and the time of entering the tasseling stage. A new maize tassel detection dataset (18260 tassels in 729 near-ground images and 20835 tassels in 144 UAV images) is created. Future studies will focus on making more lightweight models and achieving real-time detection capabilities.</p>","PeriodicalId":20423,"journal":{"name":"Precision Agriculture","volume":"35 1","pages":""},"PeriodicalIF":5.4000,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Precision Agriculture","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.1007/s11119-024-10135-y","RegionNum":2,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
The monitoring of the tassel number and tasseling time reflects the maize growth and is necessary for crop management. However, it mainly depends on field observations, which is very labor intensive and may be biased by human errors. Tassel detection remains challenging due to the varying appearance of tassels across maize varieties, tasseling stages, and spatial resolutions. Moreover, the capability of the deep learning model for monitoring tassel number change and the time of entering tasseling stage has not been explored. In this study, we propose a novel approach for fast tassel detection using PConv (Partial Convolution) within YoloV8 series, named PConv-YoloV8 series. Compared to seven state-of-the-art deep learning methods, PConv-YoloV8 × 6 best trades off detection accuracy with the number of parameters (Parameters = 52.50 MB, AP = 0.950, R2 = 0.92, rRMSE = 9.08%). The potential of PConv-YoloV8 × 6 to provide an accurate detection of tassels in complex situations from near-ground and UAV images were comprehensively studied. PConv-YoloV8 × 6 maintained an excellent detection accuracy for maize at different tasseling stages (AP = 0.826–0.972, R2 = 0.83–0.92, RMSE = 1.94–3.01, rRMSE = 21.06%-7.09%), for different varieties (AP = 0.901–0.978, R2 = 0.77–0.97, RMSE = 1.39–3.16, rRMSE = 11.72%-5.06%), at different resolutions (AP = 0.921–0.956, R2 = 0.84–0.93, rRMSE = 8.72%-17.71%), and on UAV images with different resolutions (AP = 0.918–0.968, R2 = 0.98–0.99, rRMSE = 6.43%-12.76%), which proved the robustness of the model. The tasseling number and the time of entering tasseling stage detected from images were basically consistent with the trends observed in the manually labeled results. This study provides an effective method to monitor the tassel number and the time of entering the tasseling stage. A new maize tassel detection dataset (18260 tassels in 729 near-ground images and 20835 tassels in 144 UAV images) is created. Future studies will focus on making more lightweight models and achieving real-time detection capabilities.
期刊介绍:
Precision Agriculture promotes the most innovative results coming from the research in the field of precision agriculture. It provides an effective forum for disseminating original and fundamental research and experience in the rapidly advancing area of precision farming.
There are many topics in the field of precision agriculture; therefore, the topics that are addressed include, but are not limited to:
Natural Resources Variability: Soil and landscape variability, digital elevation models, soil mapping, geostatistics, geographic information systems, microclimate, weather forecasting, remote sensing, management units, scale, etc.
Managing Variability: Sampling techniques, site-specific nutrient and crop protection chemical recommendation, crop quality, tillage, seed density, seed variety, yield mapping, remote sensing, record keeping systems, data interpretation and use, crops (corn, wheat, sugar beets, potatoes, peanut, cotton, vegetables, etc.), management scale, etc.
Engineering Technology: Computers, positioning systems, DGPS, machinery, tillage, planting, nutrient and crop protection implements, manure, irrigation, fertigation, yield monitor and mapping, soil physical and chemical characteristic sensors, weed/pest mapping, etc.
Profitability: MEY, net returns, BMPs, optimum recommendations, crop quality, technology cost, sustainability, social impacts, marketing, cooperatives, farm scale, crop type, etc.
Environment: Nutrient, crop protection chemicals, sediments, leaching, runoff, practices, field, watershed, on/off farm, artificial drainage, ground water, surface water, etc.
Technology Transfer: Skill needs, education, training, outreach, methods, surveys, agri-business, producers, distance education, Internet, simulations models, decision support systems, expert systems, on-farm experimentation, partnerships, quality of rural life, etc.