{"title":"Ground-based on-line weed control using computer vision: Analyzing the inference time-accuracy dilemma","authors":"","doi":"10.1016/j.compag.2024.109577","DOIUrl":null,"url":null,"abstract":"<div><div>The detrimental effects of weeds on crop growth and yield present substantial challenges to the agribusiness sector, necessitating the deployment of robust control strategies. The rapid advancement of Computer vision (CV) techniques has driven the integration of ground-based imaging sensors to enable site-specific weed management. The main challenge in weed management revolves around on-line weed detection, which demands a careful balance between inference time and detection accuracy. Finding this balance is very important, as prioritizing a higher number of frames per second (fps) might reduce the detection precision. However, the real-time constraint for on-line weed control remains relatively unexplored. This paper addresses this gap by categorizing proposed approaches based on ground-vehicle configuration and evaluating the real-time requirements for on-line weed control. We comprehensively examine the different components of ground-vehicles including the travel speed, camera settings, and weeding tools to understand the fps required for seamless weed control operation. Results show that for travel speeds below <span><math><mrow><mn>4</mn><mspace></mspace><mi>k</mi><mi>m</mi><mspace></mspace><msup><mrow><mi>h</mi></mrow><mrow><mo>−</mo><mn>1</mn></mrow></msup></mrow></math></span>, Deep Neural Networks (DNNs) operating at fps rates lower than 10 Hz are suitable for effective on-line weed detection. However, at higher speeds or with smaller Fields of View, fps demands increase. Our findings further reveal that the relatively relaxed fps requirements of on-line weed control create opportunities for deploying larger DNNs, such as NASNet-A-Large, which can significantly enhance detection accuracy. The operational latency introduced by certain weeding tools further provides additional processing time for DNNs. The continuous advancement of larger DNNs and improvements in hardware offer promising prospects for precise and effective weed management. Future research should leverage these developments, focusing on enhancing detection accuracy rather than optimizing for faster inference times, given the relaxed real-time constraints of ground-based weed control.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2024-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924009682","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
The detrimental effects of weeds on crop growth and yield present substantial challenges to the agribusiness sector, necessitating the deployment of robust control strategies. The rapid advancement of Computer vision (CV) techniques has driven the integration of ground-based imaging sensors to enable site-specific weed management. The main challenge in weed management revolves around on-line weed detection, which demands a careful balance between inference time and detection accuracy. Finding this balance is very important, as prioritizing a higher number of frames per second (fps) might reduce the detection precision. However, the real-time constraint for on-line weed control remains relatively unexplored. This paper addresses this gap by categorizing proposed approaches based on ground-vehicle configuration and evaluating the real-time requirements for on-line weed control. We comprehensively examine the different components of ground-vehicles including the travel speed, camera settings, and weeding tools to understand the fps required for seamless weed control operation. Results show that for travel speeds below , Deep Neural Networks (DNNs) operating at fps rates lower than 10 Hz are suitable for effective on-line weed detection. However, at higher speeds or with smaller Fields of View, fps demands increase. Our findings further reveal that the relatively relaxed fps requirements of on-line weed control create opportunities for deploying larger DNNs, such as NASNet-A-Large, which can significantly enhance detection accuracy. The operational latency introduced by certain weeding tools further provides additional processing time for DNNs. The continuous advancement of larger DNNs and improvements in hardware offer promising prospects for precise and effective weed management. Future research should leverage these developments, focusing on enhancing detection accuracy rather than optimizing for faster inference times, given the relaxed real-time constraints of ground-based weed control.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.