Mobile robot for leaf disease detection and precise spraying: Convolutional neural networks integration and path planning

IF 2.7 Q2 MULTIDISCIPLINARY SCIENCES
Youssef Bouhaja , Hatim Bamoumen , Israe Derdak , Safiyah Sheikh , Moulay El Hassan El Azhari , Hamza El Hafdaoui
{"title":"Mobile robot for leaf disease detection and precise spraying: Convolutional neural networks integration and path planning","authors":"Youssef Bouhaja ,&nbsp;Hatim Bamoumen ,&nbsp;Israe Derdak ,&nbsp;Safiyah Sheikh ,&nbsp;Moulay El Hassan El Azhari ,&nbsp;Hamza El Hafdaoui","doi":"10.1016/j.sciaf.2025.e02717","DOIUrl":null,"url":null,"abstract":"<div><div>Plant diseases are a major cause of crop yield and quality losses, particularly in tomatoes, where bacterial, fungal, and viral diseases significantly impact production. Traditional disease detection methods are slow and prone to human error, limiting their use in large-scale agriculture. This study presents a mobile robot equipped with a custom convolutional neural network (CNN)-based system for early-stage disease detection and pesticide spraying; the robot was trained and tested on 13,191 tomato leaf images, using an 80:20 train-test split. The robot features a Raspberry Pi (ARM Cortex-A72, 1.5 GHz, 4 GB RAM) for processing, an RGB camera (12 MP, 30 fps), and a LiDAR module (360° range, 12 m, 0.1° resolution) for navigation. The pesticide spraying mechanism is driven by an Arduino-controlled stepper motor (1.8° step angle) with precise 180° movement for targeted application. The system was evaluated based on performance and efficiency evaluation, cost-effectiveness, environmental impact assessment, and sensitivity analysis. In navigation tests, the robot maintained minimal deviation of 1 cm in open fields, with fast obstacle detection and path adjustment in dynamic environments, including obstacles detected within 150 milliseconds. The robot achieved a precision rate of 95 % after just 50 epochs of training with a real-time latency of 0.015 s per image classification, which significantly outperforms the highest precision rate of 91 % achieved at 70 epochs from literature, where the real-time latency exceeded 0.028 s. Validation accuracy remained between 85 % and 90 %, indicating strong generalization. Classification metrics showed exceptional performance, with accuracy, precision, recall, and F1-scores all exceeding 91 % across 10 tomato leaf classes. The confusion matrix showed minimal misclassifications, and the receiver operating characteristic curve confirmed the model’s strong ability to differentiate between healthy and diseased leaves with area under the curve values exceeding 0.90. Energy consumption was optimized, with the robot operating between 4.3 and 5.8 Watts, ensuring efficient power usage. Environmental impact assessments revealed a 40 % reduction in pesticide use and a 44.7 % decrease in worker exposure.</div><div>Sensitivity analysis showed performance variation under varying weather conditions, light variations, and environmental disturbances, with navigation accuracy dropping from 88 % at 10 °C to 75 % at 40 °C, and classification accuracy decreasing from 92.5 % at 10 °C to 77.3 % at 40 °C, with 1200 Lux light and 18 m/s wind. Additionally, energy consumption rose from 11.2 Wh at 10 °C to 18.6 Wh at 40 °C. These results demonstrate the effectiveness of the proposed system for real-time, autonomous disease management, offering a reliable and efficient solution for precision agriculture. While the system's applicability to different crops is limited by the training dataset, it can be generalized to other plant species with appropriate retraining with larger datasets. Overall, this study demonstrates the technical potential of the developed mobile robot for autonomous, real-time disease management, offering a reliable and efficient solution for precision agriculture, with considerable economic, environmental, and operational benefits.</div></div>","PeriodicalId":21690,"journal":{"name":"Scientific African","volume":"28 ","pages":"Article e02717"},"PeriodicalIF":2.7000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Scientific African","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2468227625001875","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Plant diseases are a major cause of crop yield and quality losses, particularly in tomatoes, where bacterial, fungal, and viral diseases significantly impact production. Traditional disease detection methods are slow and prone to human error, limiting their use in large-scale agriculture. This study presents a mobile robot equipped with a custom convolutional neural network (CNN)-based system for early-stage disease detection and pesticide spraying; the robot was trained and tested on 13,191 tomato leaf images, using an 80:20 train-test split. The robot features a Raspberry Pi (ARM Cortex-A72, 1.5 GHz, 4 GB RAM) for processing, an RGB camera (12 MP, 30 fps), and a LiDAR module (360° range, 12 m, 0.1° resolution) for navigation. The pesticide spraying mechanism is driven by an Arduino-controlled stepper motor (1.8° step angle) with precise 180° movement for targeted application. The system was evaluated based on performance and efficiency evaluation, cost-effectiveness, environmental impact assessment, and sensitivity analysis. In navigation tests, the robot maintained minimal deviation of 1 cm in open fields, with fast obstacle detection and path adjustment in dynamic environments, including obstacles detected within 150 milliseconds. The robot achieved a precision rate of 95 % after just 50 epochs of training with a real-time latency of 0.015 s per image classification, which significantly outperforms the highest precision rate of 91 % achieved at 70 epochs from literature, where the real-time latency exceeded 0.028 s. Validation accuracy remained between 85 % and 90 %, indicating strong generalization. Classification metrics showed exceptional performance, with accuracy, precision, recall, and F1-scores all exceeding 91 % across 10 tomato leaf classes. The confusion matrix showed minimal misclassifications, and the receiver operating characteristic curve confirmed the model’s strong ability to differentiate between healthy and diseased leaves with area under the curve values exceeding 0.90. Energy consumption was optimized, with the robot operating between 4.3 and 5.8 Watts, ensuring efficient power usage. Environmental impact assessments revealed a 40 % reduction in pesticide use and a 44.7 % decrease in worker exposure.
Sensitivity analysis showed performance variation under varying weather conditions, light variations, and environmental disturbances, with navigation accuracy dropping from 88 % at 10 °C to 75 % at 40 °C, and classification accuracy decreasing from 92.5 % at 10 °C to 77.3 % at 40 °C, with 1200 Lux light and 18 m/s wind. Additionally, energy consumption rose from 11.2 Wh at 10 °C to 18.6 Wh at 40 °C. These results demonstrate the effectiveness of the proposed system for real-time, autonomous disease management, offering a reliable and efficient solution for precision agriculture. While the system's applicability to different crops is limited by the training dataset, it can be generalized to other plant species with appropriate retraining with larger datasets. Overall, this study demonstrates the technical potential of the developed mobile robot for autonomous, real-time disease management, offering a reliable and efficient solution for precision agriculture, with considerable economic, environmental, and operational benefits.
叶片病害检测与精准喷洒移动机器人:卷积神经网络集成与路径规划
植物病害是作物产量和质量损失的主要原因,特别是番茄,细菌、真菌和病毒病害严重影响生产。传统的疾病检测方法速度慢,容易出现人为错误,限制了它们在大规模农业中的应用。本研究提出了一种基于自定义卷积神经网络(CNN)系统的移动机器人,用于早期疾病检测和农药喷洒;机器人接受了13191张番茄叶片图像的训练和测试,使用了80:20的训练测试分割。该机器人采用树莓派(ARM Cortex-A72, 1.5 GHz, 4gb RAM)进行处理,RGB摄像头(12 MP, 30 fps)和激光雷达模块(360°范围,12米,0.1°分辨率)进行导航。农药喷洒机构由arduino控制的步进电机驱动(1.8°步进角),精确180°运动,针对性应用。该系统的评价基于性能和效率评价、成本效益、环境影响评价和敏感性分析。在导航测试中,机器人在开阔场地中保持最小偏差1 cm,在动态环境中具有快速的障碍物检测和路径调整,包括在150毫秒内检测到障碍物。经过50次训练,机器人的准确率达到95%,每次图像分类的实时延迟为0.015秒,这大大超过了文献中70次训练的最高准确率91%,实时延迟超过0.028秒。验证精度保持在85%到90%之间,表明具有很强的泛化性。分类指标表现出优异的性能,在10个番茄叶类别中,准确率、精密度、召回率和f1得分均超过91%。混淆矩阵显示出最小的错误分类,接受者工作特征曲线证实了该模型区分健康和患病叶片的能力很强,曲线下面积超过0.90。优化了能耗,机器人的运行功率在4.3到5.8瓦之间,确保了高效的电力使用。环境影响评估显示,农药使用量减少了40%,工人接触的农药减少了44.7%。灵敏度分析显示,在不同天气条件、光照变化和环境干扰下,导航精度从10°C时的88%下降到40°C时的75%,分类精度从10°C时的92.5%下降到40°C时的77.3%,光照为1200勒克斯,风速为18 m/s。此外,能耗从10°C时的11.2 Wh增加到40°C时的18.6 Wh。这些结果证明了该系统在实时、自主疾病管理方面的有效性,为精准农业提供了可靠、高效的解决方案。虽然该系统对不同作物的适用性受到训练数据集的限制,但通过使用更大的数据集进行适当的再训练,它可以推广到其他植物物种。总体而言,本研究证明了所开发的移动机器人在自主、实时疾病管理方面的技术潜力,为精准农业提供了可靠、高效的解决方案,具有可观的经济、环境和运营效益。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Scientific African
Scientific African Multidisciplinary-Multidisciplinary
CiteScore
5.60
自引率
3.40%
发文量
332
审稿时长
10 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信