Hongwei Li , Jiasheng Chen , Zenan Gu , Tianyun Dong , Jiqing Chen , Junduan Huang , Jingyao Gai , Hao Gong , Zhiheng Lu , Deqiang He
{"title":"基于轻量级深度学习模型的复杂天然果园绿色百香果边缘检测系统优化","authors":"Hongwei Li , Jiasheng Chen , Zenan Gu , Tianyun Dong , Jiqing Chen , Junduan Huang , Jingyao Gai , Hao Gong , Zhiheng Lu , Deqiang He","doi":"10.1016/j.compag.2025.110269","DOIUrl":null,"url":null,"abstract":"<div><div>To address labor shortages and rising costs, developing cost-effective fruit detection technology capable of functioning effectively in complex orchard environments is especially crucial for the advancement of robotic passion fruit harvesting systems. Moreover, achieving edge device-based efficient detection is highly expected under field conditions given its operating portability and cost-effective effects. This study proposed an improved YOLOv8n model for automatic passion fruits detection. First of all, a ParNet attention mechanism was added to the C2f module of YOLOv8n to improve feature extraction. To extract more information about small targets in the images, an additional detection layer was added for small targets in the Neck network. Furthermore, a SlimNeck architecture was employed to optimize the original neck part, reducing the model parameters while maintaining detection performance. The proposed model was trained and tested using a dataset divided by Hold-out, achieving an accuracy of 96.0 %, a recall rate of 83.7 %, and a [email protected] of 91.9 %. The model size was optimal with 2,650,300 parameters, 10.4G FLOPs, and an inference speed of 115fps in Windows-based platform. Compared to the other state-of-the-art deep learning models such as YOLOv4-Tiny, YOLOv5n, YOLOv6n, YOLOv7-Tiny, YOLOv8n, YOLOv9, YOLOv10n, YOLOv11n, Faster R-CNN and SSD, the improved YOLOv8n model showcased overall superior detection performance. When deploying this proposed model on Nvidia Jetson Orin Nano, the inference speed of the improved model was 28.15fps in the C++ environment using the TensorRT API, showing real-time detection performance. This study can provide basic technology for passion fruit robotic harvesting on the basis of the potable edge devices.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"234 ","pages":"Article 110269"},"PeriodicalIF":8.9000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimizing edge-enabled system for detecting green passion fruits in complex natural orchards using lightweight deep learning model\",\"authors\":\"Hongwei Li , Jiasheng Chen , Zenan Gu , Tianyun Dong , Jiqing Chen , Junduan Huang , Jingyao Gai , Hao Gong , Zhiheng Lu , Deqiang He\",\"doi\":\"10.1016/j.compag.2025.110269\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>To address labor shortages and rising costs, developing cost-effective fruit detection technology capable of functioning effectively in complex orchard environments is especially crucial for the advancement of robotic passion fruit harvesting systems. Moreover, achieving edge device-based efficient detection is highly expected under field conditions given its operating portability and cost-effective effects. This study proposed an improved YOLOv8n model for automatic passion fruits detection. First of all, a ParNet attention mechanism was added to the C2f module of YOLOv8n to improve feature extraction. To extract more information about small targets in the images, an additional detection layer was added for small targets in the Neck network. Furthermore, a SlimNeck architecture was employed to optimize the original neck part, reducing the model parameters while maintaining detection performance. The proposed model was trained and tested using a dataset divided by Hold-out, achieving an accuracy of 96.0 %, a recall rate of 83.7 %, and a [email protected] of 91.9 %. The model size was optimal with 2,650,300 parameters, 10.4G FLOPs, and an inference speed of 115fps in Windows-based platform. Compared to the other state-of-the-art deep learning models such as YOLOv4-Tiny, YOLOv5n, YOLOv6n, YOLOv7-Tiny, YOLOv8n, YOLOv9, YOLOv10n, YOLOv11n, Faster R-CNN and SSD, the improved YOLOv8n model showcased overall superior detection performance. When deploying this proposed model on Nvidia Jetson Orin Nano, the inference speed of the improved model was 28.15fps in the C++ environment using the TensorRT API, showing real-time detection performance. This study can provide basic technology for passion fruit robotic harvesting on the basis of the potable edge devices.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"234 \",\"pages\":\"Article 110269\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-03-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169925003758\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169925003758","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
为了解决劳动力短缺和成本上升的问题,开发能够在复杂果园环境中有效运行的具有成本效益的水果检测技术对于机器人百香果收获系统的发展尤为重要。此外,鉴于其操作可移植性和成本效益,在现场条件下实现基于边缘设备的高效检测备受期待。提出了一种改进的YOLOv8n模型,用于百香果的自动检测。首先,在YOLOv8n的C2f模块中增加了ParNet关注机制,提高了特征提取的效率。为了从图像中提取更多的小目标信息,在颈部网络中对小目标增加了额外的检测层。此外,采用SlimNeck架构对原始颈部部分进行优化,在保持检测性能的同时减少了模型参数。所提出的模型使用Hold-out划分的数据集进行训练和测试,准确率为96.0%,召回率为83.7%,[email protected]为91.9%。在windows平台上,模型大小为2,650,300个参数,10.4G FLOPs,推理速度为115fps,是最优的。与YOLOv4-Tiny、YOLOv5n、YOLOv6n、YOLOv7-Tiny、YOLOv8n、YOLOv9、YOLOv10n、YOLOv11n、Faster R-CNN和SSD等先进深度学习模型相比,改进后的YOLOv8n模型整体检测性能优越。在Nvidia Jetson Orin Nano上部署该模型时,使用TensorRT API,改进模型在c++环境下的推理速度为28.15fps,具有实时检测性能。本研究可为百香果机器人采收提供基础技术。
Optimizing edge-enabled system for detecting green passion fruits in complex natural orchards using lightweight deep learning model
To address labor shortages and rising costs, developing cost-effective fruit detection technology capable of functioning effectively in complex orchard environments is especially crucial for the advancement of robotic passion fruit harvesting systems. Moreover, achieving edge device-based efficient detection is highly expected under field conditions given its operating portability and cost-effective effects. This study proposed an improved YOLOv8n model for automatic passion fruits detection. First of all, a ParNet attention mechanism was added to the C2f module of YOLOv8n to improve feature extraction. To extract more information about small targets in the images, an additional detection layer was added for small targets in the Neck network. Furthermore, a SlimNeck architecture was employed to optimize the original neck part, reducing the model parameters while maintaining detection performance. The proposed model was trained and tested using a dataset divided by Hold-out, achieving an accuracy of 96.0 %, a recall rate of 83.7 %, and a [email protected] of 91.9 %. The model size was optimal with 2,650,300 parameters, 10.4G FLOPs, and an inference speed of 115fps in Windows-based platform. Compared to the other state-of-the-art deep learning models such as YOLOv4-Tiny, YOLOv5n, YOLOv6n, YOLOv7-Tiny, YOLOv8n, YOLOv9, YOLOv10n, YOLOv11n, Faster R-CNN and SSD, the improved YOLOv8n model showcased overall superior detection performance. When deploying this proposed model on Nvidia Jetson Orin Nano, the inference speed of the improved model was 28.15fps in the C++ environment using the TensorRT API, showing real-time detection performance. This study can provide basic technology for passion fruit robotic harvesting on the basis of the potable edge devices.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.