Hongwei Li , Yongmei Mo , Jiasheng Chen , Jiqing Chen , Jiabao Li
{"title":"基于轻量级改进的YOLOv8n模型的Orah水果精确检测方法通过优化部署在边缘设备上的验证","authors":"Hongwei Li , Yongmei Mo , Jiasheng Chen , Jiqing Chen , Jiabao Li","doi":"10.1016/j.aiia.2025.05.001","DOIUrl":null,"url":null,"abstract":"<div><div>The replacement of personal computer terminal with edge device is recognized as a portable and cost-effective potential solution in solving equipment miniaturization and achieving high flexibility of robotic fruit harvesting at in-field scale. This study proposes a lightweight improved You Only Look Once version 8n (YOLOv8n) model for detecting Orah fruits and deploying this model on an edge device. First of all, the model size was reduced while maintaining detection accuracy via the introduction of the ADown modules. Subsequently, a Concentrated-Comprehensive Dual Convolution (C3_DualConv) module combining dual convolutional bottlenecks was proposed to enhance the model capability to capture features of Orah fruits obscured by branches and leaves; this practice further reduced the model size. Additionally, a Bidirectional Feature Pyramid Network (BiFPN) that includes a pyramid level 2 high-resolution layer was employed for more efficient multi-scale feature fusion. Besides, three Coordinate Attention (CA) mechanism modules were also added to improve the recognition and capture capability for Orah fruit features. Finally, a more focused minimum points distance intersection over union loss was adopted to boost the detection efficiency of densely occluded Orah fruits. Experimentally demonstrating that the improved YOLOv8n model accurately detected Orah fruits in complex orchard environments, achieving a 97.7 % of precision, an Average Precision at IoU threshold 0.5 ([email protected]) of 98.8 %, and a 96.69 % of F1 score, while maintaining a compact model size of 4.1 MB, under a Windows-based system terminal. This proposed model was optimally deployed on an Nvidia Jetson Orin Nano using TensorRT Python Application Programming Interface (API), the average interface speed exceeds 30 fps, indicating a real-time detection ability. This study can provide technical support for Orah fruit robotic harvesting on the basis of edge device.</div></div>","PeriodicalId":52814,"journal":{"name":"Artificial Intelligence in Agriculture","volume":"15 4","pages":"Pages 707-723"},"PeriodicalIF":12.4000,"publicationDate":"2025-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Accurate Orah fruit detection method using lightweight improved YOLOv8n model verified by optimized deployment on edge device\",\"authors\":\"Hongwei Li , Yongmei Mo , Jiasheng Chen , Jiqing Chen , Jiabao Li\",\"doi\":\"10.1016/j.aiia.2025.05.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The replacement of personal computer terminal with edge device is recognized as a portable and cost-effective potential solution in solving equipment miniaturization and achieving high flexibility of robotic fruit harvesting at in-field scale. This study proposes a lightweight improved You Only Look Once version 8n (YOLOv8n) model for detecting Orah fruits and deploying this model on an edge device. First of all, the model size was reduced while maintaining detection accuracy via the introduction of the ADown modules. Subsequently, a Concentrated-Comprehensive Dual Convolution (C3_DualConv) module combining dual convolutional bottlenecks was proposed to enhance the model capability to capture features of Orah fruits obscured by branches and leaves; this practice further reduced the model size. Additionally, a Bidirectional Feature Pyramid Network (BiFPN) that includes a pyramid level 2 high-resolution layer was employed for more efficient multi-scale feature fusion. Besides, three Coordinate Attention (CA) mechanism modules were also added to improve the recognition and capture capability for Orah fruit features. Finally, a more focused minimum points distance intersection over union loss was adopted to boost the detection efficiency of densely occluded Orah fruits. Experimentally demonstrating that the improved YOLOv8n model accurately detected Orah fruits in complex orchard environments, achieving a 97.7 % of precision, an Average Precision at IoU threshold 0.5 ([email protected]) of 98.8 %, and a 96.69 % of F1 score, while maintaining a compact model size of 4.1 MB, under a Windows-based system terminal. This proposed model was optimally deployed on an Nvidia Jetson Orin Nano using TensorRT Python Application Programming Interface (API), the average interface speed exceeds 30 fps, indicating a real-time detection ability. This study can provide technical support for Orah fruit robotic harvesting on the basis of edge device.</div></div>\",\"PeriodicalId\":52814,\"journal\":{\"name\":\"Artificial Intelligence in Agriculture\",\"volume\":\"15 4\",\"pages\":\"Pages 707-723\"},\"PeriodicalIF\":12.4000,\"publicationDate\":\"2025-05-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Artificial Intelligence in Agriculture\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2589721725000546\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence in Agriculture","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2589721725000546","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
边缘设备取代个人计算机终端是解决设备小型化和实现果园自动化采收高灵活性的一种便携、经济的潜在解决方案。本研究提出了一种轻量级的改进You Only Look Once version 8n (YOLOv8n)模型,用于检测Orah水果,并将该模型部署在边缘设备上。首先,通过引入down模块,在保持检测精度的同时减小了模型尺寸。随后,提出了一种结合双卷积瓶颈的集中-综合对偶卷积(C3_DualConv)模块,增强了模型捕捉被枝叶遮挡的桔梗果实特征的能力;这种做法进一步减小了模型的尺寸。此外,采用包含金字塔级2分辨率层的双向特征金字塔网络(Bidirectional Feature Pyramid Network, BiFPN)进行更高效的多尺度特征融合。此外,还增加了三个坐标注意(CA)机制模块,提高了对桔梗果特征的识别和捕获能力。最后,采用更集中的最小点距交点与并集损失交点,提高密集遮挡的奥拉果的检测效率。实验证明,改进的YOLOv8n模型在复杂果园环境下准确地检测了奥拉果,在windows系统终端下,精度达到97.7%,IoU阈值0.5 ([email protected])下的平均精度达到98.8%,F1分数达到96.69%,同时保持了4.1 MB的紧凑模型大小。采用TensorRT Python应用程序编程接口(API),将该模型优化部署在Nvidia Jetson Orin Nano上,平均接口速度超过30 fps,表明该模型具有实时检测能力。本研究可为基于边缘装置的桔梗果机器人采收提供技术支持。
Accurate Orah fruit detection method using lightweight improved YOLOv8n model verified by optimized deployment on edge device
The replacement of personal computer terminal with edge device is recognized as a portable and cost-effective potential solution in solving equipment miniaturization and achieving high flexibility of robotic fruit harvesting at in-field scale. This study proposes a lightweight improved You Only Look Once version 8n (YOLOv8n) model for detecting Orah fruits and deploying this model on an edge device. First of all, the model size was reduced while maintaining detection accuracy via the introduction of the ADown modules. Subsequently, a Concentrated-Comprehensive Dual Convolution (C3_DualConv) module combining dual convolutional bottlenecks was proposed to enhance the model capability to capture features of Orah fruits obscured by branches and leaves; this practice further reduced the model size. Additionally, a Bidirectional Feature Pyramid Network (BiFPN) that includes a pyramid level 2 high-resolution layer was employed for more efficient multi-scale feature fusion. Besides, three Coordinate Attention (CA) mechanism modules were also added to improve the recognition and capture capability for Orah fruit features. Finally, a more focused minimum points distance intersection over union loss was adopted to boost the detection efficiency of densely occluded Orah fruits. Experimentally demonstrating that the improved YOLOv8n model accurately detected Orah fruits in complex orchard environments, achieving a 97.7 % of precision, an Average Precision at IoU threshold 0.5 ([email protected]) of 98.8 %, and a 96.69 % of F1 score, while maintaining a compact model size of 4.1 MB, under a Windows-based system terminal. This proposed model was optimally deployed on an Nvidia Jetson Orin Nano using TensorRT Python Application Programming Interface (API), the average interface speed exceeds 30 fps, indicating a real-time detection ability. This study can provide technical support for Orah fruit robotic harvesting on the basis of edge device.