优化的Yolov5s-Im在无人机授粉中实时检测苹果花

IF 5.7 Q1 AGRICULTURAL ENGINEERING
Shahram Hamza Manzoor , Zhao Zhang , Hongwen Li , Qu Zhang , Kuifan Chen , C. Igathinathane , Tianzhong Li , Wei Li , Muhammad Naveed Tahir , Nabil Mustafa , Mustafa Mhamed
{"title":"优化的Yolov5s-Im在无人机授粉中实时检测苹果花","authors":"Shahram Hamza Manzoor ,&nbsp;Zhao Zhang ,&nbsp;Hongwen Li ,&nbsp;Qu Zhang ,&nbsp;Kuifan Chen ,&nbsp;C. Igathinathane ,&nbsp;Tianzhong Li ,&nbsp;Wei Li ,&nbsp;Muhammad Naveed Tahir ,&nbsp;Nabil Mustafa ,&nbsp;Mustafa Mhamed","doi":"10.1016/j.atech.2025.101150","DOIUrl":null,"url":null,"abstract":"<div><div>As traditional pollinators face increasing threats from climate change, the development of robotic pollination technology has become imperative, with apple flower detection emerging as a critical component of the technology. Deep learning (DL) advancements present novel methods in enhancing apple flower detection efficiency. However, deploying in real time on resource-constrained drone platforms demands a balance between computational efficiency and accuracy. To address this challenge, this study introduces an improved you-only-look-once version 5 small (YOLOv5s-Im) model by improving the original YOLOv5s architecture, using MobileNet version 3 as the backbone and GhostNet as the neck. This study then validated the YOLOv5s-Im performance by deploying it in real time on a drone platform designed for apple flower pollination. YOLOv5s-Im achieved an 88 % detection accuracy and averaged 41.6 pollination attempts per 3-minute flight across five tests, significantly outperforming YOLOv5s and YOLOv5s with Transformers (YOLOv5s-T) as backbone (fewer than 10 attempts), due to its 2 FPS inference speed versus their 0.05 FPS. Control tests with lightweight models YOLOv5s with ShuffleNet version 2 (YOLOv5-Sh-V2) and YOLOv5s with MobileNet version 2 (YOLOv5s-Mb-V2) as backbones, averaged 37.8 and 30.6 attempts per flight, respectively, with accuracies of 80 % and 82 % mAP and detection speeds of 1.0 FPS and 0.7 FPS, further confirming YOLOv5s-Im’s superior balance of accuracy and efficiency. Its robust accuracy (84 %-88 %) across diverse conditions—clear light (88 %), afternoon settings (86 %), angled views (87 %), and low-light shadows (84 %)—demonstrates reliability in varied orchard environments. Compared to YOLOv5s, YOLOv5s-T, YOLOv7, YOLOv8, and Faster-R-CNN, YOLOv5s-Im excels with precision (90.6 %), recall (87.7 %), mAP50 (91.2 %), and F1-score (89.42 %), while reducing GFLOPS by 89 % and model size by 85 %, achieving high frame rates (227 FPS on NVIDIA RTX 4060 Ti, 22 FPS on Jetson Xavier, 4.56 FPS on Intel NUC11TNKi3). These results make YOLOv5s-Im an effective solution for real-time apple flower detection under natural lighting conditions in drone-based pollination systems.</div></div>","PeriodicalId":74813,"journal":{"name":"Smart agricultural technology","volume":"12 ","pages":"Article 101150"},"PeriodicalIF":5.7000,"publicationDate":"2025-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimized Yolov5s-Im for real-time apple flower detection in drone-based pollination\",\"authors\":\"Shahram Hamza Manzoor ,&nbsp;Zhao Zhang ,&nbsp;Hongwen Li ,&nbsp;Qu Zhang ,&nbsp;Kuifan Chen ,&nbsp;C. Igathinathane ,&nbsp;Tianzhong Li ,&nbsp;Wei Li ,&nbsp;Muhammad Naveed Tahir ,&nbsp;Nabil Mustafa ,&nbsp;Mustafa Mhamed\",\"doi\":\"10.1016/j.atech.2025.101150\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>As traditional pollinators face increasing threats from climate change, the development of robotic pollination technology has become imperative, with apple flower detection emerging as a critical component of the technology. Deep learning (DL) advancements present novel methods in enhancing apple flower detection efficiency. However, deploying in real time on resource-constrained drone platforms demands a balance between computational efficiency and accuracy. To address this challenge, this study introduces an improved you-only-look-once version 5 small (YOLOv5s-Im) model by improving the original YOLOv5s architecture, using MobileNet version 3 as the backbone and GhostNet as the neck. This study then validated the YOLOv5s-Im performance by deploying it in real time on a drone platform designed for apple flower pollination. YOLOv5s-Im achieved an 88 % detection accuracy and averaged 41.6 pollination attempts per 3-minute flight across five tests, significantly outperforming YOLOv5s and YOLOv5s with Transformers (YOLOv5s-T) as backbone (fewer than 10 attempts), due to its 2 FPS inference speed versus their 0.05 FPS. Control tests with lightweight models YOLOv5s with ShuffleNet version 2 (YOLOv5-Sh-V2) and YOLOv5s with MobileNet version 2 (YOLOv5s-Mb-V2) as backbones, averaged 37.8 and 30.6 attempts per flight, respectively, with accuracies of 80 % and 82 % mAP and detection speeds of 1.0 FPS and 0.7 FPS, further confirming YOLOv5s-Im’s superior balance of accuracy and efficiency. Its robust accuracy (84 %-88 %) across diverse conditions—clear light (88 %), afternoon settings (86 %), angled views (87 %), and low-light shadows (84 %)—demonstrates reliability in varied orchard environments. Compared to YOLOv5s, YOLOv5s-T, YOLOv7, YOLOv8, and Faster-R-CNN, YOLOv5s-Im excels with precision (90.6 %), recall (87.7 %), mAP50 (91.2 %), and F1-score (89.42 %), while reducing GFLOPS by 89 % and model size by 85 %, achieving high frame rates (227 FPS on NVIDIA RTX 4060 Ti, 22 FPS on Jetson Xavier, 4.56 FPS on Intel NUC11TNKi3). These results make YOLOv5s-Im an effective solution for real-time apple flower detection under natural lighting conditions in drone-based pollination systems.</div></div>\",\"PeriodicalId\":74813,\"journal\":{\"name\":\"Smart agricultural technology\",\"volume\":\"12 \",\"pages\":\"Article 101150\"},\"PeriodicalIF\":5.7000,\"publicationDate\":\"2025-07-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Smart agricultural technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S277237552500382X\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURAL ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Smart agricultural technology","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S277237552500382X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURAL ENGINEERING","Score":null,"Total":0}
引用次数: 0

摘要

随着传统传粉媒介面临越来越多的气候变化威胁,机器人传粉技术的发展势在必行,苹果花检测成为该技术的关键组成部分。深度学习(DL)的进步为提高苹果花的检测效率提供了新的方法。然而,在资源受限的无人机平台上进行实时部署需要在计算效率和准确性之间取得平衡。为了解决这一挑战,本研究通过改进原始的YOLOv5s架构,采用MobileNet版本3作为主干,GhostNet作为颈部,引入了改进的you-only-look-once version 5 small (YOLOv5s- im)模型。该研究随后通过将YOLOv5s-Im实时部署在专为苹果花授粉设计的无人机平台上,验证了YOLOv5s-Im的性能。在五次测试中,YOLOv5s- im达到了88%的检测精度,平均每3分钟飞行41.6次授粉尝试,显著优于YOLOv5s和YOLOv5s与变形者(YOLOv5s- t)作为主干(少于10次尝试),因为它的2 FPS推理速度比它们的0.05 FPS。以ShuffleNet version 2 (YOLOv5-Sh-V2)和MobileNet version 2 (YOLOv5s- mb - v2)为骨架的轻量级型号YOLOv5s进行对照测试,平均每次飞行分别为37.8次和30.6次,mAP精度为80%和82%,检测速度为1.0 FPS和0.7 FPS,进一步证实了YOLOv5s- im在精度和效率方面的卓越平衡。它在不同条件下的强大精度(84% - 88%)——明亮的光线(88%)、下午的环境(86%)、角度视角(87%)和低光阴影(84%)——在不同的果园环境中证明了可靠性。与YOLOv5s、YOLOv5s- t、YOLOv7、YOLOv8和Faster-R-CNN相比,YOLOv5s- im在精度(90.6%)、查全率(87.7%)、mAP50(91.2%)和F1-score(89.42%)方面表现优异,GFLOPS降低了89%,模型大小降低了85%,实现了高帧率(NVIDIA RTX 4060 Ti上227 FPS, Jetson Xavier上22 FPS, Intel NUC11TNKi3上4.56 FPS)。这些结果使YOLOv5s-Im成为基于无人机授粉系统中自然光条件下实时苹果花检测的有效解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Optimized Yolov5s-Im for real-time apple flower detection in drone-based pollination
As traditional pollinators face increasing threats from climate change, the development of robotic pollination technology has become imperative, with apple flower detection emerging as a critical component of the technology. Deep learning (DL) advancements present novel methods in enhancing apple flower detection efficiency. However, deploying in real time on resource-constrained drone platforms demands a balance between computational efficiency and accuracy. To address this challenge, this study introduces an improved you-only-look-once version 5 small (YOLOv5s-Im) model by improving the original YOLOv5s architecture, using MobileNet version 3 as the backbone and GhostNet as the neck. This study then validated the YOLOv5s-Im performance by deploying it in real time on a drone platform designed for apple flower pollination. YOLOv5s-Im achieved an 88 % detection accuracy and averaged 41.6 pollination attempts per 3-minute flight across five tests, significantly outperforming YOLOv5s and YOLOv5s with Transformers (YOLOv5s-T) as backbone (fewer than 10 attempts), due to its 2 FPS inference speed versus their 0.05 FPS. Control tests with lightweight models YOLOv5s with ShuffleNet version 2 (YOLOv5-Sh-V2) and YOLOv5s with MobileNet version 2 (YOLOv5s-Mb-V2) as backbones, averaged 37.8 and 30.6 attempts per flight, respectively, with accuracies of 80 % and 82 % mAP and detection speeds of 1.0 FPS and 0.7 FPS, further confirming YOLOv5s-Im’s superior balance of accuracy and efficiency. Its robust accuracy (84 %-88 %) across diverse conditions—clear light (88 %), afternoon settings (86 %), angled views (87 %), and low-light shadows (84 %)—demonstrates reliability in varied orchard environments. Compared to YOLOv5s, YOLOv5s-T, YOLOv7, YOLOv8, and Faster-R-CNN, YOLOv5s-Im excels with precision (90.6 %), recall (87.7 %), mAP50 (91.2 %), and F1-score (89.42 %), while reducing GFLOPS by 89 % and model size by 85 %, achieving high frame rates (227 FPS on NVIDIA RTX 4060 Ti, 22 FPS on Jetson Xavier, 4.56 FPS on Intel NUC11TNKi3). These results make YOLOv5s-Im an effective solution for real-time apple flower detection under natural lighting conditions in drone-based pollination systems.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
4.20
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信