Multi-Growth Period Tomato Fruit Detection Using Improved Yolov5

Yingyan Yang, Yuxiao Han, Shuai Li, Han Li, Man Zhang
{"title":"Multi-Growth Period Tomato Fruit Detection Using Improved Yolov5","authors":"Yingyan Yang, Yuxiao Han, Shuai Li, Han Li, Man Zhang","doi":"10.31875/2409-9694.2022.09.06","DOIUrl":null,"url":null,"abstract":"Abstract: In agricultural mechanized production, in order to ensure the efficiency of hand-eye cooperative operation of tomato picking robot, the recognition accuracy and speed of multi-growth period tomato fruit is an important basis. Therefore, in order to improve the recognition speed of multi-growth period tomato fruit while ensuring or improving the accuracy, this paper improves the Yolov5s model by adding the architecture of the lightweight mobilenetv3 model. Firstly, the deep separable convolution is replaced in the backbone network of Yolov5s, which reduces the amount of convolution operation. Secondly, the linear bottleneck inverse residual structure is fused to obtain more features in high-dimensional space and perform convolution operation in low-dimensional space. Third, the attention mechanism is inserted into the last layer of the network to highlight features and improve accuracy. The research results show that the recognition accuracy of the improved Yolov5 model remains above 98%, the CPU recognition speed is 0.88f·s-1 faster than Yolov5s, and the GPU recognition speed is 90 frames per second faster than Yolov5s. Finally, a set of the recognition software system of multi-growth period tomato fruit is designed and developed by using RealSense D435i depth camera and PYQT. The software system further verifies the feasibility of the improved Yolov5 model, and lays a foundation for the visual software design of agricultural picking robot picking recognition.","PeriodicalId":234563,"journal":{"name":"International Journal of Robotics and Automation Technology","volume":"133 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Robotics and Automation Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.31875/2409-9694.2022.09.06","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Abstract: In agricultural mechanized production, in order to ensure the efficiency of hand-eye cooperative operation of tomato picking robot, the recognition accuracy and speed of multi-growth period tomato fruit is an important basis. Therefore, in order to improve the recognition speed of multi-growth period tomato fruit while ensuring or improving the accuracy, this paper improves the Yolov5s model by adding the architecture of the lightweight mobilenetv3 model. Firstly, the deep separable convolution is replaced in the backbone network of Yolov5s, which reduces the amount of convolution operation. Secondly, the linear bottleneck inverse residual structure is fused to obtain more features in high-dimensional space and perform convolution operation in low-dimensional space. Third, the attention mechanism is inserted into the last layer of the network to highlight features and improve accuracy. The research results show that the recognition accuracy of the improved Yolov5 model remains above 98%, the CPU recognition speed is 0.88f·s-1 faster than Yolov5s, and the GPU recognition speed is 90 frames per second faster than Yolov5s. Finally, a set of the recognition software system of multi-growth period tomato fruit is designed and developed by using RealSense D435i depth camera and PYQT. The software system further verifies the feasibility of the improved Yolov5 model, and lays a foundation for the visual software design of agricultural picking robot picking recognition.
改良Yolov5番茄多生育期果实检测
摘要:在农业机械化生产中,为了保证番茄采摘机器人手眼协同作业的效率,多生育期番茄果实的识别精度和速度是重要的基础。因此,为了在保证或提高准确率的同时提高多生长期番茄果实的识别速度,本文通过加入轻量级mobilenetv3模型的架构,对Yolov5s模型进行了改进。首先,在Yolov5s骨干网中替换深度可分离卷积,减少了卷积运算量;其次,融合线性瓶颈逆残差结构,在高维空间获得更多特征,在低维空间进行卷积运算;第三,将注意力机制插入到网络的最后一层,突出特征,提高准确率。研究结果表明,改进后的Yolov5模型识别准确率保持在98%以上,CPU识别速度比Yolov5s快0.88f·s-1, GPU识别速度比Yolov5s快90帧/秒。最后,利用RealSense D435i深度相机和PYQT设计开发了一套多生育期番茄果实识别软件系统。软件系统进一步验证了改进后的Yolov5模型的可行性,为农业采摘机器人采摘识别的可视化软件设计奠定了基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信