LDC-PP-YOLOE:检测和计数柑橘类水果的轻量级模型

IF 3.7 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Yibo Lv, Shenglian Lu, Xiaoyu Liu, Jiangchuan Bao, Binghao Liu, Ming Chen, Guo Li
{"title":"LDC-PP-YOLOE:检测和计数柑橘类水果的轻量级模型","authors":"Yibo Lv, Shenglian Lu, Xiaoyu Liu, Jiangchuan Bao, Binghao Liu, Ming Chen, Guo Li","doi":"10.1007/s10044-024-01329-1","DOIUrl":null,"url":null,"abstract":"<p>In the citrus orchard environment, accurate counting of the fruit, and the use of lightweight detection methods are the key presteps to automate citrus picking and yield estimations. Most high-precision fruit detection models based on deep learning use complex models with devices that require high quantities of computational resources and memory. Devices with limited resources cannot meet the requirements of these models. Thus, to overcome this problem, we focus on creating a lightweight model with a convolutional neural network. In this research, we propose a lightweight citrus detection model based on the mobile device LDC-PP-YOLOE. LDC-PP-YOLOE is improved based on PP-YOLOE by using localized knowledge distillation and CBAM, with a mAP@0.5 of 88<span>\\(\\%\\)</span>, mAP@0.95 of 51.3<span>\\(\\%\\)</span>, params of 8 M and speed of 0.34 s, respectively. The performance of LDC-PP-YOLOE was compared against commonly used detectors and LDC-PP-YOLOE’s mAP@0.5 was 2.5, 6.9 and 16.3<span>\\(\\%\\)</span>, and was 4.3<span>\\(\\%\\)</span> greater than Faster R-CNN, YOLOX-s and PicoDet-L, respectively. LDC-PP-YOLOE achieved an RMSE of 8.63 and an MSE of 5.27 compared to the ground truth on citrus applications. In addition, we used apple and passion fruit datasets to verify the generalization of the model; the mAP@0.5 is improved by 1 and 0.7<span>\\(\\%\\)</span>. LDC-PP-YOLOE can be used as a lightweight model to help growers track citrus populations and optimize citrus yields in complex citrus orchard environments with resource-limited equipment. It also provides a solution for lightweight models.</p>","PeriodicalId":54639,"journal":{"name":"Pattern Analysis and Applications","volume":"190 1","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"LDC-PP-YOLOE: a lightweight model for detecting and counting citrus fruit\",\"authors\":\"Yibo Lv, Shenglian Lu, Xiaoyu Liu, Jiangchuan Bao, Binghao Liu, Ming Chen, Guo Li\",\"doi\":\"10.1007/s10044-024-01329-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>In the citrus orchard environment, accurate counting of the fruit, and the use of lightweight detection methods are the key presteps to automate citrus picking and yield estimations. Most high-precision fruit detection models based on deep learning use complex models with devices that require high quantities of computational resources and memory. Devices with limited resources cannot meet the requirements of these models. Thus, to overcome this problem, we focus on creating a lightweight model with a convolutional neural network. In this research, we propose a lightweight citrus detection model based on the mobile device LDC-PP-YOLOE. LDC-PP-YOLOE is improved based on PP-YOLOE by using localized knowledge distillation and CBAM, with a mAP@0.5 of 88<span>\\\\(\\\\%\\\\)</span>, mAP@0.95 of 51.3<span>\\\\(\\\\%\\\\)</span>, params of 8 M and speed of 0.34 s, respectively. The performance of LDC-PP-YOLOE was compared against commonly used detectors and LDC-PP-YOLOE’s mAP@0.5 was 2.5, 6.9 and 16.3<span>\\\\(\\\\%\\\\)</span>, and was 4.3<span>\\\\(\\\\%\\\\)</span> greater than Faster R-CNN, YOLOX-s and PicoDet-L, respectively. LDC-PP-YOLOE achieved an RMSE of 8.63 and an MSE of 5.27 compared to the ground truth on citrus applications. In addition, we used apple and passion fruit datasets to verify the generalization of the model; the mAP@0.5 is improved by 1 and 0.7<span>\\\\(\\\\%\\\\)</span>. LDC-PP-YOLOE can be used as a lightweight model to help growers track citrus populations and optimize citrus yields in complex citrus orchard environments with resource-limited equipment. It also provides a solution for lightweight models.</p>\",\"PeriodicalId\":54639,\"journal\":{\"name\":\"Pattern Analysis and Applications\",\"volume\":\"190 1\",\"pages\":\"\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pattern Analysis and Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s10044-024-01329-1\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Analysis and Applications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10044-024-01329-1","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

在柑橘园环境中,准确的果实计数和轻量级检测方法的使用是实现柑橘采摘和产量估算自动化的关键步骤。大多数基于深度学习的高精度水果检测模型都使用复杂的模型,其设备需要大量的计算资源和内存。资源有限的设备无法满足这些模型的要求。因此,为了克服这一问题,我们专注于利用卷积神经网络创建轻量级模型。在本研究中,我们提出了一种基于移动设备 LDC-PP-YOLOE 的轻量级柑橘检测模型。LDC-PP-YOLOE是在PP-YOLOE的基础上通过使用局部知识提炼和CBAM改进而来的,其mAP@0.5,mAP@0.95,参数为8 M,速度为0.34 s。LDC-PP-YOLOE 的性能与常用检测器进行了比较,LDC-PP-YOLOE 的 mAP@0.5 分别为 2.5、6.9 和 16.3(\%\),比 Faster R-CNN、YOLOX-s 和 PicoDet-L 分别高出 4.3(\%\)。在柑橘应用中,LDC-PP-YOLOE 与地面实况相比,RMSE 为 8.63,MSE 为 5.27。此外,我们还使用苹果和百香果数据集来验证模型的泛化效果;mAP@0.5,分别提高了 1 和 0.7(\%\)。LDC-PP-YOLOE 可作为一种轻量级模型,帮助种植者在设备资源有限的复杂柑橘园环境中跟踪柑橘种群并优化柑橘产量。它还为轻量级模型提供了一种解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

LDC-PP-YOLOE: a lightweight model for detecting and counting citrus fruit

LDC-PP-YOLOE: a lightweight model for detecting and counting citrus fruit

In the citrus orchard environment, accurate counting of the fruit, and the use of lightweight detection methods are the key presteps to automate citrus picking and yield estimations. Most high-precision fruit detection models based on deep learning use complex models with devices that require high quantities of computational resources and memory. Devices with limited resources cannot meet the requirements of these models. Thus, to overcome this problem, we focus on creating a lightweight model with a convolutional neural network. In this research, we propose a lightweight citrus detection model based on the mobile device LDC-PP-YOLOE. LDC-PP-YOLOE is improved based on PP-YOLOE by using localized knowledge distillation and CBAM, with a mAP@0.5 of 88\(\%\), mAP@0.95 of 51.3\(\%\), params of 8 M and speed of 0.34 s, respectively. The performance of LDC-PP-YOLOE was compared against commonly used detectors and LDC-PP-YOLOE’s mAP@0.5 was 2.5, 6.9 and 16.3\(\%\), and was 4.3\(\%\) greater than Faster R-CNN, YOLOX-s and PicoDet-L, respectively. LDC-PP-YOLOE achieved an RMSE of 8.63 and an MSE of 5.27 compared to the ground truth on citrus applications. In addition, we used apple and passion fruit datasets to verify the generalization of the model; the mAP@0.5 is improved by 1 and 0.7\(\%\). LDC-PP-YOLOE can be used as a lightweight model to help growers track citrus populations and optimize citrus yields in complex citrus orchard environments with resource-limited equipment. It also provides a solution for lightweight models.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Pattern Analysis and Applications
Pattern Analysis and Applications 工程技术-计算机:人工智能
CiteScore
7.40
自引率
2.60%
发文量
76
审稿时长
13.5 months
期刊介绍: The journal publishes high quality articles in areas of fundamental research in intelligent pattern analysis and applications in computer science and engineering. It aims to provide a forum for original research which describes novel pattern analysis techniques and industrial applications of the current technology. In addition, the journal will also publish articles on pattern analysis applications in medical imaging. The journal solicits articles that detail new technology and methods for pattern recognition and analysis in applied domains including, but not limited to, computer vision and image processing, speech analysis, robotics, multimedia, document analysis, character recognition, knowledge engineering for pattern recognition, fractal analysis, and intelligent control. The journal publishes articles on the use of advanced pattern recognition and analysis methods including statistical techniques, neural networks, genetic algorithms, fuzzy pattern recognition, machine learning, and hardware implementations which are either relevant to the development of pattern analysis as a research area or detail novel pattern analysis applications. Papers proposing new classifier systems or their development, pattern analysis systems for real-time applications, fuzzy and temporal pattern recognition and uncertainty management in applied pattern recognition are particularly solicited.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信