在复杂果园环境中实时检测荔枝:一种便携式、低能耗的边缘计算方法,用于增强自动采摘功能

IF 8.2 Q1 AGRICULTURE, MULTIDISCIPLINARY
Zeyu Jiao , Kai Huang , Qun Wang , Zhenyu Zhong , Yingjie Cai
{"title":"在复杂果园环境中实时检测荔枝:一种便携式、低能耗的边缘计算方法,用于增强自动采摘功能","authors":"Zeyu Jiao ,&nbsp;Kai Huang ,&nbsp;Qun Wang ,&nbsp;Zhenyu Zhong ,&nbsp;Yingjie Cai","doi":"10.1016/j.aiia.2023.12.002","DOIUrl":null,"url":null,"abstract":"<div><p>Litchi, a succulent and perishable fruit, presents a narrow annual harvest window of under two weeks. The advent of smart agriculture has driven the adoption of visually-guided, automated litchi harvesting techniques. However, conventional approaches typically rely on laboratory-based, high-performance computing equipment, which presents challenges in terms of size, energy consumption, and practical application within litchi orchards. To address these limitations, we propose a real-time litchi detection methodology for complex environments, utilizing portable, low-energy edge computing devices. Initially, the litchi orchard imagery is collected to enhance data generalization. Subsequently, a convolutional neural network (CNN)-based single-stage detector, YOLOx, is constructed to accurately pinpoint litchi fruit locations within the images. To facilitate deployment on portable, low-energy edge devices, we employed channel pruning and layer pruning algorithms to compress the trained model, reducing its size and parameters. Additionally, the knowledge distillation technique is harnessed to fine-tune the network. Experimental findings demonstrated that our proposed method achieved a 97.1% compression rate, yielding a compact litchi detection model of a mere 6.9 MB, while maintaining 94.9% average precision and 97.2% average recall. Processing 99 frames per second (FPS), the method exhibited a 1.8-fold increase in speed compared to the unprocessed model. Consequently, our approach can be readily integrated into portable, low-computational automatic harvesting equipment, ensuring real-time, precise litchi detection within orchard settings.</p></div>","PeriodicalId":52814,"journal":{"name":"Artificial Intelligence in Agriculture","volume":null,"pages":null},"PeriodicalIF":8.2000,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S258972172300051X/pdfft?md5=184c6e07ee017be8224834a9e8f6c30d&pid=1-s2.0-S258972172300051X-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Real-time litchi detection in complex orchard environments: A portable, low-energy edge computing approach for enhanced automated harvesting\",\"authors\":\"Zeyu Jiao ,&nbsp;Kai Huang ,&nbsp;Qun Wang ,&nbsp;Zhenyu Zhong ,&nbsp;Yingjie Cai\",\"doi\":\"10.1016/j.aiia.2023.12.002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Litchi, a succulent and perishable fruit, presents a narrow annual harvest window of under two weeks. The advent of smart agriculture has driven the adoption of visually-guided, automated litchi harvesting techniques. However, conventional approaches typically rely on laboratory-based, high-performance computing equipment, which presents challenges in terms of size, energy consumption, and practical application within litchi orchards. To address these limitations, we propose a real-time litchi detection methodology for complex environments, utilizing portable, low-energy edge computing devices. Initially, the litchi orchard imagery is collected to enhance data generalization. Subsequently, a convolutional neural network (CNN)-based single-stage detector, YOLOx, is constructed to accurately pinpoint litchi fruit locations within the images. To facilitate deployment on portable, low-energy edge devices, we employed channel pruning and layer pruning algorithms to compress the trained model, reducing its size and parameters. Additionally, the knowledge distillation technique is harnessed to fine-tune the network. Experimental findings demonstrated that our proposed method achieved a 97.1% compression rate, yielding a compact litchi detection model of a mere 6.9 MB, while maintaining 94.9% average precision and 97.2% average recall. Processing 99 frames per second (FPS), the method exhibited a 1.8-fold increase in speed compared to the unprocessed model. Consequently, our approach can be readily integrated into portable, low-computational automatic harvesting equipment, ensuring real-time, precise litchi detection within orchard settings.</p></div>\",\"PeriodicalId\":52814,\"journal\":{\"name\":\"Artificial Intelligence in Agriculture\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.2000,\"publicationDate\":\"2023-12-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S258972172300051X/pdfft?md5=184c6e07ee017be8224834a9e8f6c30d&pid=1-s2.0-S258972172300051X-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Artificial Intelligence in Agriculture\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S258972172300051X\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence in Agriculture","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S258972172300051X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

荔枝是一种多汁易腐烂的水果,每年只有不到两周的收获期。智能农业的出现推动了视觉引导、自动化荔枝收获技术的采用。然而,传统的方法通常依赖于基于实验室的高性能计算设备,这在规模、能耗和荔枝果园的实际应用方面提出了挑战。为了解决这些限制,我们提出了一种用于复杂环境的实时荔枝检测方法,利用便携式,低能耗的边缘计算设备。首先,收集荔枝园图像以增强数据泛化。随后,构建了基于卷积神经网络(CNN)的单级检测器YOLOx,以准确定位图像中的荔枝果实位置。为了便于在便携式、低能量的边缘设备上部署,我们使用通道修剪和层修剪算法来压缩训练模型,减小其大小和参数。此外,利用知识蒸馏技术对网络进行微调。实验结果表明,该方法实现了97.1%的压缩率,生成了一个紧凑的荔枝检测模型,仅为6.9 MB,同时保持了94.9%的平均精度和97.2%的平均召回率。该方法每秒处理99帧(FPS),与未处理的模型相比,速度提高了1.8倍。因此,我们的方法可以很容易地集成到便携式、低计算的自动收获设备中,确保在果园设置中实时、精确地检测荔枝。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Real-time litchi detection in complex orchard environments: A portable, low-energy edge computing approach for enhanced automated harvesting

Litchi, a succulent and perishable fruit, presents a narrow annual harvest window of under two weeks. The advent of smart agriculture has driven the adoption of visually-guided, automated litchi harvesting techniques. However, conventional approaches typically rely on laboratory-based, high-performance computing equipment, which presents challenges in terms of size, energy consumption, and practical application within litchi orchards. To address these limitations, we propose a real-time litchi detection methodology for complex environments, utilizing portable, low-energy edge computing devices. Initially, the litchi orchard imagery is collected to enhance data generalization. Subsequently, a convolutional neural network (CNN)-based single-stage detector, YOLOx, is constructed to accurately pinpoint litchi fruit locations within the images. To facilitate deployment on portable, low-energy edge devices, we employed channel pruning and layer pruning algorithms to compress the trained model, reducing its size and parameters. Additionally, the knowledge distillation technique is harnessed to fine-tune the network. Experimental findings demonstrated that our proposed method achieved a 97.1% compression rate, yielding a compact litchi detection model of a mere 6.9 MB, while maintaining 94.9% average precision and 97.2% average recall. Processing 99 frames per second (FPS), the method exhibited a 1.8-fold increase in speed compared to the unprocessed model. Consequently, our approach can be readily integrated into portable, low-computational automatic harvesting equipment, ensuring real-time, precise litchi detection within orchard settings.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Artificial Intelligence in Agriculture
Artificial Intelligence in Agriculture Engineering-Engineering (miscellaneous)
CiteScore
21.60
自引率
0.00%
发文量
18
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信