智能手机图像害虫监测的高效零标记分割方法

IF 4.5 1区 农林科学 Q1 AGRONOMY
L. Minh Dang , Sufyan Danish , Asma Khan , Nur Alam , Muhammad Fayaz , Dinh Khuong Nguyen , Hyoung-Kyu Song , Hyeonjoon Moon
{"title":"智能手机图像害虫监测的高效零标记分割方法","authors":"L. Minh Dang ,&nbsp;Sufyan Danish ,&nbsp;Asma Khan ,&nbsp;Nur Alam ,&nbsp;Muhammad Fayaz ,&nbsp;Dinh Khuong Nguyen ,&nbsp;Hyoung-Kyu Song ,&nbsp;Hyeonjoon Moon","doi":"10.1016/j.eja.2024.127331","DOIUrl":null,"url":null,"abstract":"<div><p>Timely and precise farm inspection, which involves the identification and recognition of harmful insects and diseases, is crucial for safeguarding crop production. Traditional vision-based pest recognition methods typically require extensive annotated data for each pest species and a lengthy training process. This approach is time-consuming, labor-intensive, and prone to human error. Zero-shot learning offers a potential solution by enabling pest segmentation and control without requiring explicit training data. This study supports farmers in automatically identifying ten common pests and their precise locations in real-world outdoor environments. The zero-shot pest segmentation is based on a hybrid approach combining Explainable Contrastive Language-Image Pre-training (ECLIP) and Segment-Anything (SAM). Moreover, an optimized super-resolution model and various data augmentation methods are implemented to improve the quality of the dataset. Lastly, a mask post-processing step is applied to remove highly overlapping segmented masks and noise blobs caused by the complex background. The mean Intersection over Union (mIoU) of 66.5 % on the validation set demonstrates the potential of zero-shot methods for automated pest segmentation during farm inspections. This research lays the foundation for accurate pest monitoring systems capable of adapting to new pests, ultimately improving agricultural productivity.</p></div>","PeriodicalId":51045,"journal":{"name":"European Journal of Agronomy","volume":"160 ","pages":"Article 127331"},"PeriodicalIF":4.5000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An efficient zero-labeling segmentation approach for pest monitoring on smartphone-based images\",\"authors\":\"L. Minh Dang ,&nbsp;Sufyan Danish ,&nbsp;Asma Khan ,&nbsp;Nur Alam ,&nbsp;Muhammad Fayaz ,&nbsp;Dinh Khuong Nguyen ,&nbsp;Hyoung-Kyu Song ,&nbsp;Hyeonjoon Moon\",\"doi\":\"10.1016/j.eja.2024.127331\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Timely and precise farm inspection, which involves the identification and recognition of harmful insects and diseases, is crucial for safeguarding crop production. Traditional vision-based pest recognition methods typically require extensive annotated data for each pest species and a lengthy training process. This approach is time-consuming, labor-intensive, and prone to human error. Zero-shot learning offers a potential solution by enabling pest segmentation and control without requiring explicit training data. This study supports farmers in automatically identifying ten common pests and their precise locations in real-world outdoor environments. The zero-shot pest segmentation is based on a hybrid approach combining Explainable Contrastive Language-Image Pre-training (ECLIP) and Segment-Anything (SAM). Moreover, an optimized super-resolution model and various data augmentation methods are implemented to improve the quality of the dataset. Lastly, a mask post-processing step is applied to remove highly overlapping segmented masks and noise blobs caused by the complex background. The mean Intersection over Union (mIoU) of 66.5 % on the validation set demonstrates the potential of zero-shot methods for automated pest segmentation during farm inspections. This research lays the foundation for accurate pest monitoring systems capable of adapting to new pests, ultimately improving agricultural productivity.</p></div>\",\"PeriodicalId\":51045,\"journal\":{\"name\":\"European Journal of Agronomy\",\"volume\":\"160 \",\"pages\":\"Article 127331\"},\"PeriodicalIF\":4.5000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European Journal of Agronomy\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1161030124002521\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRONOMY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Agronomy","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1161030124002521","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRONOMY","Score":null,"Total":0}
引用次数: 0

摘要

及时、精确的农场检查,包括识别有害昆虫和疾病,对于保障作物生产至关重要。传统的基于视觉的害虫识别方法通常需要为每种害虫提供大量注释数据和漫长的训练过程。这种方法耗时、耗力,而且容易出现人为错误。零镜头学习提供了一种潜在的解决方案,它无需明确的训练数据,就能实现害虫分割和控制。本研究支持农民自动识别十种常见害虫及其在真实室外环境中的精确位置。零镜头害虫分割基于一种混合方法,该方法结合了可解释对比语言-图像预训练(ECLIP)和任意分段(SAM)。此外,还采用了优化的超分辨率模型和各种数据增强方法,以提高数据集的质量。最后,应用掩膜后处理步骤来去除高度重叠的分段掩膜和复杂背景造成的噪点。验证集上的平均交集大于联合度(mIoU)为 66.5%,这证明了零镜头方法在农场检查期间进行自动害虫分割的潜力。这项研究为能够适应新害虫的精确害虫监测系统奠定了基础,最终将提高农业生产率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An efficient zero-labeling segmentation approach for pest monitoring on smartphone-based images

Timely and precise farm inspection, which involves the identification and recognition of harmful insects and diseases, is crucial for safeguarding crop production. Traditional vision-based pest recognition methods typically require extensive annotated data for each pest species and a lengthy training process. This approach is time-consuming, labor-intensive, and prone to human error. Zero-shot learning offers a potential solution by enabling pest segmentation and control without requiring explicit training data. This study supports farmers in automatically identifying ten common pests and their precise locations in real-world outdoor environments. The zero-shot pest segmentation is based on a hybrid approach combining Explainable Contrastive Language-Image Pre-training (ECLIP) and Segment-Anything (SAM). Moreover, an optimized super-resolution model and various data augmentation methods are implemented to improve the quality of the dataset. Lastly, a mask post-processing step is applied to remove highly overlapping segmented masks and noise blobs caused by the complex background. The mean Intersection over Union (mIoU) of 66.5 % on the validation set demonstrates the potential of zero-shot methods for automated pest segmentation during farm inspections. This research lays the foundation for accurate pest monitoring systems capable of adapting to new pests, ultimately improving agricultural productivity.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
European Journal of Agronomy
European Journal of Agronomy 农林科学-农艺学
CiteScore
8.30
自引率
7.70%
发文量
187
审稿时长
4.5 months
期刊介绍: The European Journal of Agronomy, the official journal of the European Society for Agronomy, publishes original research papers reporting experimental and theoretical contributions to field-based agronomy and crop science. The journal will consider research at the field level for agricultural, horticultural and tree crops, that uses comprehensive and explanatory approaches. The EJA covers the following topics: crop physiology crop production and management including irrigation, fertilization and soil management agroclimatology and modelling plant-soil relationships crop quality and post-harvest physiology farming and cropping systems agroecosystems and the environment crop-weed interactions and management organic farming horticultural crops papers from the European Society for Agronomy bi-annual meetings In determining the suitability of submitted articles for publication, particular scrutiny is placed on the degree of novelty and significance of the research and the extent to which it adds to existing knowledge in agronomy.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信