L. Minh Dang , Sufyan Danish , Asma Khan , Nur Alam , Muhammad Fayaz , Dinh Khuong Nguyen , Hyoung-Kyu Song , Hyeonjoon Moon
{"title":"智能手机图像害虫监测的高效零标记分割方法","authors":"L. Minh Dang , Sufyan Danish , Asma Khan , Nur Alam , Muhammad Fayaz , Dinh Khuong Nguyen , Hyoung-Kyu Song , Hyeonjoon Moon","doi":"10.1016/j.eja.2024.127331","DOIUrl":null,"url":null,"abstract":"<div><p>Timely and precise farm inspection, which involves the identification and recognition of harmful insects and diseases, is crucial for safeguarding crop production. Traditional vision-based pest recognition methods typically require extensive annotated data for each pest species and a lengthy training process. This approach is time-consuming, labor-intensive, and prone to human error. Zero-shot learning offers a potential solution by enabling pest segmentation and control without requiring explicit training data. This study supports farmers in automatically identifying ten common pests and their precise locations in real-world outdoor environments. The zero-shot pest segmentation is based on a hybrid approach combining Explainable Contrastive Language-Image Pre-training (ECLIP) and Segment-Anything (SAM). Moreover, an optimized super-resolution model and various data augmentation methods are implemented to improve the quality of the dataset. Lastly, a mask post-processing step is applied to remove highly overlapping segmented masks and noise blobs caused by the complex background. The mean Intersection over Union (mIoU) of 66.5 % on the validation set demonstrates the potential of zero-shot methods for automated pest segmentation during farm inspections. This research lays the foundation for accurate pest monitoring systems capable of adapting to new pests, ultimately improving agricultural productivity.</p></div>","PeriodicalId":51045,"journal":{"name":"European Journal of Agronomy","volume":"160 ","pages":"Article 127331"},"PeriodicalIF":4.5000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An efficient zero-labeling segmentation approach for pest monitoring on smartphone-based images\",\"authors\":\"L. Minh Dang , Sufyan Danish , Asma Khan , Nur Alam , Muhammad Fayaz , Dinh Khuong Nguyen , Hyoung-Kyu Song , Hyeonjoon Moon\",\"doi\":\"10.1016/j.eja.2024.127331\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Timely and precise farm inspection, which involves the identification and recognition of harmful insects and diseases, is crucial for safeguarding crop production. Traditional vision-based pest recognition methods typically require extensive annotated data for each pest species and a lengthy training process. This approach is time-consuming, labor-intensive, and prone to human error. Zero-shot learning offers a potential solution by enabling pest segmentation and control without requiring explicit training data. This study supports farmers in automatically identifying ten common pests and their precise locations in real-world outdoor environments. The zero-shot pest segmentation is based on a hybrid approach combining Explainable Contrastive Language-Image Pre-training (ECLIP) and Segment-Anything (SAM). Moreover, an optimized super-resolution model and various data augmentation methods are implemented to improve the quality of the dataset. Lastly, a mask post-processing step is applied to remove highly overlapping segmented masks and noise blobs caused by the complex background. The mean Intersection over Union (mIoU) of 66.5 % on the validation set demonstrates the potential of zero-shot methods for automated pest segmentation during farm inspections. This research lays the foundation for accurate pest monitoring systems capable of adapting to new pests, ultimately improving agricultural productivity.</p></div>\",\"PeriodicalId\":51045,\"journal\":{\"name\":\"European Journal of Agronomy\",\"volume\":\"160 \",\"pages\":\"Article 127331\"},\"PeriodicalIF\":4.5000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European Journal of Agronomy\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1161030124002521\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRONOMY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Agronomy","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1161030124002521","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRONOMY","Score":null,"Total":0}
An efficient zero-labeling segmentation approach for pest monitoring on smartphone-based images
Timely and precise farm inspection, which involves the identification and recognition of harmful insects and diseases, is crucial for safeguarding crop production. Traditional vision-based pest recognition methods typically require extensive annotated data for each pest species and a lengthy training process. This approach is time-consuming, labor-intensive, and prone to human error. Zero-shot learning offers a potential solution by enabling pest segmentation and control without requiring explicit training data. This study supports farmers in automatically identifying ten common pests and their precise locations in real-world outdoor environments. The zero-shot pest segmentation is based on a hybrid approach combining Explainable Contrastive Language-Image Pre-training (ECLIP) and Segment-Anything (SAM). Moreover, an optimized super-resolution model and various data augmentation methods are implemented to improve the quality of the dataset. Lastly, a mask post-processing step is applied to remove highly overlapping segmented masks and noise blobs caused by the complex background. The mean Intersection over Union (mIoU) of 66.5 % on the validation set demonstrates the potential of zero-shot methods for automated pest segmentation during farm inspections. This research lays the foundation for accurate pest monitoring systems capable of adapting to new pests, ultimately improving agricultural productivity.
期刊介绍:
The European Journal of Agronomy, the official journal of the European Society for Agronomy, publishes original research papers reporting experimental and theoretical contributions to field-based agronomy and crop science. The journal will consider research at the field level for agricultural, horticultural and tree crops, that uses comprehensive and explanatory approaches. The EJA covers the following topics:
crop physiology
crop production and management including irrigation, fertilization and soil management
agroclimatology and modelling
plant-soil relationships
crop quality and post-harvest physiology
farming and cropping systems
agroecosystems and the environment
crop-weed interactions and management
organic farming
horticultural crops
papers from the European Society for Agronomy bi-annual meetings
In determining the suitability of submitted articles for publication, particular scrutiny is placed on the degree of novelty and significance of the research and the extent to which it adds to existing knowledge in agronomy.