MAFDE-DN4: Improved Few-shot plant disease classification method based on Deep Nearest Neighbor Neural Network

IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY
{"title":"MAFDE-DN4: Improved Few-shot plant disease classification method based on Deep Nearest Neighbor Neural Network","authors":"","doi":"10.1016/j.compag.2024.109373","DOIUrl":null,"url":null,"abstract":"<div><p>Deep learning-based methods for accurately identifying plant diseases can be effective in improving crop yields. However, the effectiveness of these methods heavily relies on the availability of large-scale manually labeled datasets, which present technical and economic challenges. Few-shot learning methods can be generalized to new categories with a small number of samples, which is very promising in the field of plant disease recognition despite the limited sample size. However, due to the complexity of real-life scenarios, distribution of disease leaves, and significant intra-class variability and inter-class similarity resulting from crop species and disease species, existing methods perform poorly in the field of plant disease recognition. To address the above problems, this paper proposes an improved multi-scale attention fusion with discriminative enhancement deep nearest neighbor neural network MAFDE-DN4 based on DN4. Our approach makes three main contributions. First, we have designed a bidirectional weighted feature fusion module (BWFM) to enhance the aggregation of fine-grained features and enhance the network’s representation of complex disease images. Second, to tackle the issue of sparse feature descriptors being vulnerable to irrelevant noise in small sample conditions, a episodic attention module (EA) has been developed to produce scene category-relevant attention maps. This effectively mitigates the influence of irrelevant background information. Finally, we introduce additional spacing between category margins to enhance the original softmax loss function, amplify the inter-class differences to reduce the intra-class distances, and add L2 regularization constraint terms to stabilize the training process. To simulate different real-world scenarios, we set up different dataset settings. Under the 1-shot task and the 5-shot task, our method achieves 57.5% and 81.41% accuracy under the within-domain strategy and 36.54% and 51.23% accuracy under the cross-domain strategy. The experimental results show that our method outperforms existing related work in the field of plant disease recognition, whether it is a dataset with a single background or a field dataset with a complex background in a real scenario. MAFDE-DN4 based on Few-shot learning requires substantially less data on new categories of plant diseases.</p></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924007646","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Deep learning-based methods for accurately identifying plant diseases can be effective in improving crop yields. However, the effectiveness of these methods heavily relies on the availability of large-scale manually labeled datasets, which present technical and economic challenges. Few-shot learning methods can be generalized to new categories with a small number of samples, which is very promising in the field of plant disease recognition despite the limited sample size. However, due to the complexity of real-life scenarios, distribution of disease leaves, and significant intra-class variability and inter-class similarity resulting from crop species and disease species, existing methods perform poorly in the field of plant disease recognition. To address the above problems, this paper proposes an improved multi-scale attention fusion with discriminative enhancement deep nearest neighbor neural network MAFDE-DN4 based on DN4. Our approach makes three main contributions. First, we have designed a bidirectional weighted feature fusion module (BWFM) to enhance the aggregation of fine-grained features and enhance the network’s representation of complex disease images. Second, to tackle the issue of sparse feature descriptors being vulnerable to irrelevant noise in small sample conditions, a episodic attention module (EA) has been developed to produce scene category-relevant attention maps. This effectively mitigates the influence of irrelevant background information. Finally, we introduce additional spacing between category margins to enhance the original softmax loss function, amplify the inter-class differences to reduce the intra-class distances, and add L2 regularization constraint terms to stabilize the training process. To simulate different real-world scenarios, we set up different dataset settings. Under the 1-shot task and the 5-shot task, our method achieves 57.5% and 81.41% accuracy under the within-domain strategy and 36.54% and 51.23% accuracy under the cross-domain strategy. The experimental results show that our method outperforms existing related work in the field of plant disease recognition, whether it is a dataset with a single background or a field dataset with a complex background in a real scenario. MAFDE-DN4 based on Few-shot learning requires substantially less data on new categories of plant diseases.

MAFDE-DN4:基于深度近邻神经网络的改进型多发植物病害分类方法
基于深度学习的植物病害准确识别方法可以有效提高作物产量。然而,这些方法的有效性在很大程度上依赖于大规模人工标注数据集的可用性,这带来了技术和经济上的挑战。少量学习方法只需少量样本就能归纳出新的类别,尽管样本量有限,但在植物病害识别领域却大有可为。然而,由于现实场景的复杂性、病叶的分布以及作物种类和病害种类导致的显著类内变异性和类间相似性,现有方法在植物病害识别领域表现不佳。针对上述问题,本文提出了一种基于 DN4 的改进型多尺度注意力融合与判别增强深度近邻神经网络 MAFDE-DN4。我们的方法主要有三个贡献。首先,我们设计了一个双向加权特征融合模块(BWFM),以增强细粒度特征的聚合,提高网络对复杂疾病图像的表示能力。其次,为了解决稀疏特征描述符在小样本条件下易受无关噪声影响的问题,我们开发了一个表观注意力模块(EA),以生成与场景类别相关的注意力图。这有效地减轻了无关背景信息的影响。最后,我们引入了类别边缘之间的额外间距,以增强原始的 softmax 损失函数,放大类间差异以缩小类内距离,并添加 L2 正则化约束项以稳定训练过程。为了模拟现实世界的不同场景,我们设置了不同的数据集。在一枪任务和五枪任务中,我们的方法在域内策略下分别取得了 57.5% 和 81.41% 的准确率,在跨域策略下分别取得了 36.54% 和 51.23% 的准确率。实验结果表明,在植物病害识别领域,无论是单一背景的数据集,还是实际场景中复杂背景的田间数据集,我们的方法都优于现有的相关工作。基于 Few-shot 学习的 MAFDE-DN4 对植物病害新类别所需的数据量大大减少。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信