Multi-View Self-Supervised Auxiliary Task for Few-Shot Remote Sensing Classification

IF 1.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Baodi Liu, Lei Xing, Xujian Qiao, Qian Liu
{"title":"Multi-View Self-Supervised Auxiliary Task for Few-Shot Remote Sensing Classification","authors":"Baodi Liu,&nbsp;Lei Xing,&nbsp;Xujian Qiao,&nbsp;Qian Liu","doi":"10.1111/coin.70009","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>In the past few years, the swift advancement of remote sensing technology has greatly promoted its widespread application in the agricultural field. For example, remote sensing technology is used to monitor the planting area and growth status of crops, classify crops, and detect agricultural disasters. In these applications, the accuracy of image classification is of great significance in improving the efficiency and sustainability of agricultural production. However, many of the existing studies primarily rely on contrastive self-supervised learning methods, which come with certain limitations such as complex data construction and a bias towards invariant features. To address these issues, additional techniques like knowledge distillation are often employed to optimize the learned features. In this article, we propose a novel approach to enhance feature acquisition specific to remote sensing images by introducing a classification-based self-supervised auxiliary task. This auxiliary task involves performing image transformation self-supervised learning tasks directly on the remote sensing images, thereby improving the overall capacity for feature representation. In this work, we design a texture fading reinforcement auxiliary task to reinforce texture features and color features that are useful for distinguishing similar classes of remote sensing. Different auxiliary tasks are fused to form a multi-view self-supervised auxiliary task and integrated with the main task to optimize the model training in an end-to-end manner. The experimental results on several popular few-shot remote sensing image datasets validate the effectiveness of the proposed method. The performance better than many advanced algorithms is achieved with a more concise structure.</p>\n </div>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 6","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/coin.70009","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

In the past few years, the swift advancement of remote sensing technology has greatly promoted its widespread application in the agricultural field. For example, remote sensing technology is used to monitor the planting area and growth status of crops, classify crops, and detect agricultural disasters. In these applications, the accuracy of image classification is of great significance in improving the efficiency and sustainability of agricultural production. However, many of the existing studies primarily rely on contrastive self-supervised learning methods, which come with certain limitations such as complex data construction and a bias towards invariant features. To address these issues, additional techniques like knowledge distillation are often employed to optimize the learned features. In this article, we propose a novel approach to enhance feature acquisition specific to remote sensing images by introducing a classification-based self-supervised auxiliary task. This auxiliary task involves performing image transformation self-supervised learning tasks directly on the remote sensing images, thereby improving the overall capacity for feature representation. In this work, we design a texture fading reinforcement auxiliary task to reinforce texture features and color features that are useful for distinguishing similar classes of remote sensing. Different auxiliary tasks are fused to form a multi-view self-supervised auxiliary task and integrated with the main task to optimize the model training in an end-to-end manner. The experimental results on several popular few-shot remote sensing image datasets validate the effectiveness of the proposed method. The performance better than many advanced algorithms is achieved with a more concise structure.

用于少镜头遥感分类的多视图自监督辅助任务
过去几年,遥感技术的迅速发展极大地推动了其在农业领域的广泛应用。例如,遥感技术可用于监测农作物的种植面积和生长状况、对农作物进行分类以及检测农业灾害。在这些应用中,图像分类的准确性对于提高农业生产的效率和可持续性具有重要意义。然而,现有的许多研究主要依赖于对比自监督学习方法,这种方法存在一定的局限性,如数据构建复杂、偏向不变特征等。为了解决这些问题,通常会采用知识提炼等附加技术来优化学习到的特征。在本文中,我们提出了一种新方法,通过引入基于分类的自监督辅助任务来增强遥感图像的特征获取。该辅助任务包括直接在遥感图像上执行图像变换自监督学习任务,从而提高特征表示的整体能力。在这项工作中,我们设计了一个纹理衰减强化辅助任务,以强化纹理特征和颜色特征,这些特征对于区分遥感的相似类别非常有用。不同的辅助任务被融合成多视角自监督辅助任务,并与主任务集成,以端到端的方式优化模型训练。在几个常用的几幅遥感图像数据集上的实验结果验证了所提方法的有效性。该方法结构更简洁,性能优于许多先进算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computational Intelligence
Computational Intelligence 工程技术-计算机:人工智能
CiteScore
6.90
自引率
3.60%
发文量
65
审稿时长
>12 weeks
期刊介绍: This leading international journal promotes and stimulates research in the field of artificial intelligence (AI). Covering a wide range of issues - from the tools and languages of AI to its philosophical implications - Computational Intelligence provides a vigorous forum for the publication of both experimental and theoretical research, as well as surveys and impact studies. The journal is designed to meet the needs of a wide range of AI workers in academic and industrial research.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信