基于小样本细粒度分类的跨样本特征交互增强

IF 3.7 2区 工程技术 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Kaiyang Liao , Yunfei Tan , Yuanlin Zheng , Dingwen Song
{"title":"基于小样本细粒度分类的跨样本特征交互增强","authors":"Kaiyang Liao ,&nbsp;Yunfei Tan ,&nbsp;Yuanlin Zheng ,&nbsp;Dingwen Song","doi":"10.1016/j.displa.2025.103157","DOIUrl":null,"url":null,"abstract":"<div><div>Few-shot fine-grained image classification faces challenges due to high inter-class feature similarity, significant intra-class variations, and limited data, leading to insufficient model generalization. To address the challenges of category aggregation and separation in few-shot fine-grained scenarios, this paper proposes a classification network enhanced by cross-sample feature interaction. The cross-sample feature interaction enhancement process includes three core components: the Cross-domain Feature Attention Network (CFAN), which enhances feature consistency between support and query sets through channel and spatial attention mechanisms, focusing on capturing critical detail regions; the Global Dependency Augmentation Module (GDAM), which explicitly models dependencies between distant pixels and integrates local and global information; and the Cross-class Interaction Module (CCIM), which uses a bidirectional self-attention mechanism to align local features of query and support samples through complementary and interactive cross-sample features. Additionally, dynamic generation of inter-class feature contrast relationships improves inter-class feature discrimination. Experimental results demonstrate that the proposed method achieves superior performance compared to mainstream methods on multiple public few-shot fine-grained classification datasets, with particularly remarkable results under extremely few-shot conditions. The proposed method significantly improves the accuracy and robustness of few-shot fine-grained classification through an efficient feature interaction mechanism.</div></div>","PeriodicalId":50570,"journal":{"name":"Displays","volume":"90 ","pages":"Article 103157"},"PeriodicalIF":3.7000,"publicationDate":"2025-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cross-sample feature interaction enhancement for few-shot fine-grained classification\",\"authors\":\"Kaiyang Liao ,&nbsp;Yunfei Tan ,&nbsp;Yuanlin Zheng ,&nbsp;Dingwen Song\",\"doi\":\"10.1016/j.displa.2025.103157\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Few-shot fine-grained image classification faces challenges due to high inter-class feature similarity, significant intra-class variations, and limited data, leading to insufficient model generalization. To address the challenges of category aggregation and separation in few-shot fine-grained scenarios, this paper proposes a classification network enhanced by cross-sample feature interaction. The cross-sample feature interaction enhancement process includes three core components: the Cross-domain Feature Attention Network (CFAN), which enhances feature consistency between support and query sets through channel and spatial attention mechanisms, focusing on capturing critical detail regions; the Global Dependency Augmentation Module (GDAM), which explicitly models dependencies between distant pixels and integrates local and global information; and the Cross-class Interaction Module (CCIM), which uses a bidirectional self-attention mechanism to align local features of query and support samples through complementary and interactive cross-sample features. Additionally, dynamic generation of inter-class feature contrast relationships improves inter-class feature discrimination. Experimental results demonstrate that the proposed method achieves superior performance compared to mainstream methods on multiple public few-shot fine-grained classification datasets, with particularly remarkable results under extremely few-shot conditions. The proposed method significantly improves the accuracy and robustness of few-shot fine-grained classification through an efficient feature interaction mechanism.</div></div>\",\"PeriodicalId\":50570,\"journal\":{\"name\":\"Displays\",\"volume\":\"90 \",\"pages\":\"Article 103157\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-07-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Displays\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0141938225001945\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Displays","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0141938225001945","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

摘要

由于类间特征相似度高,类内差异大,数据有限,导致模型泛化不足,小镜头细粒度图像分类面临挑战。为了解决小样本细粒度场景下的分类聚合和分类分离问题,本文提出了一种基于跨样本特征交互增强的分类网络。跨样本特征交互增强过程包括三个核心组件:跨域特征注意网络(CFAN),该网络通过通道和空间注意机制增强支持集和查询集之间的特征一致性,重点捕获关键细节区域;全局依赖增强模块(Global Dependency Augmentation Module, GDAM),它显式地模拟远距离像素之间的依赖关系,并整合局部和全局信息;跨类交互模块(Cross-class Interaction Module, CCIM),采用双向自关注机制,通过互补交互的跨样本特征对齐查询样本的局部特征和支持样本。此外,类间特征对比关系的动态生成提高了类间特征的识别能力。实验结果表明,该方法在多个公开的少镜头细粒度分类数据集上取得了优于主流方法的性能,尤其在极少镜头条件下效果显著。该方法通过有效的特征交互机制,显著提高了小样本细粒度分类的准确性和鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Cross-sample feature interaction enhancement for few-shot fine-grained classification
Few-shot fine-grained image classification faces challenges due to high inter-class feature similarity, significant intra-class variations, and limited data, leading to insufficient model generalization. To address the challenges of category aggregation and separation in few-shot fine-grained scenarios, this paper proposes a classification network enhanced by cross-sample feature interaction. The cross-sample feature interaction enhancement process includes three core components: the Cross-domain Feature Attention Network (CFAN), which enhances feature consistency between support and query sets through channel and spatial attention mechanisms, focusing on capturing critical detail regions; the Global Dependency Augmentation Module (GDAM), which explicitly models dependencies between distant pixels and integrates local and global information; and the Cross-class Interaction Module (CCIM), which uses a bidirectional self-attention mechanism to align local features of query and support samples through complementary and interactive cross-sample features. Additionally, dynamic generation of inter-class feature contrast relationships improves inter-class feature discrimination. Experimental results demonstrate that the proposed method achieves superior performance compared to mainstream methods on multiple public few-shot fine-grained classification datasets, with particularly remarkable results under extremely few-shot conditions. The proposed method significantly improves the accuracy and robustness of few-shot fine-grained classification through an efficient feature interaction mechanism.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Displays
Displays 工程技术-工程:电子与电气
CiteScore
4.60
自引率
25.60%
发文量
138
审稿时长
92 days
期刊介绍: Displays is the international journal covering the research and development of display technology, its effective presentation and perception of information, and applications and systems including display-human interface. Technical papers on practical developments in Displays technology provide an effective channel to promote greater understanding and cross-fertilization across the diverse disciplines of the Displays community. Original research papers solving ergonomics issues at the display-human interface advance effective presentation of information. Tutorial papers covering fundamentals intended for display technologies and human factor engineers new to the field will also occasionally featured.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信