一种用于少量学习的稳健传导分布校准方法

IF 7.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Jingcong Li, Chunjin Ye, Fei Wang, Jiahui Pan
{"title":"一种用于少量学习的稳健传导分布校准方法","authors":"Jingcong Li,&nbsp;Chunjin Ye,&nbsp;Fei Wang,&nbsp;Jiahui Pan","doi":"10.1016/j.patcog.2025.111488","DOIUrl":null,"url":null,"abstract":"<div><div>Few-shot learning (FSL) has gained much attention and has recently made substantial progress. To alleviate the data constraints in FSL, previous studies have attempted to generate features by learning a feature distribution. However, the learned distribution is biased and unstable due to limited labeled data, and the features from it can be even more biased, which decreases its generalizability. This paper proposes a Robust Transductive Distribution Calibration (RTDC) method to estimate feature distributions of few-shot classes in a more accurate and robust way. First, we capture the underlying distribution information by precisely estimating the covariance matrix of each novel category. Second, we consider the distribution similarity between labeled and unlabeled samples using the estimated covariance matrix and then optimize the feature distribution in a transductive manner. Extensive experiments demonstrated the effectiveness and significance of our method on several FSL benchmarks, including <em>mini</em>ImageNet, <em>tiered</em>ImageNet, CUB, and CIFAR-FS.</div></div>","PeriodicalId":49713,"journal":{"name":"Pattern Recognition","volume":"163 ","pages":"Article 111488"},"PeriodicalIF":7.6000,"publicationDate":"2025-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A robust transductive distribution calibration method for few-shot learning\",\"authors\":\"Jingcong Li,&nbsp;Chunjin Ye,&nbsp;Fei Wang,&nbsp;Jiahui Pan\",\"doi\":\"10.1016/j.patcog.2025.111488\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Few-shot learning (FSL) has gained much attention and has recently made substantial progress. To alleviate the data constraints in FSL, previous studies have attempted to generate features by learning a feature distribution. However, the learned distribution is biased and unstable due to limited labeled data, and the features from it can be even more biased, which decreases its generalizability. This paper proposes a Robust Transductive Distribution Calibration (RTDC) method to estimate feature distributions of few-shot classes in a more accurate and robust way. First, we capture the underlying distribution information by precisely estimating the covariance matrix of each novel category. Second, we consider the distribution similarity between labeled and unlabeled samples using the estimated covariance matrix and then optimize the feature distribution in a transductive manner. Extensive experiments demonstrated the effectiveness and significance of our method on several FSL benchmarks, including <em>mini</em>ImageNet, <em>tiered</em>ImageNet, CUB, and CIFAR-FS.</div></div>\",\"PeriodicalId\":49713,\"journal\":{\"name\":\"Pattern Recognition\",\"volume\":\"163 \",\"pages\":\"Article 111488\"},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2025-02-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pattern Recognition\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0031320325001487\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0031320325001487","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

少射学习(Few-shot learning, FSL)受到了广泛关注,近年来取得了长足的进展。为了缓解FSL中的数据约束,以往的研究尝试通过学习特征分布来生成特征。然而,由于标记数据有限,学习分布是有偏差的和不稳定的,并且它的特征可能更有偏差,这降低了它的泛化能力。本文提出了一种鲁棒换能性分布校准(RTDC)方法,以更准确和鲁棒的方式估计少量射击类的特征分布。首先,我们通过精确估计每个新类别的协方差矩阵来捕获潜在的分布信息。其次,我们使用估计的协方差矩阵考虑标记和未标记样本之间的分布相似度,然后以转导的方式优化特征分布。大量的实验证明了我们的方法在几个FSL基准测试上的有效性和重要性,包括miniImageNet、tieredImageNet、CUB和CIFAR-FS。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A robust transductive distribution calibration method for few-shot learning
Few-shot learning (FSL) has gained much attention and has recently made substantial progress. To alleviate the data constraints in FSL, previous studies have attempted to generate features by learning a feature distribution. However, the learned distribution is biased and unstable due to limited labeled data, and the features from it can be even more biased, which decreases its generalizability. This paper proposes a Robust Transductive Distribution Calibration (RTDC) method to estimate feature distributions of few-shot classes in a more accurate and robust way. First, we capture the underlying distribution information by precisely estimating the covariance matrix of each novel category. Second, we consider the distribution similarity between labeled and unlabeled samples using the estimated covariance matrix and then optimize the feature distribution in a transductive manner. Extensive experiments demonstrated the effectiveness and significance of our method on several FSL benchmarks, including miniImageNet, tieredImageNet, CUB, and CIFAR-FS.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Pattern Recognition
Pattern Recognition 工程技术-工程:电子与电气
CiteScore
14.40
自引率
16.20%
发文量
683
审稿时长
5.6 months
期刊介绍: The field of Pattern Recognition is both mature and rapidly evolving, playing a crucial role in various related fields such as computer vision, image processing, text analysis, and neural networks. It closely intersects with machine learning and is being applied in emerging areas like biometrics, bioinformatics, multimedia data analysis, and data science. The journal Pattern Recognition, established half a century ago during the early days of computer science, has since grown significantly in scope and influence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信