{"title":"无监督少镜头学习的双情景抽样和动量一致性正则化","authors":"Jiaxin Chen, Yanxu Hu, Meng Shen, A. J. Ma","doi":"10.1109/ICME55011.2023.00491","DOIUrl":null,"url":null,"abstract":"Unsupervised Few-shot Learning (UFSL) is a practical approach to adapting knowledge learned from unlabeled data of base classes to novel classes with limited labeled data. Nevertheless, most existing UFSL methods may not learn generalizable features in latter training epochs due to the simplicity of meta-learning tasks constructed by data augmentation. To address this issue, we propose two novel components, namely Dual Episodic Sampling (DES) and Momentum Consistency Regularization (MCR) for UFSL. In the DES, two types of sampling strategies are used to construct harder training tasks with multiple augmentations to generate each pseudo-class of increased diversity. The MCR constrains the consistency of the backbone encoder with its momentum counterpart to learn better generalized features for novel classes. Experimental results on four datasets verify the superiority of our method for unsupervised few-shot image classification.","PeriodicalId":321830,"journal":{"name":"2023 IEEE International Conference on Multimedia and Expo (ICME)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual Episodic Sampling and Momentum Consistency Regularization for Unsupervised Few-shot Learning\",\"authors\":\"Jiaxin Chen, Yanxu Hu, Meng Shen, A. J. Ma\",\"doi\":\"10.1109/ICME55011.2023.00491\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Unsupervised Few-shot Learning (UFSL) is a practical approach to adapting knowledge learned from unlabeled data of base classes to novel classes with limited labeled data. Nevertheless, most existing UFSL methods may not learn generalizable features in latter training epochs due to the simplicity of meta-learning tasks constructed by data augmentation. To address this issue, we propose two novel components, namely Dual Episodic Sampling (DES) and Momentum Consistency Regularization (MCR) for UFSL. In the DES, two types of sampling strategies are used to construct harder training tasks with multiple augmentations to generate each pseudo-class of increased diversity. The MCR constrains the consistency of the backbone encoder with its momentum counterpart to learn better generalized features for novel classes. Experimental results on four datasets verify the superiority of our method for unsupervised few-shot image classification.\",\"PeriodicalId\":321830,\"journal\":{\"name\":\"2023 IEEE International Conference on Multimedia and Expo (ICME)\",\"volume\":\"16 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE International Conference on Multimedia and Expo (ICME)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICME55011.2023.00491\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE International Conference on Multimedia and Expo (ICME)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICME55011.2023.00491","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Dual Episodic Sampling and Momentum Consistency Regularization for Unsupervised Few-shot Learning
Unsupervised Few-shot Learning (UFSL) is a practical approach to adapting knowledge learned from unlabeled data of base classes to novel classes with limited labeled data. Nevertheless, most existing UFSL methods may not learn generalizable features in latter training epochs due to the simplicity of meta-learning tasks constructed by data augmentation. To address this issue, we propose two novel components, namely Dual Episodic Sampling (DES) and Momentum Consistency Regularization (MCR) for UFSL. In the DES, two types of sampling strategies are used to construct harder training tasks with multiple augmentations to generate each pseudo-class of increased diversity. The MCR constrains the consistency of the backbone encoder with its momentum counterpart to learn better generalized features for novel classes. Experimental results on four datasets verify the superiority of our method for unsupervised few-shot image classification.