{"title":"用于高光谱图像分类的多分支特征变换跨域少镜头学习","authors":"Meilin Shi , Jiansi Ren","doi":"10.1016/j.patcog.2024.111197","DOIUrl":null,"url":null,"abstract":"<div><div>In the field of hyperspectral image (HSI) classification, a source dataset with ample labeled samples is commonly utilized to enhance the classification performance of a target dataset with few labeled samples. Existing few-shot learning (FSL) methods typically assume identical feature distribution in the source and target domains. However, since the classes of samples collected from different regions may vary considerably, it leads to a disparity in the feature distribution. To address the domain distribution shift between the source and target domains, a cross-domain FSL method based on multi-branch feature transformation (MBFT-CFSL) is proposed for HSI classification. First, the spectral–spatial features of the image are extracted by the multi-branch feature fusion module, and the feature diversity is increased using the featurewise transformation layers to boost the generalization performance of the model. Then, the conditional adversarial domain adaptation technique is employed for model training to lessen the impact of domain shift. Finally, the model is optimized by minimizing the maximum mean difference loss function to further diminish the distribution difference between the source and target domains. Experimental results on three distinct hyperspectral datasets validate the effectiveness of MBFT-CFSL, with the overall classification accuracy improved by 1.73%–5.45% compared to the suboptimal method. The source code is available at <span><span>https://github.com/Ziyin2/MBFT-CFSL</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":49713,"journal":{"name":"Pattern Recognition","volume":"160 ","pages":"Article 111197"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-branch feature transformation cross-domain few-shot learning for hyperspectral image classification\",\"authors\":\"Meilin Shi , Jiansi Ren\",\"doi\":\"10.1016/j.patcog.2024.111197\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In the field of hyperspectral image (HSI) classification, a source dataset with ample labeled samples is commonly utilized to enhance the classification performance of a target dataset with few labeled samples. Existing few-shot learning (FSL) methods typically assume identical feature distribution in the source and target domains. However, since the classes of samples collected from different regions may vary considerably, it leads to a disparity in the feature distribution. To address the domain distribution shift between the source and target domains, a cross-domain FSL method based on multi-branch feature transformation (MBFT-CFSL) is proposed for HSI classification. First, the spectral–spatial features of the image are extracted by the multi-branch feature fusion module, and the feature diversity is increased using the featurewise transformation layers to boost the generalization performance of the model. Then, the conditional adversarial domain adaptation technique is employed for model training to lessen the impact of domain shift. Finally, the model is optimized by minimizing the maximum mean difference loss function to further diminish the distribution difference between the source and target domains. Experimental results on three distinct hyperspectral datasets validate the effectiveness of MBFT-CFSL, with the overall classification accuracy improved by 1.73%–5.45% compared to the suboptimal method. The source code is available at <span><span>https://github.com/Ziyin2/MBFT-CFSL</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":49713,\"journal\":{\"name\":\"Pattern Recognition\",\"volume\":\"160 \",\"pages\":\"Article 111197\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-11-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pattern Recognition\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0031320324009488\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0031320324009488","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Multi-branch feature transformation cross-domain few-shot learning for hyperspectral image classification
In the field of hyperspectral image (HSI) classification, a source dataset with ample labeled samples is commonly utilized to enhance the classification performance of a target dataset with few labeled samples. Existing few-shot learning (FSL) methods typically assume identical feature distribution in the source and target domains. However, since the classes of samples collected from different regions may vary considerably, it leads to a disparity in the feature distribution. To address the domain distribution shift between the source and target domains, a cross-domain FSL method based on multi-branch feature transformation (MBFT-CFSL) is proposed for HSI classification. First, the spectral–spatial features of the image are extracted by the multi-branch feature fusion module, and the feature diversity is increased using the featurewise transformation layers to boost the generalization performance of the model. Then, the conditional adversarial domain adaptation technique is employed for model training to lessen the impact of domain shift. Finally, the model is optimized by minimizing the maximum mean difference loss function to further diminish the distribution difference between the source and target domains. Experimental results on three distinct hyperspectral datasets validate the effectiveness of MBFT-CFSL, with the overall classification accuracy improved by 1.73%–5.45% compared to the suboptimal method. The source code is available at https://github.com/Ziyin2/MBFT-CFSL.
期刊介绍:
The field of Pattern Recognition is both mature and rapidly evolving, playing a crucial role in various related fields such as computer vision, image processing, text analysis, and neural networks. It closely intersects with machine learning and is being applied in emerging areas like biometrics, bioinformatics, multimedia data analysis, and data science. The journal Pattern Recognition, established half a century ago during the early days of computer science, has since grown significantly in scope and influence.