Benyuan Lv , Ying Luo , Jiacheng Ni , Siyuan Zhao , Jia Liang , Yingxi Liu , Qun Zhang
{"title":"MMFF: Multiview and multi-level feature fusion method within limited sample conditions for SAR image target recognition","authors":"Benyuan Lv , Ying Luo , Jiacheng Ni , Siyuan Zhao , Jia Liang , Yingxi Liu , Qun Zhang","doi":"10.1016/j.isprsjprs.2025.03.010","DOIUrl":null,"url":null,"abstract":"<div><div>The fusion of SAR image features from multiple views can effectively improve the recognition performance of SAR ATR tasks. However, when the number of raw samples in SAR images is limited, multiple fusions of SAR image features from different views of the same class may result in significant feature redundancy, causing overfitting of the model. To solve those problems, we propose a multiview and multi-level feature fusion (MMFF) method that can extract richer features from extremely limited raw data. Firstly, we design a new multiview feature fusion (NMFF) module to reduce feature redundancy generated by fusing features from the same class but from different views. This module uses multiple feature fusion methods to fuse features from different views, effectively reducing feature redundancy and alleviating model overfitting. Then, we design a multiview multi-class random feature extraction (MMRFE) module to extract inter-class separability features and intra-class similarity features and fuse them with multiview features. The MMRFE module enables the network to learn inter-class separability between different classes and intra-class similarity between the same classes, thereby improving the network’s recognition ability in extremely limited data. Finally, to further increase inter-class separability and intra-class similarity, we design a coarse classifier to perform coarse classification on inter-class separability features and intra-class similarity features. The coarse classifier increases inter-class separability and intra-class similarity by calculating classification loss to affect updating network parameters. Experimental results demonstrate that when trained with 10 SAR images per class, our algorithm achieves recognition rates of 92.53 % and 80.50 % on the MSTAR dataset and Civilian Vehicle dataset, respectively, outperforming state-of-the-art methods by at least 3.2 % and 3.94 % in classification accuracy.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"224 ","pages":"Pages 302-316"},"PeriodicalIF":10.6000,"publicationDate":"2025-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S092427162500108X","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0
Abstract
The fusion of SAR image features from multiple views can effectively improve the recognition performance of SAR ATR tasks. However, when the number of raw samples in SAR images is limited, multiple fusions of SAR image features from different views of the same class may result in significant feature redundancy, causing overfitting of the model. To solve those problems, we propose a multiview and multi-level feature fusion (MMFF) method that can extract richer features from extremely limited raw data. Firstly, we design a new multiview feature fusion (NMFF) module to reduce feature redundancy generated by fusing features from the same class but from different views. This module uses multiple feature fusion methods to fuse features from different views, effectively reducing feature redundancy and alleviating model overfitting. Then, we design a multiview multi-class random feature extraction (MMRFE) module to extract inter-class separability features and intra-class similarity features and fuse them with multiview features. The MMRFE module enables the network to learn inter-class separability between different classes and intra-class similarity between the same classes, thereby improving the network’s recognition ability in extremely limited data. Finally, to further increase inter-class separability and intra-class similarity, we design a coarse classifier to perform coarse classification on inter-class separability features and intra-class similarity features. The coarse classifier increases inter-class separability and intra-class similarity by calculating classification loss to affect updating network parameters. Experimental results demonstrate that when trained with 10 SAR images per class, our algorithm achieves recognition rates of 92.53 % and 80.50 % on the MSTAR dataset and Civilian Vehicle dataset, respectively, outperforming state-of-the-art methods by at least 3.2 % and 3.94 % in classification accuracy.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.