{"title":"RDFS-TDC: Robust discriminant feature selection based on improved trace difference criterion","authors":"Libo Yang , Dawei Zhu , Xuemei Liu , Feiping Nie","doi":"10.1016/j.ins.2025.121940","DOIUrl":null,"url":null,"abstract":"<div><div>Various discriminant feature selection models have been proposed that combine discriminant subspaces and sparse constraints. However, most scholars ignore the sensitivity of the discriminant criterion to outliers. In this study, we propose a robust discriminative feature selection method called RDFS-TDC. RDFS-TDC learns the optimal discriminative projection based on the trace-difference criterion, which provides good flexibility while avoiding singular matrices. Subsequently, the objective function was optimized using an iterative reweighting method, which reduced the impact of outliers on the discriminant subspace during the learning process. To satisfy different sparsity requirements, this study introduces the <span><math><msub><mrow><mi>L</mi></mrow><mrow><mn>2</mn><mo>,</mo><mi>p</mi></mrow></msub></math></span> norm constraint to impose row sparsity on the projection matrix. RDFS-TDC obtained 87.05%, 94.68%, 84.82%, and 89.60% accuracies on YaleB, COIL20, CMUPIE, and FERET, respectively, and the misclassification error rate was 0.01%-3.32% lower compared to other methods. In addition, RDFS-TDC performed better on datasets with different scenarios compared to SDFS, WDFS, Fisher Score, DLSR, ReliefF, and RFS.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"705 ","pages":"Article 121940"},"PeriodicalIF":8.1000,"publicationDate":"2025-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025525000726","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Various discriminant feature selection models have been proposed that combine discriminant subspaces and sparse constraints. However, most scholars ignore the sensitivity of the discriminant criterion to outliers. In this study, we propose a robust discriminative feature selection method called RDFS-TDC. RDFS-TDC learns the optimal discriminative projection based on the trace-difference criterion, which provides good flexibility while avoiding singular matrices. Subsequently, the objective function was optimized using an iterative reweighting method, which reduced the impact of outliers on the discriminant subspace during the learning process. To satisfy different sparsity requirements, this study introduces the norm constraint to impose row sparsity on the projection matrix. RDFS-TDC obtained 87.05%, 94.68%, 84.82%, and 89.60% accuracies on YaleB, COIL20, CMUPIE, and FERET, respectively, and the misclassification error rate was 0.01%-3.32% lower compared to other methods. In addition, RDFS-TDC performed better on datasets with different scenarios compared to SDFS, WDFS, Fisher Score, DLSR, ReliefF, and RFS.
期刊介绍:
Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions.
Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.