{"title":"Randomized smart subset selection for high-dimensional generalized linear models with false positive control","authors":"Nicholas Rios, Zhaoxue Tong","doi":"10.1007/s11634-026-00675-8","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>We introduce a novel variable selection method for high-dimensional generalized linear models, called Randomized Smart Subset Selection (RS3). RS3 combines randomized block-wise model fitting with importance-weighted stochastic subset sampling to efficiently identify active predictors. Two extensions are proposed: (i) RS3+SCAD, which applies penalized regression with the SCAD penalty to a reduced set of candidate variables, improving computational efficiency while adaptively determining model size; and (ii) RS3+FPCS, a subsampling-based procedure for false positive control based on coefficient sign stability. Simulation studies demonstrate that RS3 and its variants achieve high true positive rates with low false discovery, even under moderate predictor correlation. Applications to gene expression data show that RS3+SCAD consistently identifies sparse, biologically interpretable gene sets, outperforming existing methods in terms of prediction accuracy and stability.</p>\n <p>MSC Codes: 62F40, 62J12, 62H30</p>\n </div>","PeriodicalId":49270,"journal":{"name":"Advances in Data Analysis and Classification","volume":"20 3","pages":"857 - 875"},"PeriodicalIF":2.1000,"publicationDate":"2026-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s11634-026-00675-8.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Data Analysis and Classification","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s11634-026-00675-8","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0
Abstract
We introduce a novel variable selection method for high-dimensional generalized linear models, called Randomized Smart Subset Selection (RS3). RS3 combines randomized block-wise model fitting with importance-weighted stochastic subset sampling to efficiently identify active predictors. Two extensions are proposed: (i) RS3+SCAD, which applies penalized regression with the SCAD penalty to a reduced set of candidate variables, improving computational efficiency while adaptively determining model size; and (ii) RS3+FPCS, a subsampling-based procedure for false positive control based on coefficient sign stability. Simulation studies demonstrate that RS3 and its variants achieve high true positive rates with low false discovery, even under moderate predictor correlation. Applications to gene expression data show that RS3+SCAD consistently identifies sparse, biologically interpretable gene sets, outperforming existing methods in terms of prediction accuracy and stability.
期刊介绍:
The international journal Advances in Data Analysis and Classification (ADAC) is designed as a forum for high standard publications on research and applications concerning the extraction of knowable aspects from many types of data. It publishes articles on such topics as structural, quantitative, or statistical approaches for the analysis of data; advances in classification, clustering, and pattern recognition methods; strategies for modeling complex data and mining large data sets; methods for the extraction of knowledge from data, and applications of advanced methods in specific domains of practice. Articles illustrate how new domain-specific knowledge can be made available from data by skillful use of data analysis methods. The journal also publishes survey papers that outline, and illuminate the basic ideas and techniques of special approaches.