{"title":"Variable selection in high-dimensional varying coefficient panel data models with fixed effects","authors":"Yiping Yang , Peixin Zhao","doi":"10.1016/j.jspi.2025.106355","DOIUrl":null,"url":null,"abstract":"<div><div>To address the challenges of variable selection in panel data models with fixed effects and varying coefficients, we introduce a novel method that combines basis function approximations with group nonconcave penalty functions. By utilizing a forward orthogonal deviation transformation, we eliminate fixed effects, allowing us to select significant variables and estimate non-zero coefficient functions. Under certain regularity conditions, we demonstrate that our method consistently identifies the true model structure, and the resulting estimators exhibit oracle properties. For computational efficiency, we have developed a group gradient descent algorithm that incorporates a transformation of the penalty terms. Simulation studies reveal that nonconvex penalties (SCAD/MCP) outperform the Lasso across various performance metrics. Furthermore, compared to existing methods, our approach significantly reduces false positives (FPs). To demonstrate the practical applicability and effectiveness of our method, we present an analysis of a real dataset.</div></div>","PeriodicalId":50039,"journal":{"name":"Journal of Statistical Planning and Inference","volume":"242 ","pages":"Article 106355"},"PeriodicalIF":0.8000,"publicationDate":"2025-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Statistical Planning and Inference","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S037837582500093X","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0
Abstract
To address the challenges of variable selection in panel data models with fixed effects and varying coefficients, we introduce a novel method that combines basis function approximations with group nonconcave penalty functions. By utilizing a forward orthogonal deviation transformation, we eliminate fixed effects, allowing us to select significant variables and estimate non-zero coefficient functions. Under certain regularity conditions, we demonstrate that our method consistently identifies the true model structure, and the resulting estimators exhibit oracle properties. For computational efficiency, we have developed a group gradient descent algorithm that incorporates a transformation of the penalty terms. Simulation studies reveal that nonconvex penalties (SCAD/MCP) outperform the Lasso across various performance metrics. Furthermore, compared to existing methods, our approach significantly reduces false positives (FPs). To demonstrate the practical applicability and effectiveness of our method, we present an analysis of a real dataset.
期刊介绍:
The Journal of Statistical Planning and Inference offers itself as a multifaceted and all-inclusive bridge between classical aspects of statistics and probability, and the emerging interdisciplinary aspects that have a potential of revolutionizing the subject. While we maintain our traditional strength in statistical inference, design, classical probability, and large sample methods, we also have a far more inclusive and broadened scope to keep up with the new problems that confront us as statisticians, mathematicians, and scientists.
We publish high quality articles in all branches of statistics, probability, discrete mathematics, machine learning, and bioinformatics. We also especially welcome well written and up to date review articles on fundamental themes of statistics, probability, machine learning, and general biostatistics. Thoughtful letters to the editors, interesting problems in need of a solution, and short notes carrying an element of elegance or beauty are equally welcome.