Two-stage subsampling variable selection for sparse high-dimensional generalized linear models Journal Article
| Authors: | Capanu, M.; Giurcanu, M.; Begg, C. B.; Gönen, M. |
| Article Title: | Two-stage subsampling variable selection for sparse high-dimensional generalized linear models |
| Abstract: | Although high-dimensional data analysis has received a lot of attention after the advent of omics data, model selection in this setting continues to be challenging and there is still substantial room for improvement. Through a novel combination of existing methods, we propose here a two-stage subsampling approach for variable selection in high-dimensional generalized linear regression models. In the first stage, we screen the variables using smoothly clipped absolute deviance penalty regularization followed by partial least squares regression on repeated subsamples of the data; we include in the second stage only those predictors that were most frequently selected over the subsamples either by smoothly clipped absolute deviance or for having the top loadings in either of the first two partial least squares regression components. In the second stage, we again repeatedly subsample the data and, for each subsample, we find the best Akaike information criterion model based on an exhaustive search of all possible models on the reduced set of predictors. We then include in the final model those predictors with high selection probability across the subsamples. We prove that the proposed first-stage estimator is n1/2[jls-end-space/]-consistent and that the true predictors are included in the first stage with probability converging to 1. In an extensive simulation study, we show that this two-stage approach outperforms the competitors yielding among the highest probability of selecting the true model while having one of the lowest number of false positives in the settings of logistic, Poisson, and linear regression. We illustrate the proposed method on two gene expression cancer datasets. © 2025 Elsevier B.V., All rights reserved. |
| Keywords: | controlled study; linear models; bayes theorem; algorithms; statistical analysis; algorithm; screening; data analysis; computer simulation; least-squares analysis; false positive result; statistical model; linear regression analysis; diagnostic test accuracy study; partial least squares regression; variable selection; humans; human; article; mean squared error; omics; stability selection; least square analysis; subsampling; high-dimensional regression; smoothly clipped absolute deviance; glmnet r package; r package changepoint; r software version 4.4.1; stabs package; principal component regression; sparse high dimensional generalized linear model; subsampling variable selection; sure independence screening |
| Journal Title: | Statistical Methods in Medical Research |
| Volume: | 34 |
| Issue: | 7 |
| ISSN: | 09622802 |
| Publisher: | Elsevier B.V. |
| Date Published: | 2025-01-01 |
| Start Page: | 1504 |
| End Page: | 1521 |
| Language: | English |
| DOI: | 10.1177/09622802251343597 |
| PUBMED: | 40598955 |
| PROVIDER: | scopus |
| DOI/URL: | |
| Notes: | Article -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
Related MSK Work