LASSO PSVM - Sufficient Dimension Reduction in High Dimensional Settings
Conference
65th ISI World Statistics Congress
Format: IPS Abstract - WSC 2025
Keywords: dimension-reduction, high-dimensional, lasso
Session: IPS 914 - Recent Advances on High-Dimensional Statistics for Complex Data
Tuesday 7 October 10:50 a.m. - 12:30 p.m. (Europe/Amsterdam)
Abstract
We develop in this work a new dimension reduction method for high-dimensional settings. The proposed procedure is based on a principal support vector machine framework where principal projections are used in order to overcome the non-invertibility of the covariance matrix. Using a series of equivalences we show that one can accurately recover the central subspace using a projection on a lower dimensional subspace and then applying an l1 penalization strategy to obtain sparse estimators of the sufficient directions. Based next on a desparsified estimator, we provide an inferential procedure for high-dimensional models that allows testing for the importance of variables in determining the sufficient direction. Theoretical properties of the methodology are illustrated and computational advantages are demonstrated with simulated and real data experiments.