an:05915059
Zbl 1216.62103
Wang, Tao; Zhu, Lixing
Consistent tuning parameter selection in high dimensional sparse linear regression
EN
J. Multivariate Anal. 102, No. 7, 1141-1151 (2011).
00281674
2011
j
62J05 62F15 62H12 65C60 62G20
adaptive elastic net; Bayesian information criterion; high dimensionality; sure independence screening; variable selection
Summary: An exhaustive search as required for traditional variable selection methods is impractical in high dimensional statistical modeling. Thus, to conduct variable selection, various forms of penalized estimators with good statistical and computational properties, have been proposed during the past two decades. The attractive properties of these shrinkage and selection estimators, however, depend critically on the size of regularization which controls model complexity. We consider the problem of consistent tuning parameter selection in high dimensional sparse linear regression where the dimension of the predictor vector is larger than the size of the sample. First, we propose a family of high dimensional Bayesian Information Criteria (HBIC), and then investigate the selection consistency, extending the results of the extended Bayesian Information Criterion (EBIC), of \textit{J. Chen} and \textit{Z. Chen} [Biometrika 95, No.~3, 795--771 (2008; Zbl 1437.62415)] to ultra-high dimensional situations. Second, we develop a two-step procedure, the SIS + AENET, to conduct variable selection in \(p>n\) situations. The consistency of tuning parameter selection is established under fairly mild technical conditions. Simulation studies are presented to confirm theoretical findings, and an empirical example is given to illustrate the use in the internet advertising data.
Zbl 1437.62415