×

Variable selection and semiparametric efficient estimation for the heteroscedastic partially linear single-index model. (English) Zbl 1471.62105

Summary: An efficient estimating equations procedure is developed for performing variable selection and defining semiparametric efficient estimates simultaneously for the heteroscedastic partially linear single-index model. The estimating equations are proposed based on the smooth threshold estimating equations by using the efficient score function of partially linear single-index models. And this estimating equations procedure can be used to perform variable selection without solving any convex optimization problems, and automatically eliminate nonsignificant variables by setting their coefficients as zero. The resulting estimators enjoy the oracle property and are semiparametrically efficient. The finite sample properties of the proposed estimators are illustrated by some simulation examples, as well as a real data application.

MSC:

62-08 Computational methods for problems pertaining to statistics
62G08 Nonparametric regression and quantile regression
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Candes, E.; Tao, T., The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\) (with discussion), Ann. Statist., 35, 2313-2404, (2007) · Zbl 1139.62019
[2] Carroll, R. J.; Fan, J.; Gijbels, I.; Wand, W. P., Generalized partially linear single-index models, J. Amer. Statist. Assoc., 92, 477-489, (1997) · Zbl 0890.62053
[3] Chiou, J. M.; Müller, H. G., Nonparametric quasi-likelihood, Ann. Statist., 27, 36-64, (1999) · Zbl 0978.62056
[4] Einmahl, U.; Mason, D. M., Uniform in bandwidth consistency of kernel-type function estimators, Ann. Statist., 22, 1380-1403, (2005) · Zbl 1079.62040
[5] Fan, J., Local linear regression smoothers and their minimax efficiency, Ann. Statist., 21, 196-216, (1993) · Zbl 0773.62029
[6] Fan, J.; Li, R., Variable selection via nonconcave penalized likelihood and its oracle properties, J. Amer. Statist. Assoc., 96, 1348-1360, (2001) · Zbl 1073.62547
[7] Kong, E.; Xia, Y. C., Variable selection for the single-index model, Biometrika, 94, 217-229, (2007) · Zbl 1142.62353
[8] Liang, H.; Li, R. Z., Variable selection for partially linear models with measurement errors, J. Amer. Statist. Assoc., 104, 234-248, (2009), (technical report) · Zbl 1388.62208
[9] Liang, H.; Liu, X.; Li, R. Z.; Tsai, C. L., Estimation and testing for partially linear single-index models, Ann. Statist., 38, 3811-3836, (2010) · Zbl 1204.62068
[10] Ma, Y. Y; Chiou, J. M.; Wang, N., Efficient semiparametric estimator for heteroscedastic partially linear models, Biometrika, 93, 75-84, (2006) · Zbl 1152.62020
[11] Naik, P. A.; Tsai, C. L., Single-index model selections, Biometrika, 88, 821-832, (2001) · Zbl 0988.62042
[12] Tibshirani, R., Regression shrinkage and selection via the lasso, J. R. Stat. Soc. Ser. B Stat. Methodol., 58, 267-288, (1996) · Zbl 0850.62538
[13] Ueki, M., A note on automatic variable selection using smooth-threshold estimating equations, Biometrika, 96, 1005-1011, (2009) · Zbl 1437.62634
[14] Wang, H. S.; Leng, C. L., Unified lasso estimation via least squares approximation, J. Amer. Statist. Assoc., 102, 1039-1048, (2007) · Zbl 1306.62167
[15] Wang, J. L.; Xue, L. G.; Zhu, L. X.; Chong, Y. S., Estimation for a partial-linear single-index model, Ann. Statist., 38, 246-274, (2010) · Zbl 1181.62038
[16] Xia, Y. C.; Härdle, W., Semiparametric estimation of partially linear single-index models, J. Multivariate Anal., 97, 1162-1184, (2006) · Zbl 1089.62050
[17] Xia, Y. C.; Tong, H.; Li, W. K., On extended partially linear single-index models, Biometrika, 86, 831-842, (1999) · Zbl 0942.62109
[18] Yu, Y.; Ruppert, D., Penalized spline estimation for partially linear single-index models, J. Amer. Statist. Assoc., 97, 1042-1054, (2002) · Zbl 1045.62035
[19] Zhao, P. X.; Xue, L. G., Variable selection for semiparametric varying coefficient partially linear models, Statist. Probab. Lett., 79, 2148-2157, (2009) · Zbl 1171.62026
[20] Zhu, L. X.; Xue, L. G., Empirical likelihood confidence regions in a partially linear single-index model, J. R. Stat. Soc. Ser. B Stat. Methodol., 68, 549-570, (2006) · Zbl 1110.62055
[21] Zhu, L. P.; Zhu, L. X., Nonconcave penalized inverse regression in single-index models with high dimensional predictors, J. Multivariate Anal., 100, 862-875, (2009) · Zbl 1157.62037
[22] Zou, H., The adaptive lasso and its oracle properties, J. Amer. Statist. Assoc., 101, 1418-1429, (2006) · Zbl 1171.62326
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.