×

Smooth-threshold estimating equations for varying coefficient partially nonlinear models based on orthogonality-projection method. (English) Zbl 1381.62229

Summary: In this paper, a two-stage estimation procedure is proposed for varying coefficient partially nonlinear models, in which the estimates of parametric vector and coefficient functions do not affect each other. Specifically, we first employ an orthogonality-projection-based method for the estimation of parametric coefficient by removing out the varying coefficient parts. In the second stage, we approximate each coefficient function via B-spline basis functions and develop a novel variable selection procedure based on smooth-threshold estimating equations. The proposed procedure can automatically eliminate the irrelevant covariates by setting the corresponding coefficient functions as zero, and simultaneously estimate the nonzero regression components. Besides, this approach not only avoids solving a convex optimization problem that is required in previous variable selection procedures, but also is flexible and easy to implement. Under some mild conditions, the asymptotic theories of the generated estimates are established, including model selection consistency, rate of convergence as well as asymptotic distribution. Finally, some numerical simulations are conducted to examine the finite sample performance of the proposed methodologies, and a real data analysis is followed to further illustrate the application of the methods.

MSC:

62J02 General nonlinear regression
62F12 Asymptotic properties of parametric estimators
62G05 Nonparametric estimation

Software:

Arc_Mat
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Kai, B.; Li, R.; Zou, H., New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models, Ann. Statist., 39, 305-332 (2011) · Zbl 1209.62074
[2] Cai, Z.; Xiao, Z., Semiparametric quantile regression estimation in dynamic models with partially varying coefficients, J. Econometrics, 167, 413-425 (2012) · Zbl 1441.62623
[3] Zhang, R.; Zhao, W.; Liu, J., Robust estimation and variable selection for semiparametric partially linear varying coefficient model based on modal regression, J. Nonparametr. Stat., 25, 523-544 (2013) · Zbl 1297.62104
[4] Sun, Jing; Lin, Lu, Local rank estimation and related test for varying-coefficient partially linear models, J. Nonparametr. Stat., 26, 187-206 (2014) · Zbl 1359.62111
[5] Li, D.; Yuan, Ke.; Zhang, W., Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models, Ann. Statist., 43, 2676-2705 (2015) · Zbl 1327.62262
[6] Li, T.; Mei, C., Estimation and inference for varying coefficient partially nonlinear models, J. Statist. Plann. Inference, 143, 2023-2037 (2013) · Zbl 1279.62138
[7] Frank, I.; Friedman, J., A statistical view of some chemometrics regression tool (with discussion), Technometrics, 35, 109-148 (1993) · Zbl 0775.62288
[8] Tibshirani, R., Regression shrinkage and selection via the Lasso, J. R. Stat. Soc. Ser. B, 58, 267-288 (1996) · Zbl 0850.62538
[9] Fan, J.; Li, R., Variable selection via nonconcave penalized likelihood and its oracle properties, J. Amer. Statist. Assoc., 96, 1348-1360 (2001) · Zbl 1073.62547
[10] Zou, H., The adaptive Lasso and its oracle properties, J. Amer. Statist. Assoc., 101, 1418-1429 (2006) · Zbl 1171.62326
[11] Wang, M.; Wang, X.; Wang, X., A note on the one-step estimator for ultrahigh dimensionality, J. Comput. Appl. Math., 260, 91-98 (2014) · Zbl 1293.62151
[12] Ueki, M., A note on automatic variable selection using smooth-threshold estimating equations, Biometrika, 96, 1005-1011 (2009) · Zbl 1437.62634
[13] Lai, P.; Wang, Q.; Lian, H., Bias-corrected GEE estimation and smooth-threshold GEE variable selection for single-index models with clustered data, J. Multivariate Anal., 105, 422-432 (2012) · Zbl 1274.62245
[14] Lai, P.; Wang, Q.; Zhou, X., Variable selection and semiparametric efficient estimation for the heteroscedastic partially linear single-index model, Comput. Statist. Data Anal., 70, 241-256 (2014) · Zbl 1471.62105
[15] Li, G.; Lian, H.; Feng, S.; Zhu, L., Automatic variable selection for longitudinal generalized linear models, Comput. Statist. Data Anal., 61, 174-186 (2013) · Zbl 1348.62205
[16] Tian, R.; Xue, L.; Hu, Y., Smooth-threshold GEE variable selection for varying coefficient partially linear models with longitudinal data, J. Korean Statist. Soc., 44, 419-431 (2015) · Zbl 1485.62050
[17] Henderson, C., Estimation of variance and covariance components, Biometrics, 9, 226-252 (1953)
[18] Wu, P.; Zhu, L., An orthogonality-based estimation of moments for linear mixed models, Scand. J. Stat., 37, 253-263 (2010) · Zbl 1223.62123
[19] Zhao, Y.; Lin, J.; Xu, P.; Ye, X., Orthogonality-projection-based estimation for semi-varying coefficient models with heteroscedastic errors, Comput. Statist. Data Anal., 89, 204-221 (2015) · Zbl 1468.62237
[20] Li, R.; Nie, L., Efficient statistical inference procedures for partially nonlinear models and their applications, Biometrics, 64, 904-911 (2008) · Zbl 1145.62030
[21] De Boor, C., A Practical Guide to Splines (1978), Springer: Springer New York · Zbl 0406.41003
[22] Schumaker, L., Spline Functions: Basic Theory (1981), Wiley: Wiley New York · Zbl 0449.41004
[23] He, X.; Fung, W.; Zhu, Z., Robust estimation in a generalized partial linear model for clustered data, J. Amer. Statist. Assoc., 100, 1176-1184 (2005) · Zbl 1117.62351
[24] Huang, J.; Wu, C.; Zhou, L., Varying-coefficient models and basis function approximation for the analysis of repeated measurements, Biometrika, 89, 111-128 (2002) · Zbl 0998.62024
[25] Huang, J.; Wu, C.; Zhou, L., Polynomial spline estimation and inference for varying coefficient models with longitudinal data, Statist. Sinica, 14, 763-788 (2004) · Zbl 1073.62036
[26] Noh, H.; Kwanghun, C.; Ingrid, V., Variable selection of varying coefficient models in quantile regression, Electron. J. Stat., 6, 1220-1238 (2012) · Zbl 1295.62072
[27] Tang, Y.; Wang, H.; Zhu, Z.; Song, X., A unified variable selection approach for varying coefficient models, Statist. Sinica, 22, 601-628 (2012) · Zbl 1238.62021
[28] Kim, M., Quantile regression with varying coefficients, Ann. Statist., 35, 92-108 (2007) · Zbl 1114.62051
[29] Xue, L.; Qu, A.; Zhou, J., Consistent model selection for marginal generalized additive model for correlated data, J. Amer. Statist. Assoc., 105, 1518-1530 (2010) · Zbl 1388.62223
[30] Xue, L.; Qu, A., Variable selection in high-dimensional varying coefficient models with global optimality, J. Mach. Learn. Res., 13, 1973-1998 (2012) · Zbl 1435.62093
[31] Harrison, D.; Rubinfeld, D., Hedonic housing prices and the demand for clean air, J. Environ. Econ. Manag., 5, 81-102 (1978) · Zbl 0375.90023
[32] Fan, J.; Huang, T., Profile likelihood inferences on semiparametric varying-coefficient partially linear models, Bernoulli, 11, 1031-1057 (2005) · Zbl 1098.62077
[33] Lesage, J.; Pace, R., Introduction to Spatial Econometrics (2009), CRC Press: CRC Press Boca Raton · Zbl 1163.91004
[34] Wang, Q.; Xue, L., Statistical estimation in partially-varying-coefficient single-index models, J. Multivariate Anal., 102, 1-19 (2011) · Zbl 1206.62113
[35] Wong, H.; Ip, W.; Zhang, R., Varying-coefficient single-index model, Comput. Statist. Data Anal., 52, 1458-1476 (2008) · Zbl 1452.62296
[36] Huang, Z.; Lin, B.; Feng, F.; Pang, Z., Efficient penalized estimating method in the partially varying-coefficient single-index model, J. Multivariate Anal., 114, 189-200 (2013) · Zbl 1255.62056
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.