×

Ridge estimation in semi-parametric regression models under the stochastic restriction and correlated elliptically contoured errors. (English) Zbl 1439.62105

Summary: Some linear stochastic constraints may occur during real data set modeling, based on either additional information or prior knowledge. These stochastic constraints often cause some changes in the behaviors of estimators. In this research, shrinkage ridge estimators as well as their positive parts are proposed in the semi-parametric model when some stochastic constrains are imposed under a multicollinearity setting. Also, it is assumed that the error terms are dependent and distributed according to the elliptically contoured models. The bias and risk expressions of the proposed estimators for comparison purposes are derived. Finally, the Monte-Carlo simulation studies and a real application related to electricity consumption data are conducted to support our theoretical discussion.

MSC:

62G08 Nonparametric regression and quantile regression
62J05 Linear regression; mixed models
62J07 Ridge regression; shrinkage estimators (Lasso)
62P30 Applications of statistics in engineering and industry; control charts
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Fang, K. T.; Kotz, S.; Ng, K. W., Symmetric Multivariate and Related Distributions (1990), Chapman and Hall: Chapman and Hall New York, London · Zbl 0699.62048
[2] Arashi, M.; Tabatabaey, S. M.M., A note on classical Stein-type estimators in elliptically contoured models, J. Statist. Plann. Inference, 140, 1206-1213 (2010) · Zbl 1181.62080
[3] Härdle, W.; Liang, H.; Gao, J., Partially Linear Models (2000), Physika Verlag: Physika Verlag Heidelberg · Zbl 0968.62006
[4] Speckman, P., Kernel somoothing in partial linear models, J. R. Stat. Soc. Ser. B Stat. Methodol., 50, 413-436 (1988) · Zbl 0671.62045
[5] Zhao, Y. Y.; Lin, J. G.; Xu, P. R.; Ye, X. G., Orthogonality-projection-based estimation for semi-varying coefficient models with heteroscedastic errors, Comput. Statist. Data Anal., 89, 204-221 (2015) · Zbl 1468.62237
[6] Zhao, Y. Y.; Lin, J. G.; Wang, H. X., Robust bootstrap estimates in heteroscedastic semi-varying coefficient models and applications in analyzing Australia CPI data, Comm. Statist. Simulation Comput., 46, 2638-2653 (2017) · Zbl 1373.62266
[7] Liu, Y.; Zhao, Y. Y.; Zhao, J. Q.; Miao, Z. X., Estimation and inference for generalized semi-varying coefficient models, J. Stat. Comput. Simul., 88, 2215-2231 (2018) · Zbl 07192655
[8] Zhao, Y. Y.; Lin, J. G.; Ye, X. G.; Wang, H. X.; Huang, X. F., Two-stage orthogonality-based estimation for semiparametric varying-coefficient models and its applications in analyzing AIDS data, Biom. J., 60, 79-99 (2018) · Zbl 1383.62303
[9] Zhao, Y. Y., Analysis of longitudinal data with semiparametric varying-coefficient mean-covariance models, J. Comput. Appl. Math., 363, 485-502 (2020) · Zbl 1420.62184
[10] Hoerl, A. E.; Kennard, R. W., Ridge regression: biased estimation for non-orthogonal problems, Technometrics, 12, 55-67 (1970) · Zbl 0202.17205
[11] Gisela, M.; Kibria, B. M.G., One some ridge regression estimators: An empirical comparisons, Comm. Statist. Simulation Comput., 38, 621-630 (2009) · Zbl 1160.62337
[12] Tabakan, G.; Akdenïz, F., Difference-based ridge estimator of parameters in partial linear model, Statist. Papers, 51, 357-368 (2010) · Zbl 1247.62182
[13] Hassanzadeh Bashtian, M.; Arashi, M.; Tabatabaey, S. M.M., Ridge estimation under the stochastic restriction, Comm. Statist. Theory Methods, 40, 3711-3747 (2011) · Zbl 1277.62177
[14] Akdenïz Duran, E.; Härdle, W. K.; Osipenko, M., Difference based ridge and Liu type estimators in semiparametric regression models, J. Multivariate Anal., 105, 164-175 (2012) · Zbl 1236.62030
[15] Kibria, B. M.G., Some Liu and ridge type estimators and their properties under the ill-conditioned Gaussian linear regression model, J. Stat. Comput. Simul., 82, 1-17 (2012) · Zbl 1431.62299
[16] Najarian, S.; Arashi, M.; Kibria, B. M.G., A simulation study on some restricted ridge regression estimators, Comm. Statist. Simulation Comput., 42, 871-879 (2013) · Zbl 1347.62144
[17] Roozbeh, M.; Arashi, M., Feasible ridge estimator in partially linear models, J. Multivariate Anal., 116, 35-44 (2013) · Zbl 1277.62178
[18] Amini, M.; Roozbeh, M., Optimal partial ridge estimation in restricted semiparametric regression models, J. Multivariate Anal., 136, 26-40 (2015) · Zbl 1308.62081
[19] Roozbeh, M., Robust ridge estimator in restricted semiparametric regression models, J. Multivariate Anal., 147, 127-144 (2016) · Zbl 1334.62067
[20] Roozbeh, M.; Arashi, M., Shrinkage ridge regression in partial linear models, Comm. Statist. Theory Methods, 45, 6022-6044 (2016) · Zbl 1348.62146
[21] Arashi, M.; Roozbeh, M., Some improved estimation strategies in high-dimensional semiparametric regression models with application to riboflavin production data, Statist. Papers, 60, 667-686 (2019) · Zbl 1419.62079
[22] Fallah, R.; arashi, M.; Tabatabaey, S. M.M., On the ridge regression estimator with sub-space restriction, Comm. Statist. Theory Methods, 46, 11854-11865 (2017) · Zbl 1462.62177
[23] Belsley, D. A.; Kuh, E.; Welsch, R. E., Regression Diagnostics Identifying Influential Data and Sources of Collinearity (2004), John Wiley: John Wiley New Jersey · Zbl 0479.62056
[24] Judge, G. G.; Hill, R. C.; Griffiths, W. E.; Lütkepohl, H.; Lee, T. C., Introduction to the Theory and Practice of Econometrics (1988), John Wiley: John Wiley New York · Zbl 0731.62155
[25] Toutenburg, H., Prior Information in Linear Models (1982), John Wiley: John Wiley New York · Zbl 0468.62056
[26] Akdenïz, F.; Tabakan, G., Restricted ridge estimators of the parameters in semiparametric regression model, Comm. Statist. Theory Methods, 38, 1852-1869 (2009) · Zbl 1167.62062
[27] Özkale, M. R., Comment on ridge estimation to the restricted linear model, Comm. Statist. Theory Methods, 38, 1094-1097 (2009) · Zbl 1278.62106
[28] Akdenïz, F.; Akdenïz Duran, E.; Roozbeh, M.; Arashi, M., Efficiency of the generalized difference-based liu estimators in semiparametric regression models with correlated errors., J. Stat. Comput. Simul., 85, 147-165 (2015) · Zbl 1457.62104
[29] Arashi, M.; Roozbeh, M., Shrinkage estimation in system regression model, Computational Statistics, 30, 359-376 (2015) · Zbl 1317.65035
[30] Akdeniz, F.; Roozbeh, M., Efficiency of the generalized difference-based weighted mixed almost unbiased two parameter estimator in partially linear model, Comm. Statist. Theory Methods, 46, 12259-12280 (2017) · Zbl 1462.62236
[31] Amini, M.; Roozbeh, M., Least trimmed squares ridge estimation in partially linear regression models, J. Stat. Comput. Simul., 86, 2766-2780 (2016) · Zbl 07184766
[32] Babaie-Kafaki, S.; Roozbeh, M., A revised Cholesky decomposition to combat multicollinearity in multiple regression models, J. Stat. Comput. Simul., 87, 2298-2308 (2017) · Zbl 07192064
[33] Roozbeh, M.; Hamzah, N. A., Feasible robust estimator in restricted semiparametric regression models based on the lts approach, Comm. Statist. Simulation Comput., 46, 7332-7350 (2017) · Zbl 1462.62427
[34] Akdeniz, F.; Roozbeh, M., Generalized difference-based weighted mixed almost unbiased ridge estimator in partially linear models, Statist. Papers, 60, 1717-1739 (2019) · Zbl 1432.62221
[35] Roozbeh, M., Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion, Comput. Statist. Data Anal., 117, 45-61 (2018) · Zbl 1469.62134
[36] Müller, M., Semiparametric Extensions to Generalized Linear Models (2000), (Habilitationsschrift)
[37] Theil, H., On the use of incomplete prior information in regression analysis, J. Amer. Statist. Assoc., 58, 401-414 (1963) · Zbl 0129.11401
[38] Judge, W.; Bock, M., The Statistical Implication of Pre-Test and Stein-Rule Estimators in Econometrics (1978), North-Holland: North-Holland New York · Zbl 0395.62078
[39] Theil, H.; Goldberger, A. S., On pure and mixed statistical estimation in economics, Internat. Econom. Rev., 2, 65-78 (1961)
[40] Arashi, M., Preliminary test and Stein estimators in simultaneous linear equations, Linear Algebra Appl., 436, 1195-1211 (2012) · Zbl 1232.62084
[41] Arashi, M.; Tabatabaey, S. M.M.; Soleimani, H., Simple regression in view of elliptical models, Linear Algebra Appl., 437, 1675-1691 (2012) · Zbl 1348.62185
[42] Roozbeh, M., Shrinkage ridge estimators in semiparametric regression models, J. Multivariate Anal., 136, 56-74 (2015) · Zbl 1308.62085
[43] Sheather, S. J., A Modern Approach to Regression with R (2009), Springer: Springer New York · Zbl 1181.62101
[44] Zellner, A., An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias, J. Amer. Statist. Assoc., 57, 348-368 (1962) · Zbl 0113.34902
[45] Ducharme, G. R.; Lafaye de Micheaux, P., A goodness-of-fit test for elliptical distributions with diagnostic capabilities, J. Multivariate Anal., 178 (2020) · Zbl 1440.62196
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.