×

zbMATH — the first resource for mathematics

Local Walsh-average regression. (English) Zbl 1297.62087
Summary: Local polynomial regression is widely used for nonparametric regression. However, the efficiency of least squares (LS) based methods is adversely affected by outlying observations and heavy tailed distributions. On the other hand, the least absolute deviation (LAD) estimator is more robust, but may be inefficient for many distributions of interest. B. Kai, R. Li and H. Zou [“Local composite quantile regression smoothing: an efficient and safe alternative to local polynomial regression”, J. R. Stat. Soc., Ser. B, Stat. Methodol. 72, No. 1, 49–69 (2010; doi:10.1111/j.1467-9868.2009.00725.x)] propose a nonparametric regression technique called local composite quantile regression (LCQR) smoothing to improve local polynomial regression further. However, the performance of LCQR depends on the choice of the number of quantiles to combine, a meta parameter which plays a vital role in balancing the performance of LS and LAD based methods. To overcome this issue, we propose a novel method termed the local Walsh-average regression (LWAR) estimator by minimizing a locally Walsh-average based loss function. Under the same assumptions in [loc. cit.], we theoretically show that the proposed estimator is highly efficient across a wide spectrum of distributions. Its asymptotic relative efficiency with respect to the LS based method is closely related to that of the signed-rank Wilcoxon test in comparison with the t-test. Both of the theoretical and numerical results demonstrate that the performance of the new approach and LCQR is at least comparable in estimating the nonparametric regression function or its derivatives and in some cases the new approach performs better than the LCQR with commonly recommended number of quantiles, especially for estimating the regression function.

MSC:
62G08 Nonparametric regression and quantile regression
62G05 Nonparametric estimation
62G20 Asymptotic properties of nonparametric inference
Software:
wwcode
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Cleveland, W.S., Robust locally weighted regression and smoothing scatterplots, J. amer. statist. assoc., 74, 829-836, (1979) · Zbl 0423.62029
[2] Fan, J., Local linear regression smoothers and their minimax efficiencies, Ann. statist., 21, 196-216, (1993) · Zbl 0773.62029
[3] Fan, J.; Gijbels, I., Design-adaptive nonparametric regression, J. amer. statist. assoc., 87, 998-1004, (1992) · Zbl 0850.62354
[4] Fan, J.; Gijbels, I., Local polynomial modeling and its applications, (1996), Chapman and Hall London · Zbl 0873.62037
[5] Fan, J.; Hall, P., On cureve estimation by minimizing Mean absolute deviation and its implications, Ann. statist., 22, 867-885, (1994) · Zbl 0806.62030
[6] Fan, J.; Hu, T.; Truong, Y., Robust non-parametric function estimation, Scandinavian J. statist., 21, 433-446, (1994) · Zbl 0810.62038
[7] Fan, J.; Huang, T., Profile likelihood inferences on semiparametric varying-coefficient partially linear models, Bernoulli, 11, 1031-1057, (2005) · Zbl 1098.62077
[8] Fan, J.; Jiang, J., Variable bandwidth and one-step local \(M\)-estimator, Sci. China ser. A, 43, 65-81, (2000) · Zbl 0969.62028
[9] Härdle, W., Applied nonparametric regression, (1990), Cambridge University Press New York · Zbl 0714.62030
[10] Hettmansperger, T.P.; McKean, J.W., Robust nonparametric statistical methods, (1998), Arnold London · Zbl 0887.62056
[11] Hodges, J.L.; Lehmann, E.L., Estimates of location based on rank tests, Ann. math. statist., 34, 598-611, (1963) · Zbl 0203.21105
[12] Huber, P.J., Robust estimation, (1981), Wiley New York · Zbl 0186.52301
[13] Kai, B.; Li, R.; Zou, H., Local composite quantile regression smoothing: an efficient and safe alternative to local polynomial regression, J. R. stat. soc. ser. B, 72, 49-69, (2010)
[14] Parzen, E., On estimation of a probability density function and model, Ann. math. statist., 33, 1065-1076, (1962) · Zbl 0116.11302
[15] Pollard, D., Asymptotics for least absolute deviation regression estimators, Econom. theory, 7, 186-199, (1991)
[16] Ruppert, D.; Sheather, S.J.; Wand, M.P., An effective bandwidth selector for local least squares regression, J. amer. statist. assoc., 90, 1257-1270, (1995) · Zbl 0868.62034
[17] Terpstra, J.; McKean, J., Rank-based analysis of linear models using R, J. stat. softw., 14, 1-26, (2005)
[18] Wang, L.; Kai, B.; Li, R., Local rank inference for varying coefficient models, J. amer. statist. assoc., 488, 1631-1645, (2009) · Zbl 1205.62092
[19] Wang, H.; Xia, Y., Shrinkage estimation of the varying coefficient model, J. amer. statist. assoc., 104, 747-757, (2009) · Zbl 1388.62213
[20] Welsh, A.H., Robust estimation of smooth regression and spread functions and their derivatives, Statist. sinica, 6, 347-366, (1996) · Zbl 0884.62047
[21] Zou, H.; Yuan, M., Composite quantile regression and the oracle model selection theory, Ann. statist., 36, 1108-1126, (2007) · Zbl 1360.62394
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.