×

Correcting an estimator of a multivariate monotone function with isotonic regression. (English) Zbl 1448.62056

Summary: In many problems, a sensible estimator of a possibly multivariate monotone function may fail to be monotone. We study the correction of such an estimator obtained via projection onto the space of functions monotone over a finite grid in the domain. We demonstrate that this corrected estimator has no worse supremal estimation error than the initial estimator, and that analogously corrected confidence bands contain the true function whenever the initial bands do, at no loss to band width. Additionally, we demonstrate that the corrected estimator is asymptotically equivalent to the initial estimator if the initial estimator satisfies a stochastic equicontinuity condition and the true function is Lipschitz and strictly monotone. We provide simple sufficient conditions in the special case that the initial estimator is asymptotically linear, and illustrate the use of these results for estimation of a G-computed distribution function. Our stochastic equicontinuity condition is weaker than standard uniform stochastic equicontinuity, which has been required for alternative correction procedures. This allows us to apply our results to the bivariate correction of the local linear estimator of a conditional distribution function known to be monotone in its conditioning argument. Our experiments suggest that the projection step can yield significant practical improvements.

MSC:

62G20 Asymptotic properties of nonparametric inference
62G15 Nonparametric tolerance and confidence regions
62H12 Estimation in multivariate analysis
60G15 Gaussian processes
PDFBibTeX XMLCite
Full Text: DOI arXiv Euclid

References:

[1] Ayer, M., Brunk, H. D., Ewing, G. M., Reid, W. T. and Silverman, E. (1955). An Empirical Distribution Function for Sampling with Incomplete Information., Ann. Math. Statist. 26 641-647. · Zbl 0066.38502 · doi:10.1214/aoms/1177728423
[2] Barlow, R. E., Bartholomew, D. J., Bremner, J. M. and Brunk, H. D. (1972)., Statistical Inference Under Order Restrictions: The Theory and Application of Isotonic Regression. Wiley New York. · Zbl 0246.62038
[3] Bril, G., Dykstra, R., Pillers, C. and Robertson, T. (1984). Algorithm AS 206: Isotonic Regression in Two Independent Variables., J. R. Stat. Soc. Ser. C. Appl. Stat 33 352-357.
[4] Chernozhukov, V., Fernández-Val, I. and Galichon, A. (2010). Quantile and Probability Curves Without Crossing., Econometrica 78 1093-1125. · Zbl 1192.62255 · doi:10.3982/ECTA7880
[5] Chernozhukov, V., Fernández-Val, I. and Galichon, A. (2009). Improving point and interval estimators of monotone functions by rearrangement., Biometrika 96 559-575. · Zbl 1170.62025 · doi:10.1093/biomet/asp030
[6] Daouia, A. and Park, B. U. (2013). On Projection-type Estimators of Multivariate Isotonic Functions., Scandinavian Journal of Statistics 40 363-386. · Zbl 1328.62200 · doi:10.1111/j.1467-9469.2012.00815.x
[7] Dette, H., Neumeyer, N. and Pilz, K. F. (2006). A simple nonparametric estimator of a strictly monotone regression function., Bernoulli 12 469-490. · Zbl 1100.62045 · doi:10.3150/bj/1151525131
[8] Fan, J. and Gijbels, I. (1996)., Local Polynomial Modelling and Its Applications. CRC Press, Boca Raton. · Zbl 0873.62037
[9] Fokianos, K., Leucht, A. and Neumann, M. H. (2017). On Integrated \(L^1\) Convergence Rate of an Isotonic Regression Estimator for Multivariate Observations., arXiv e-prints arXiv:1710.04813. · Zbl 1452.62282 · doi:10.1109/TIT.2020.3013390
[10] Gill, R. D. and Robins, J. M. (2001). Causal Inference for Complex Longitudinal Data: The Continuous Case., Ann. Statist. 29 1785-1811. · Zbl 1043.62094 · doi:10.1214/aos/1015345962
[11] Hall, P. and Kang, K.-H. (2001). Bootstrapping nonparametric density estimators with empirically chosen bandwidths., Ann. Statist. 29 1443-1468. · Zbl 1043.62028 · doi:10.1214/aos/1013203461
[12] Hardle, W., Janssen, P. and Serfling, R. (1988). Strong Uniform Consistency Rates for Estimators of Conditional Functionals., Ann. Statist. 16 1428-1449. · Zbl 0672.62050 · doi:10.1214/aos/1176351047
[13] Kyng, R., Rao, A. and Sachdeva, S. (2015). Fast, Provable Algorithms for Isotonic Regression in all \(\ell_p\)-norms. In, Advances in Neural Information Processing Systems 28 (C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama and R. Garnett, eds.) 2719-2727. Curran Associates, Inc.
[14] Liao, X. and Meyer, M. C. (2014). coneproj: An R Package for the Primal or Dual Cone Projections with Routines for Constrained Regression., Journal of Statistical Software 61 1-22.
[15] Meyer, M. C. (1999). An extension of the mixed primal-dual bases algorithm to the case of more constraints than dimensions., Journal of Statistical Planning and Inference 81 13-31. · Zbl 1057.62510 · doi:10.1016/S0378-3758(99)00025-7
[16] Mukarjee, H. and Stern, S. (1994). Feasible Nonparametric Estimation of Multiargument Monotone Functions., Journal of the American Statistical Association 89 77-80. · Zbl 0795.62040 · doi:10.1080/01621459.1994.10476447
[17] Patra, R. K. and Sen, B. (2016). Estimation of a two-component mixture model with applications to multiple testing., Journal of the Royal Statistical Society: Series B (Statistical Methodology) 78 869-893. · Zbl 1414.62111 · doi:10.1111/rssb.12148
[18] Robertson, T., Wright, F. and Dykstra, R. (1988)., Order Restricted Statistical Inference. Wiley, New York. · Zbl 0645.62028
[19] Robins, J. (1986). A new approach to causal inference in mortality studies with a sustained exposure period – application to control of the healthy worker survivor effect., Mathematical Modelling 7 1393-1512. · Zbl 0614.62136 · doi:10.1016/0270-0255(86)90088-6
[20] Ruppert, D., Sheather, S. J. and Wand, M. P. (1995). An effective bandwidth selector for local least squares regression., Journal of the American Statistical Association 90 1257-1270. · Zbl 0868.62034 · doi:10.1080/01621459.1995.10476630
[21] Stupfler, G. (2016). On the weak convergence of the kernel density estimator in the uniform topology., Electron. Commun. Probab. 21 13 pp. · Zbl 1338.60100 · doi:10.1214/16-ECP4638
[22] R Core Team (2018). R: A Language and Environment for Statistical Computing R Foundation for Statistical Computing, Vienna, Austria.
[23] Turner, R. (2015). Iso: Functions to Perform Isotonic Regression R package version, 0.0-17.
[24] van der Laan, M. J. and Robins, J. M. (2003)., Unified methods for censored longitudinal data and causality. Springer Science & Business Media. · Zbl 1013.62034
[25] van der Vaart, A. W. and Wellner, J. A. (1996)., Weak Convergence and Empirical Processes. Springer-Verlag New York. · Zbl 0862.60002
[26] van der Vaart, A. and Wellner, J. A. (2011). A local maximal inequality under uniform entropy., Electron. J. Statist. 5 192-203. · Zbl 1268.60027 · doi:10.1214/11-EJS605
[27] Wand, M. (2015). KernSmooth: Functions for Kernel Smoothing Supporting Wand & Jones (1995) R package version, 2.23-15.
[28] Wand, M. · Zbl 0854.62043
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.