×

Asymptotic normality of quadratic estimators. (English) Zbl 1348.62170

Summary: We prove conditional asymptotic normality of a class of quadratic U-statistics that are dominated by their degenerate second order part and have kernels that change with the number of observations. These statistics arise in the construction of estimators in high-dimensional semi- and non-parametric models, and in the construction of nonparametric confidence sets. This is illustrated by estimation of the integral of a square of a density or regression function, and estimation of the mean response with missing data. We show that estimators are asymptotically normal even in the case that the rate is slower than the square root of the observations.

MSC:

62G20 Asymptotic properties of nonparametric inference
62G05 Nonparametric estimation
62H12 Estimation in multivariate analysis
PDFBibTeX XMLCite
Full Text: DOI arXiv

References:

[1] Bhattacharya, R. N.; Ghosh, J. K., A class of \(U\)-statistics and asymptotic normality of the number of \(k\)-clusters, J. Multivariate Anal., 43, 2, 300-330 (1992) · Zbl 0764.60025
[2] Bickel, P. J.; Ritov, Y., Estimating integrated squared density derivatives: sharp best order of convergence estimates, Sankhyā Ser. A, 50, 3, 381-393 (1988) · Zbl 0676.62037
[3] Birgé, L.; Massart, P., Estimation of integral functionals of a density, Ann. Statist., 23, 1, 11-29 (1995) · Zbl 0848.62022
[4] Daubechies, I., (Ten Lectures on Wavelets. Ten Lectures on Wavelets, CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 61 (1992), Society for Industrial and Applied Mathematics (SIAM): Society for Industrial and Applied Mathematics (SIAM) Philadelphia, PA)
[5] de Jong, P., A central limit theorem for generalized quadratic forms, Probab. Theory Related Fields, 75, 2, 261-277 (1987) · Zbl 0596.60022
[6] de Jong, P., A central limit theorem for generalized multilinear forms, J. Multivariate Anal., 34, 2, 275-289 (1990) · Zbl 0709.60019
[7] DeVore, R. A.; Lorentz, G. G., (Constructive Approximation. Constructive Approximation, Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], vol. 303 (1993), Springer-Verlag: Springer-Verlag Berlin) · Zbl 0797.41016
[8] Ermakov, M. S., Asymptotic minimaxity of chi-squared tests, Teor. Veroyatn. Primen., 42, 4, 668-695 (1997) · Zbl 0911.62039
[9] Giné, E.; Latala, R.; Zinn, J., Exponential and moment inequalities for \(U\)-statistics, (High Dimensional Probability, II (Seattle, WA, 1999). High Dimensional Probability, II (Seattle, WA, 1999), Progr. Probab., vol. 47 (2000), Birkhäuser Boston: Birkhäuser Boston Boston, MA), 13-38 · Zbl 0969.60024
[10] Jammalamadaka, S. R.; Janson, S., Limit theorems for a triangular scheme of \(U\)-statistics with applications to inter-point distances, Ann. Probab., 14, 4, 1347-1358 (1986) · Zbl 0604.60023
[11] Kerkyacharian, G.; Picard, D., Estimating nonquadratic functionals of a density using Haar wavelets, Ann. Statist., 24, 2, 485-507 (1996) · Zbl 0860.62033
[12] Laurent, B., Efficient estimation of integral functionals of a density, Ann. Statist., 24, 2, 659-681 (1996) · Zbl 0859.62038
[13] Laurent, B., Estimation of integral functionals of a density and its derivatives, Bernoulli, 3, 2, 181-211 (1997) · Zbl 0872.62044
[14] Laurent, B.; Massart, P., Adaptive estimation of a quadratic functional by model selection, Ann. Statist., 28, 5, 1302-1338 (2000) · Zbl 1105.62328
[15] Mikosch, T., A weak invariance principle for weighted \(U\)-statistics with varying kernels, J. Multivariate Anal., 47, 1, 82-102 (1993) · Zbl 0788.60045
[16] Morris, C., Central limit theorems for multinomial sums, Ann. Statist., 3, 165-188 (1975) · Zbl 0305.62013
[17] Newey, W. K.; Hsieh, F.; Robins, J. M., Twicing kernels and a small bias property of semiparametric estimators, Econometrica, 72, 3, 947-962 (2004) · Zbl 1091.62024
[18] Robins, J.; Li, L.; Tchetgen, E.; van der Vaart, A., Higher order influence functions and minimax estimation of nonlinear functionals, (Probability and Statistics: Essays in Honor of David A. Freedman. Probability and Statistics: Essays in Honor of David A. Freedman, Inst. Math. Stat. Collect., vol. 2 (2008), Inst. Math. Statist.: Inst. Math. Statist. Beachwood, OH), 335-421 · Zbl 1513.62067
[19] Robins, J.; Li, L.; Tchetgen, E.; van der Vaart, A. W., Quadratic semiparametric von Mises calculus, Metrika, 69, 2-3, 227-247 (2009) · Zbl 1433.62102
[20] Robins, J.; Tchetgen Tchetgen, E.; Li, L.; van der Vaart, A., Semiparametric minimax rates, Electron. J. Stat., 3, 1305-1321 (2009) · Zbl 1326.62080
[21] Robins, J.; van der Vaart, A., Adaptive nonparametric confidence sets, Ann. Statist., 34, 1, 229-253 (2006) · Zbl 1091.62039
[23] van der Vaart, A. W., (Asymptotic Statistics. Asymptotic Statistics, Cambridge Series in Statistical and Probabilistic Mathematics, vol. 3 (1998), Cambridge University Press: Cambridge University Press Cambridge) · Zbl 0910.62001
[24] van der Vaart, A., Higher order tangent spaces and influence functions, Statist. Sci., 29, 4, 679-686 (2014) · Zbl 1331.62111
[25] Weber, N. C., Central limit theorems for a class of symmetric statistics, Math. Proc. Cambridge Philos. Soc., 94, 2, 307-313 (1983) · Zbl 0563.60025
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.