×

Convergence of conditional Metropolis-Hastings samplers. (English) Zbl 1379.60082

Summary: We consider Markov chain Monte Carlo algorithms which combine Gibbs updates with Metropolis-Hastings updates, resulting in a conditional Metropolis-Hastings sampler (CMH sampler). We develop conditions under which the CMH sampler will be geometrically or uniformly ergodic. We illustrate our results by analysing a CMH sampler used for drawing Bayesian inferences about the entire sample path of a diffusion process, based only upon discrete observations.

MSC:

60J22 Computational methods in Markov chains
60J05 Discrete-time Markov processes on general state spaces
65C05 Monte Carlo methods
62F15 Bayesian inference
PDFBibTeX XMLCite
Full Text: DOI Euclid

References:

[1] Brooks, S., Gelman, A., Jones, G. L. and Meng, X.-L. (eds) (2011). Handbook of Markov Chain Monte Carlo . CRC Press, Boca Raton, FL. · Zbl 1218.65001
[2] Chan, K. S. and Geyer, C. J. (1994). Discussion: Markov chains for exploring posterior distributions. Ann. Statist. 22 , 1747-1758. · Zbl 0829.62080
[3] Diaconis, P. and Saloff-Coste, L. (1993). Comparison theorems for reversible Markov chains. Ann. Appl. Prob. 3 , 696-730. · Zbl 0799.60058
[4] Elerian, O., Chib, S. and Shephard, N. (2001). Likelihood inference for discretely observed nonlinear diffusions. Econometrica 69 , 959-993. · Zbl 1017.62068
[5] Flegal, J. M., Haran, M. and Jones, G. L. (2008). Markov chain Monte Carlo: can we trust the third significant figure? Statist. Sci. 23 , 250-260. · Zbl 1327.62017
[6] Gelfand, A. E. and Smith, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. J. Amer. Statist. Assoc. 85 , 398-409. · Zbl 0702.62020
[7] Hobert, J. P. and Geyer, C. J. (1998). Geometric ergodicity of Gibbs and block Gibbs samplers for a hierarchical random effects model. J. Multivariate Anal. 67 , 414-430. · Zbl 0922.60069
[8] Jarner, S. F. and Hansen, E. (2000). Geometric ergodicity of Metropolis algorithms. Stoch. Process. Appl. 85 , 341-361. · Zbl 0997.60070
[9] Johnson, A. A. and Jones, G. L. (2010). Gibbs sampling for a Bayesian hierarchical general linear model. Electron. J. Statist. 4 , 313-333. · Zbl 1329.62336
[10] Johnson, A. A., Jones, G. L. and Neath, R. C. (2013). Component-wise Markov chain Monte Carlo: uniform and geometric ergodicity under mixing and composition. Statist. Sci. 28 , 360-375. · Zbl 1331.60151
[11] Jones, G. L. (2004). On the Markov chain central limit theorem. Prob. Surveys 1 , 299-320. · Zbl 1189.60129
[12] Jones, G. L. and Hobert, J. P. (2001). Honest exploration of intractable probability distributions via Markov chain Monte Carlo. Statist. Sci. 16 , 312-334. · Zbl 1127.60309
[13] Jones, G. L. and Hobert, J. P. (2004). Sufficient burn-in for Gibbs samplers for a hierarchical random effects model. Ann. Statist. 32 , 784-817. · Zbl 1048.62069
[14] Jones, G. L., Haran, M., Caffo, B. S. and Neath, R. (2006). Fixed-width output analysis for Markov chain Monte Carlo. J. Amer. Statist. Assoc. 101 , 1537-1547. · Zbl 1171.62316
[15] Lawler, G. F. and Sokal, A. D. (1988). Bounds on the \({L}^2\) spectrum for Markov chains and Markov processes: a generalization of Cheeger’s inequality. Trans. Amer. Math. Soc. 309 , 557-580. · Zbl 0716.60073
[16] Liu, J. S. (1996). Metropolized independent sampling with comparisons to rejection sampling and importance sampling. Statist. Comput. 6 , 113-119.
[17] Liu, J. S., Wong, W. H. and Kong, A. (1994). Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes. Biometrika 81 , 27-40. · Zbl 0811.62080
[18] Marchev, D. and Hobert, J. P. (2004). Geometric ergodicity of van Dyk and Meng’s algorithm for the multivariate Student’s \(t\) model. J. Amer. Statist. Assoc. 99 , 228-238. · Zbl 1089.60518
[19] Mengersen, K. L. and Tweedie, R. L. (1996). Rates of convergence of the Hastings and Metropolis algorithms. Ann. Statist. 24 , 101-121. · Zbl 0854.60065
[20] Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability . Springer, London. · Zbl 0925.60001
[21] Papaspiliopoulos, O. and Roberts, G. (2008). Stability of the Gibbs sampler for Bayesian hierarchical models. Ann. Statist. 36 , 95-117. · Zbl 1144.65007
[22] Peskun, P. H. (1973). Optimum Monte-Carlo sampling using Markov chains. Biometrika 60 , 607-612. · Zbl 0271.62041
[23] Robert, C. P. (1995). Convergence control methods for Markov chain Monte Carlo algorithms. Statist. Sci. 10 , 231-253. · Zbl 0955.60526
[24] Roberts, G. O. and Polson, N. G. (1994). On the geometric convergence of the Gibbs sampler. J. R. Statist. Soc. B 56 , 377-384. · Zbl 0796.62029
[25] Roberts, G. O. and Rosenthal, J. S. (1997). Geometric ergodicity and hybrid Markov chains. Electron. Commun. Prob. 2 , 13-25. · Zbl 0890.60061
[26] Roberts, G. O. and Rosenthal, J. S. (1998). Two convergence properties of hybrid samplers. Ann. Appl. Prob. 8 , 397-407. · Zbl 0938.60055
[27] Roberts, G. O. and Rosenthal, J. S. (1999). Convergence of slice sampler Markov chains. J. R. Statist. Soc. B 61 , 643-660. · Zbl 0929.62098
[28] Roberts, G. O. and Rosenthal, J. S. (2001). Markov chains and de-initializing processes. Scand. J. Statist. 28 , 489-504. · Zbl 0985.60067
[29] Roberts, G. O. and Rosenthal, J. S. (2004). General state space Markov chains and MCMC algorithms. Prob. Surveys 1 , 20-71. · Zbl 1189.60131
[30] Roberts, G. O. and Rosenthal, J. S. (2011). Quantitative non-geometric convergence bounds for independence samplers. Methodol. Comput. Appl. Prob. 13 , 391-403. · Zbl 1222.60054
[31] Roberts, G. O. and Sahu, S. K. (1997). Updating schemes, correlation structure, blocking and parametrization for the Gibbs sampler. J. R. Statist. Soc. B 59 , 291-317. · Zbl 0886.62083
[32] Roberts, G. O. and Stramer, O. (2001). On inference for partially observed nonlinear diffusion models using the Metropolis-Hastings algorithm. Biometrika 88 , 603-621. · Zbl 0985.62066
[33] Roberts, G. O. and Tweedie, R. L. (1996). Geometric convergence and central limit theorems for multidimensional Hastings and Metropolis algorithms. Biometrika 83 , 95-110. · Zbl 0888.60064
[34] Rogers, L. C. G. and Williams, D. (1994). Diffusions, Markov Processes, and Martingales, Vol. 1, Foundations , 2nd edn. John Wiley, Chichester. · Zbl 0826.60002
[35] Rosenthal, J. S. (1995). Minorization conditions and convergence rates for Markov chain Monte Carlo. J. Amer. Statist. Assoc. 90 , 558-566. (Correction: 90 (1995), 1136.) · Zbl 0824.60077
[36] Rosenthal, J. S. (1996). Analysis of the Gibbs sampler for a model related to James-Stein estimators. Statist. Comput. 6 , 269-275.
[37] Roy, V. and Hobert, J. P. (2007). Convergence rates and asymptotic standard errors for Markov chain Monte Carlo algorithms for Bayesian probit regression. J. R. Statist. Soc. B 69 , 607-623.
[38] Schervish, M. J. and Carlin, B. P. (1992). On the convergence of successive substitution sampling. J. Comput. Graph. Statist. 1 , 111-127.
[39] Sinclair, A. (1992). Improved bounds for mixing rates of Markov chains and multicommodity flow. Combin. Prob. Comput. 1 , 351-370. · Zbl 0801.90039
[40] Smith, R. L. and Tierney, L. (1996). Exact transition probabilities for the independence Metropolis sampler. Tech. Rep. , University of North Carolina.
[41] Tan, A. and Hobert, J. P. (2009). Block Gibbs sampling for Bayesian random effects models with improper priors: convergence and regeneration. J. Comput. Graph. Statist. 18 , 861-878.
[42] Tierney, L. (1994). Markov chains for exploring posterior distributions. With discussion and a rejoinder by the author. Ann. Statist. 22 , 1701-1762. · Zbl 0829.62080
[43] Tierney, L. (1998). A note on Metropolis-Hastings kernels for general state spaces. Ann. Appl. Prob. 8 , 1-9. · Zbl 0935.60053
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.