Gibbs sampling on a steady model

In this study Gibbs sampling, a widely used simulation method, is applied to the steady model, a simple variation of the dynamic linear model, and the model parameters are estimated. The estimates obtained from Gibbs sampling and the results for the standard Kalman filter are compared and are found to be close. These similarities in the results indicate the success of the stochastic simulation. In this study, a variance modulation on the steady model is also applied and Gibbs sampling is proposed to overcome analytic problems. In the variance adaptation, denned as $mu^b_t(a,b>0)$, estimates for the model parameters are obtained for different values of a and b.

PDF

___

[1] Brooks, S. P. Markov Chain Monte Carlo Method and its Application, The Statistician 47, 69-100, 1998.
[2] Carter, C.K. and Kohn, R. On Gibbs Sampling for State Space Models, Biometrika 81 (3), 541-553, 1994.
[3] Chib, S. and Greenberg, E. Markov Chain Monte Carlo Simulation Methods, in Econometrics, Econometric Theory 12, 409-431, 1996.
[4] Chib, S. and Greenberg, E. Understanding the Metropolis-Hasting Algorithm, The American Statistician 49, 327-335, 1995.
[5] Clayton, D. G. Generalized Linear Mixed Models, in Markov Chain Monte Carlo in Practice (eds. W.R. Gilks, S. Richardson and D. J. Spiegelhalter), (Chapman &Hall, 1996), 275-301.
[6] Congdon, P. Bayesian Statistical Modelling (Wiley, London, 2001).
[7] Cowles, M. K. and Carlin, B.P. 1996, Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review, J. Amer. Statist. Assoc. 91, 883-904, 1996.
[8] Fearnhead, P. MCMC, Sufficient Statistics, Journal of Computational and Graphical Statistics 11(4), 848-862, 2002.
[9] Gamerman, D. Markov Chain Monte Carlo, (Chapman & Hall, 1997).
[10] Gamerman, D. Sampling from the Posterior Distribution in Generalized Linear Mixed Models, [1] Statistics and Computing 7, 57-68, 1998.
[11] Gelfand, A.E. and Smith, A.F.M. Sampling-Based Approaches to Calculating Marjinal Densities, J. Amer. Stats. Assoc. 85, 398-409, 1990.
[12] Gelman, A., Carlin, J.B., Stern, H.S. and Rubin, D.B. Bayesian Data Analysis, (Chapman & Hall, London, 1998).
[13] Geman, S. and Geman, D. Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images, IEEE Transaction on Pattern Analysis and Machine Intelligence 6, 721-741, 1984.
[14] Gilks, W.R. and Berzuini, C. Following a Moving Target - Monte Carlo Inference for Dynamic Bayesian Models, Journal of Royal Statistical Society, Series B. 63, 1-20, 2001.
[15] Harrison, P.J. and Stevens ,C.F. Bayesian Forecasting (with discussion), Journal of Royal Statistical Society, Series B 38, 205-247, 1976.
[16] Kass, R. E. Markov Chain Monte Carlo in Practice: A Roundtable Discussion. Panel Discussion at Joint Statistical Meeting, 1997.
[17] Kunsch, H.R. 2001, State-Space and Hidden Markov Models, in Complex Stochastic Systems, O.E. Barndorff-Nielsen, D.R. Cox and C. Kluppelberg, Eds., Number 87 in Monographs on Statistics and Applied Probability, (Chapman and Hall, 2001), 1009-173.
[18] Pole, A., West, M. and Harrison, J. Applied Bayesian Forecasting and Time Series Analysis, (Chapman & Hall, New York, 1994).
[19] Radford, M. N. 2003, Markov Chain Sampling for Nonlinear State-Space Models Using Embedded Hidden Markov Models, Technical Report, No:0304, 9 Pages; Dept. of Statistics and Dept. of Computer Science, (Universtiy of Toronto, 2003)
[20] Spiegelhalter, Thomas and Best. WinBUGS User Manual, Version 1.3, www.mrc-bsu.cam.ac.uk./bugs, 1995.
[21] Spielgelhalter, Thomas and Best. WinBUGS User Manual, Version 1.4, www.mrc-bsu.cam.ac.uk./bugs, 2002.
[22] West, M. and Harrison, P.J., 1997, Bayesian Forecasting and Dynamic Models, (Springer Verlag, New York, 1997).

Hacettepe Journal of Mathematics and Statistics-Cover

Yayın Aralığı: Yılda 6 Sayı
Başlangıç: 2002
Yayıncı: Hacettepe Üniversitesi Fen Fakultesi

Arşiv