Christopher Drovandi
Ensemble MCMC: Accelerating Pseudo-Marginal MCMC for State Space Models using the Ensemble Kalman Filter
Drovandi, Christopher; Everitt, Richard G.; Golightly, Andrew; Prangle, Dennis
Authors
Richard G. Everitt
Professor Andrew Golightly andrew.golightly@durham.ac.uk
Professor
Dennis Prangle
Abstract
Particle Markov chain Monte Carlo (pMCMC) is now a popular method for performing Bayesian statistical inference on challenging state space models (SSMs) with unknown static parameters. It uses a particle filter (PF) at each iteration of an MCMC algorithm to unbiasedly estimate the likelihood for a given static parameter value. However, pMCMC can be computationally intensive when a large number of particles in the PF is required, such as when the data are highly informative, the model is misspecified and/or the time series is long. In this paper we exploit the ensemble Kalman filter (EnKF) developed in the data assimilation literature to speed up pMCMC. We replace the unbiased PF likelihood with the biased EnKF likelihood estimate within MCMC to sample over the space of the static parameter. On a wide class of different non-linear SSM models, we demonstrate that our extended ensemble MCMC (eMCMC) methods can significantly reduce the computational cost whilst maintaining reasonable accuracy. We also propose several extensions of the vanilla eMCMC algorithm to further improve computational efficiency. Computer code to implement our methods on all the examples can be downloaded from https://github.com/cdrovandi/Ensemble-MCMC.
Citation
Drovandi, C., Everitt, R. G., Golightly, A., & Prangle, D. (2022). Ensemble MCMC: Accelerating Pseudo-Marginal MCMC for State Space Models using the Ensemble Kalman Filter. Bayesian Analysis, 17(1), 223-260. https://doi.org/10.1214/20-ba1251
Journal Article Type | Article |
---|---|
Acceptance Date | Nov 16, 2020 |
Online Publication Date | Dec 16, 2020 |
Publication Date | Feb 8, 2022 |
Deposit Date | Feb 9, 2022 |
Publicly Available Date | Feb 10, 2022 |
Journal | Bayesian Analysis |
Print ISSN | 1936-0975 |
Publisher | International Society for Bayesian Analysis (ISBA) |
Peer Reviewed | Peer Reviewed |
Volume | 17 |
Issue | 1 |
Pages | 223-260 |
DOI | https://doi.org/10.1214/20-ba1251 |
Files
Published Journal Article
(798 Kb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
You might also like
Accelerating Bayesian inference for stochastic epidemic models using incidence data
(2023)
Journal Article
Accelerating inference for stochastic kinetic models
(2023)
Journal Article
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search