Exact Bayesian inference for discretely observed Markov Jump Processes using finite rate matrices

Sherlock, Chris and Golightly, Andrew (2023) Exact Bayesian inference for discretely observed Markov Jump Processes using finite rate matrices. Journal of Computational and Graphical Statistics, 32 (1). pp. 36-48. ISSN 1061-8600

[thumbnail of MJPexactJCGSfinal]
Text (MJPexactJCGSfinal)
MJPexactJCGSfinal.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (483kB)


We present new methodologies for Bayesian inference on the rate parameters of a discretely observed continuous-time Markov jump process with a countably infinite statespace. The usual method of choice for inference, particle Markov chain Monte Carlo (particle MCMC), struggles when the observation noise is small. We consider the most challenging regime of exact observations and provide two new methodologies for inference in this case: the minimal extended statespace algorithm (MESA) and the nearly minimal extended statespace algorithm (nMESA). By extending the Markov chain Monte Carlo statespace, both MESA and nMESA use the exponentiation of finite rate matrices to perform exact Bayesian inference on the Markov jump process even though its statespace is countably infinite. Numerical experiments show improvements over particle MCMC of between a factor of three and several orders of magnitude.

Item Type:
Journal Article
Journal or Publication Title:
Journal of Computational and Graphical Statistics
Uncontrolled Keywords:
?? mcmccontinuous-time markov chaincoffin statecorrelated pseudo-marginaldiscrete mathematics and combinatoricsstatistics and probabilitystatistics, probability and uncertainty ??
ID Code:
Deposited By:
Deposited On:
14 Jul 2022 09:25
Last Modified:
15 Jul 2024 22:45