arXiv Science⌕ Search

arXiv · math/0607800

The ODE method for stability of skip-free Markov chains with applications to MCMC

Abstract

Fluid limit techniques have become a central tool to analyze queueing networks over the last decade, with applications to performance analysis, simulation and optimization. In this paper, some of these techniques are extended to a general class of skip-free Markov chains. As in the case of queueing models, a fluid approximation is obtained by scaling time, space and the initial condition by a large constant. The resulting fluid limit is the solution of an ordinary differential equation (ODE) in ``most'' of the state space. Stability and finer ergodic properties for the stochastic model then follow from stability of the set of fluid limits. Moreover, similarly to the queueing context where fluid models are routinely used to design control policies, the structure of the limiting ODE in this general setting provides an understanding of the dynamics of the Markov chain. These results are illustrated through application to Markov chain Monte Carlo methods.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Gersende Fort, Sean Meyn, Eric Moulines, Pierre Priouret. 2008-04-02. The ODE method for stability of skip-free Markov chains with applications to MCMC. https://doi.org/10.1214/07-aap471. https://arxiv.science/abs/math/0607800

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

Approximation of the Lévy-driven stochastic heat equation on the sphere

The stochastic heat equation on the sphere driven by an additive square-integrable Lévy process is approximated by a spectral method in space and forward and backward Euler-Maruyama schemes in time. New sharp regularity results are proven for its solution. The spectral approximation is based on a truncation of the series expansion with respect to the spherical harmonic functions. For a given regularity of the initial condition and two different settings of regularity for the driving noise, strong convergence rates for the spectral approximation and for the Euler-Maruyama methods are proven. Moreover, weak rates of up to twice the strong rates are shown for Wiener noise and for Lévy noise with independent and up to a deterministic decay rate factor identically distributed components, while for general square-integrable Lévy noise the weak rate depends explicitly on the polynomial order of the test function. Numerical simulations confirm the theoretical results.

math.PR↗

A Multivariate Generalized Cox Model for Dependent and Simultaneous Default Times

We propose a framework for dependent default times where each name defaults when an increasing driver crosses an independent unit exponential threshold. As in Gueye and Jeanblanc (2022), the drivers may jump, so defaults may occur at stopping times of the reference filtration, including predictable ones, and a common jump may cause no, one or several simultaneous defaults. For general drivers, we derive the conditional joint survival law by a backward recursion; it is an explicit product of survival functions if and only if, for every set of names, the predictable reduction of the compensator of their first default time is deterministic. If, moreover, defaults avoid predictable stopping times, the law is a fatal shock law with hazards identified from the drivers; predictable default atoms can rule this out. Examples include Lévy subordinators and, with random reductions but explicit laws, Liu's model and shot-noise drivers with memory.

math.PR↗

Concentration Inequalities for Branching Random Walks

Motivated by phase transition problems in CSPs, we prove a more general concentration inequality that retains classical sub-Gaussian tails under a mild global linear-growth condition $|S_n| < Cn$, relaxing the bounded-increment assumption to finite exponential moments and requiring neither independence nor the martingale property. We further extend it to branching random walks (BRWs), obtaining the first concentration inequality for BRWs.

math.PR↗