Taming correlations through entropy-efficient measure decompositions with applications to mean-field approximation

Abstract

The analysis of various models in statistical physics relies on the existence of decompositions of measures into mixtures of product-like components, where the goal is to attain a decomposition into measures whose entropy is close to that of the original measure, yet with small correlations between coordinates. We prove a related general result: For every isotropic measure $μ$ on $\mathbb{R}^n$ and every $ε> 0$, there exists a decomposition $μ= \int μ_θd m(θ)$ such that $H(μ) - \mathbb{E}_{θ\sim m} H(μ_θ) \leq n ε$ and $\mathbb{E}_{θ\sim m} \mathrm{Cov}(μ_θ) \preceq \mathrm{Id}/ε$. As an application, we prove a general bound for the mean-field approximation of Ising and Potts models, which is in a sense dimension free, in both continuous and discrete settings. In particular, for an Ising model on $\{\pm 1 \}^n$ or on $[-1,1]^n$, we show that the deficit between the mean-field approximation and the free energy is at most $C \frac{1+p}{p} \left ( n\|J\|_{S_p} \right)^{\frac{p}{1+p}} $ for all $p>0$, where $\|J\|_{S_p}$ denotes the Schatten-$p$ norm of the interaction matrix. For the case $p=2$, this recovers the result of [Jain et al., 2018], but for an optimal choice of $p$ it often allows to get almost dimension-free bounds.