arXiv Science⌕ Search

subject

math.PR

math.PR: explore 87 source-linked works published from 2005 to 2026, with original documents and citations.

This collection is a preview while coverage and quality are evaluated.

Search within this collection

Coverage and selection

Includes records with this source-supplied label or an explicit phrase match in their metadata. Matches indicate a mention, not proof that a paper uses a method or tests a material. Source versions are consolidated by DOI.

Sources: arxiv. Collection updated 2026-09-16. Counts describe this index, not the complete source archives.

Almost Sharp Equivalence between Approximate Message Passing and Low-Degree Polynomials

We prove a sharp lower bound for growing-degree polynomial estimation in the symmetric rank-one matrix estimation problem. The observation is \[ \boldsymbol{Y}=\frac{1}{\sqrt{n}} \boldsymbolθ \boldsymbolθ^{\top}+\boldsymbol{W}, \] where the coordinates of $\boldsymbolθ$ are independent with a common, fixed sub-Gaussian distribution $π_Θ$ satisfying $\mathbb E[Θ]\neq0$, and $\boldsymbol{W}$ is symmetric with independent standard Gaussian upper-triangular entries. For every such prior, we give an explicit finite-dimensional bound implying that every sequence of polynomial estimators of degree $D(n)=o(n^{1/60})$ has normalized mean-square error with limit inferior at least $\mathbb E[Θ^2]-q_{\mathsf{amp}}$, the limiting error of Bayes approximate message passing (AMP). This extends the constant-degree equivalence of Montanari and Wein~\cite{montanari2025equivalence} to growing degree under the same prior assumptions. Combined with their polynomial approximation of fixed-iteration AMP, the bound identifies the exact limiting low-degree MMSE whenever $D(n)\to\infty$ within this range. It thereby answers the growing-degree AMP-equivalence question discussed in~\cite{wein2025computational, maleki2026high} for nonzero-mean sub-Gaussian priors in the stated degree range. We also obtain a moment-dependent finite-dimensional lower bound for any nonzero-mean prior with all moments finite. The proof bounds low-degree MMSE using \emph{conditional} joint cumulants and a refined application of Jensen's inequality. The conditional cumulants are defined using an auxiliary Gaussian channel $\boldsymbol{R}$ calibrated to the AMP fixed point. This retains signal dependence that is lost in unconditional cumulant bounds and produces the cancellations needed for quantitative control as the degree grows.

math.ST↗

Conditional Fisher-Information Central Limit Theorems under Log-Concavity with Information-Theoretic Consequences

We establish conditional central limit theorems in Fisher information under log-concavity in every fixed dimension. For conditionally centered normalized sums, after whitening by the averaged conditional covariance, the averaged conditional Fisher information converges to the dimension if and only if it is finite at one convolution level. The scalar criterion follows as the one-dimensional case; we also provide an independent scalar proof based on a second-order continuity theorem for Fisher production on Gaussian-smoothed, tail-controlled classes. For the original sums, the averaged Fisher information matrix converges in operator norm to the inverse averaged conditional covariance. Consequently, the conditional relative Fisher information with respect to the limiting Gaussian law vanishes, and the Gaussian logarithmic Sobolev inequality yields convergence in conditional relative entropy and conditional entropy. We give two operational consequences. For any fixed finite-constellation low-power input, the first-order conditional mutual-information slope converges to the Gaussian-noise benchmark. For Gaussian signaling at any fixed signal covariance, the mutual-information gap from that benchmark is bounded by the conditional relative Fisher deficit and hence vanishes asymptotically.

cs.IT↗

Efficient computation of the asymptotics of extensive-rank HCIZ integrals

We study the high-dimensional asymptotics of Harish-Chandra-Itzykson-Zuber (HCIZ) integrals in the extensive-rank regime. The limit of these integrals is governed by a one-dimensional boundary-value hydrodynamical problem originally derived by Matytsin (1994) and rigorously proved by Guionnet and Zeitouni (2002). Despite its wide-ranging applications, explicit solutions to this problem are known only in a few specific cases. In this work, we introduce an efficient numerical scheme based on a particle discretization and prove its convergence to the continuous boundary-value problem for generic boundary densities. We validate our approach against known analytical solutions and apply it to generic densities, uncovering interesting dynamical phenomena. The high-dimensional limit of HCIZ integrals appears in various contexts, from the large deviations of random matrix spectra to the limiting free energy of disordered systems, high-dimensional statistics, and machine learning. As such, our contribution opens the way towards the numerical exploration of a wide range of high-dimensional models that were previously intractable.

math.PR↗

A sharp version of Talagrand's selector process conjecture, with applications to rounding fractional covers and Bernoulli Sudakov minoration

We prove a sharp version of Talagrand's selector process conjecture. Roughly speaking, given any collection of nonnegative weight vectors whose support form a family that is not $p$-small, a random set of density $O(sp)$ captures all but a $2^{-s}$ fraction of weight of some vector with high probability. This gives a common strengthening of Talagrand's selector process conjecture and the Kahn--Kalai conjecture. We give two applications of this result. First, towards a conjecture of Talagrand on the equivalence of expectation thresholds and fractional expectation thresholds, we show that a $p$-small fractional cover supported on sets of size at most $t$ can be rounded to a $cp/\log(2t)$-small integral cover. As a corollary, we show that the fractional and integral expectation thresholds are separated by at most a $\log \log$ factor. Second, we prove a Sudakov minoration principle for general positive selector processes, which in particular resolves a problem of Talagrand on Sudakov minoration for the product Bernoulli measure.

math.CO↗

Convergent Stochastic Training of Multi-Headed Attention and Understanding LoRA

Transformers have revolutionized machine learning and deploying attention layers in the model is increasingly standard across a myriad of applications. Further, for large models, it is common to implement Low Rank Adaptation (LoRA), whereby a factorized parameterization of them is trained, to achieve a surprisingly beneficial accuracy-size trade-off. In this work, via a unified framework we rigorously establish trainability of such models under stochastic methods. We prove that for a class of mild regularizations, the empirical regression loss on a attention layer and LoRA on a shallow neural net, both induce Poincaré inequality for the corresponding Gibbs' measure. Crucially, we show that the Poincaré constant is free of the data dimension for LoRA and for multi-head attention it is free of the head dimensions, Then it follows, via invoking recent results, that a certain SDE, which mimics the SGD, minimizes the corresponding losses. In both the cases, our first-of-its-kind results of trainability on attention and nets, do not use any assumptions on the data or the model size.

cs.LG↗

Beyond Worst-Case Coreset Bounds for $k$-Clustering via Determinantal Sampling

Massive datasets in modern machine learning have made data reduction a central challenge, particularly for clustering tasks where memory and computational constraints demand compact yet faithful summaries. A standard approach is to construct an \textit{$ε$-coreset}: a small weighted subset that approximately preserves the clustering cost for every plausible choice of centers. For the \textit{$(k,z)$-clustering problem}, existing worst-case bounds on coreset size are essentially tight, ruling out substantially smaller coresets in general. However, such worst-case instances are often unrepresentative of real-world data. In this work, we show that significantly smaller coresets are possible under mild and natural assumptions on the underlying data distribution. We introduce a new correlated sampling framework, called \textit{determinantal sampling}, based on a novel application of determinantal point processes. Using this framework, we obtain an efficiently constructible $\varepsilon$-coreset for $(k,z)$-clustering in $\mathbb R^d$ whose dependence on $1/\varepsilon$ has exponent strictly smaller than $2$ when $d$ is fixed. This improves over the worst-case $\varepsilon^{-2}$ barrier under our beyond-worst-case assumptions. To the best of our knowledge, this is the first result that provably surpasses these lower bounds through beyond-worst-case assumptions. Finally, we validate our approach on synthetic and real-world benchmark datasets, where it consistently achieves smaller coresets than existing state-of-the-art methods, even without explicitly enforcing the assumptions used in the analysis.

stat.ML↗

From Tsallis to KL: Convergence and Error Estimates for Tsallis-Regularized Optimal Transport

We study the Tsallis-to-Kullback--Leibler (KL) limit for entropy-regularized optimal transport with nonnegative bounded continuous costs. Fixing the regularization parameter $\varepsilon > 0$, we first derive an exact variational reformulation of Tsallis-regularized optimal transport in terms of the Tsallis information projection onto the set of couplings. The formula isolates an explicit correction term and thereby explains why, unlike in the KL case, the regularized transport problem and the corresponding information projection problem do not coincide exactly. We also establish existence and uniqueness for the Tsallis information projection. We then prove, with respect to the narrow topology, the $Γ$-convergence of the Tsallis-regularized functionals to the KL-regularized functional as $q\downarrow1$, together with narrow convergence of their unique minimizers. Finally, we obtain explicit error estimates of order $O(q-1)$ for both the regularized optimal transport values and the associated information projection values. These results quantify the passage from Tsallis regularization to the classical KL setting and clarify the relation between entropic regularization and information projection for $1 < q \leq 2$.

cs.IT↗

Rate of convergence of a fully discrete structure-preserving midpoint scheme for the stochastic Landau--Lifshitz--Gilbert equation

The stochastic Landau--Lifshitz--Gilbert (sLLG) equation is a strongly nonlinear stochastic PDE with a non-convex pointwise constraint arising in the theory of micromagnetics. We analyse a fully discrete, structure-preserving finite element approximation of the sLLG equation with coloured multiplicative Stratonovich noise on a bounded interval. The method utilises continuous piecewise affine finite elements, mass lumping, and midpoint time discretisation to preserve the unit-length constraint exactly at the finite element nodes. Under suitable regularity assumptions on the initial data and the noise, we establish uniform higher-moment stability and develop an error analysis for the scheme. The analysis exploits the geometric structure of the equation and the stochastic midpoint discretisation. For every $γ\in(0,\frac12)$, we prove first-order spatial convergence and temporal convergence of order $γ$ in the natural discrete energy norm, locally in mean square on events of arbitrarily large probability and, consequently, in probability. To the best of our knowledge, this is the first convergence-rate result for a fully discrete structure-preserving finite element scheme solving the stochastic Landau--Lifshitz--Gilbert equation.

math.NA↗

A discontinuous Galerkin approximation of the Dean--Kawasaki equation

We introduce and analyse an arbitrary order spatial discontinuous Galerkin (dG) method for the Dean--Kawasaki equation, a highly singular SPDE modelling density fluctuations of $N$ diffusing particles in the regime of large particle number $N \gg 1$. Our starting point is a general procedure for discretising multiplicative, divergence-form noise on finite element spaces whilst preserving its cross-variation structure at the discrete level; the construction is explicit, elementwise, applies to continuous and discontinuous spaces alike, and extends to general mobilities. Using it, we prove weak error estimates of order $O(h^p)$ between fluctuations of the semi-discrete scheme and those of the underlying particle system, together with a correction that is exponentially small in the scaling regime $Nh^d \gg 1$ and arises because the scheme does not preserve positivity. The resulting method is locally and globally conservative and applies on unstructured simplicial meshes. Quantitative numerical experiments support the analysis, and further experiments illustrate the method beyond the scope of the theory: indicator function observables, external and interaction potentials, convection-dominated regimes and reflecting boundary conditions.

math.NA↗

Numerical approximation to the invariant measure of McKean-Vlasov stochastic differential equations

Inspired by the stochastic particle method, this paper develops an easily implementable explicit scheme for McKean-Vlasov stochastic differential equations (MV-SDEs) with superlinear growth coefficients. We prove that the numerical solution of the interacting particle system (IPS) attains the optimal uniform-in-time strong convergence rate of order 1/2, and that it faithfully captures the long-term dynamics of MV-SDEs, including moment boundedness, stability, and ergodicity. In particular, the existence and uniqueness of an exchangeable numerical invariant probability measure for the IPS are established via an appropriately constructed operator semigroup. Concerning the approximation of the invariant measure, we derive a non-asymptotic error bound between the distribution of the one-particle numerical solution and the marginal distribution of the IPS's invariant measure; By the uniform-in-time propagation of chaos, we further obtain an asymptotic error bound between the one-particle marginal of the IPS's numerical invariant measure and the exact invariant measure of the MV-SDE. Numerical experiments are provided to validate the theoretical results.

math.PR↗

Hit-and-Run Mixes as Fast as the Ball Walk

Let $K\subset\mathbb{R}^n$ be an isotropic convex body. We prove that the hit-and-run walk, started from any $M$-warm distribution, reaches total-variation distance $\varepsilon$ from the uniform distribution on $K$ in $O\!\left(n^2ψ_n^{-2}\log^3(M/\varepsilon)\right)$ steps, where $ψ_n^{-1}$ is the Kannan-Lovász-Simonovits (KLS) constant. Up to logarithmic factors, this matches the best-known warm-start mixing time for the ball walk. Chen and Eldan [Discrete Comput. Geom. 2026] obtained the same $n^2ψ_n^{-2}$ dependence for hit-and-run, but with polynomial dependence on $M/\varepsilon$. Our result improves that polynomial dependence to a polylogarithmic one, fully resolving their open question about warm-start mixing of hit-and-run in isotropic convex bodies.

cs.DS↗

Exact affine conditioning beyond Gaussians: a unique characterization of the ensemble Kalman update

The analysis step of the stochastic ensemble Kalman filter, called the ensemble Kalman update (EnKU), is widely used for approximating posterior distributions in inverse problems and data assimilation. The EnKU approximates the posterior distribution $π_{X\mid Y=y_\star}$ by pushing forward the joint distribution $(X,Y)\simπ$ through an affine map $L^{\mathrm{EnKU}}_{π,y_\star}(x,y)$ that depends only on the covariance structure of $π$ and the observation $y_\star$. While the EnKU yields the exact posterior for Gaussian $π$ in the mean-field, this property alone does not uniquely determine the EnKU. In fact, there are infinitely many affine maps $L_{π, y_\star}$ that achieve such exact conditioning. In this paper, we offer a novel characterization of the EnKU among all such affine maps. We first exhaustively characterize the set ${E}^{\mathrm{EnKU}}$ of joint distributions for which the EnKU yields exact conditioning, showing that it is much larger than the set of Gaussians. Next, we show that except for a small class of highly symmetric distributions within ${E}^{\mathrm{EnKU}}$, the EnKU is the {unique} exact affine conditioning map. Further, we characterize the largest possible set of distributions ${F}$ for which a distribution-dependent, weakly observation-dependent, affine map exists, a class of transports that naturally includes the EnKU. We show that ${F}={E}^{\mathrm{EnKU}}\cup{S}_{\mathrm{nl-dec}}$ with a small symmetry class ${S}_{\mathrm{nl-dec}}$, meaning that for affine conditioning beyond the Gaussian setting, the EnKU has an exact set that is essentially maximally large.

math.ST↗

An Euler scheme for BSDEs via the Wiener chaos decomposition

The Euler scheme is a standard time discretization for BSDEs, but its implementation hinges on approximating conditional expectations and the associated martingale terms at each time step. We propose an implementation based on the Wiener chaos decomposition to approximate these quantities. In contrast to many numerical schemes that rely on a finite-dimensional Markovian representation, our approach accommodates arbitrary $\mathcal{F}_T$-measurable square-integrable terminal conditions. We provide a comprehensive convergence analysis under additional Malliavin regularity assumptions and illustrate the method on several numerical examples, including genuinely non-Markovian problems arising, for instance, in the pricing and hedging of contingent claims under rough-volatility models.

math.NA↗

Deep belief networks are exact

We prove that every strictly positive probability distribution on \(\{-1,1\}^n\) is represented exactly by a sigmoid belief network with finite parameters. This answers a question of Sutskever and Hinton. The proof upgrades their probability-sharing approximation to exact representation using Brouwer's fixed-point theorem.

cs.AI↗

Optimal mixing of the systematic scan dynamics via approximate tensorization of entropy

We study the mixing time of the systematic scan dynamics for high-dimensional discrete distributions. This Markov chain updates coordinates sequentially according to a fixed predetermined order, in contrast to the Glauber dynamics that updates coordinates selected uniformly at random. The systematic scan is often favored in practice because it exhibits strong empirical performance, but its theoretical analysis remains far less developed than that of Glauber dynamics. We take a step toward addressing this imbalance by showing that two standard functional notions of weak dependence between the coordinates of the distribution provide strong convergence guarantees for the systematic scan dynamics. First, we show that approximate tensorization of entropy implies optimal $O(\log n)$ mixing time for every scan order under standard marginal, connectivity, and bounded interaction degree assumptions about the distribution. Second, we show that approximate tensorization of variance yields a constant-factor contraction of the variance functional per scan, which in turn implies an optimal $O(1)$ relaxation time for the natural additive and multiplicative reversibilizations of the systematic scan dynamics. Compared with our entropy result, the variance bound improves the dependence on the maximum interaction degree from exponential to quadratic and requires weaker assumptions on the distribution. As concrete applications of our results, we establish optimal $O(\log n)$ mixing of the systematic scan dynamics for bounded-degree antiferromagnetic two-spin systems in the tree-uniqueness region and for the ferromagnetic $q$-state Potts model on square boxes in $\mathbb{Z}^2$ throughout its subcritical regime.

math.PR↗

Moments of crosscorrelation demerit factors of binary sequences

Families of sequences with low mutual aperiodic crosscorrelation assist the design of systems for multi-user asynchronous communications and multiple-input multiple-output radar. The crosscorrelation demerit factor of a pair of sequences is the sum of the squared magnitudes of their crosscorrelation values at every shift when the sequences are normalized to unit Euclidean norm, and the merit factor is the reciprocal of the demerit factor. For each positive integer $\ell$, we endow the $2^{2 \ell}$ pairs of binary sequences of length $\ell$ with uniform probability measure and study the distribution of their crosscorrelation demerit factors. Sarwate showed that the mean value is always $1$ regardless of length $\ell$. We develop a method for finding an exact formula for the $p$th central moment (for any positive integer $p$) as a function of $\ell$. Formulae for the variance and third central moment ($p=2$ and $3$) are then obtained by hand calculations, while the fourth through sixth central moments are obtained by computer-assisted calculations. Our theory also shows that all the central moments must be strictly positive for $p\geq 2$ and $\ell \geq 3$.

cs.IT↗

On the Equality of the ELBO to a Sum of Entropies at Stationary Points of Learning

The variational lower bound (a.k.a. ELBO or free energy) is the central objective for many established as well as for many novel algorithms for unsupervised learning. Such algorithms usually increase the bound until parameters have converged to values close to a stationary point of the learning dynamics. Here we show that (for a very large class of generative models) the variational lower bound is at all stationary points of learning equal to a sum of entropies. Concretely, for standard generative models with one set of latents and one set of observed variables, the sum consists of three entropies: (A) the (average) entropy of the variational distributions, (B) the negative entropy of the model's prior distribution, and (C) the (expected) negative entropy of the observable distribution. The obtained result applies under realistic conditions including: finite numbers of data points, at any stationary point (including saddle points) and for any family of (well behaved) variational distributions. The class of generative models for which we show the equality to entropy sums contains many standard as well as novel generative models including standard (Gaussian) variational autoencoders. The prerequisites we use to show equality to entropy sums are relatively mild. Concretely, the distributions defining a given generative model have to be of the exponential family, and the model has to satisfy a parameterization criterion (which is usually fulfilled). Proving equality of the ELBO to entropy sums at stationary points (under the stated conditions) is the main contribution of this work.

stat.ML↗

Entropy and Distributed Source Coding of Connected Soft Random Geometric Graphs

We consider the distributed compression of Soft Random Geometric Graphs (SRGGs) above the connectivity threshold. We establish the Slepian-Wolf rate region for the SRGG in the setting where there are a finite number of encoders compressing sections of the graph independently. To do so, we prove novel limit theorems and asymptotic equipartition properties for the SRGG and its entropy, which allow us to use random binning techniques for distributed compression.

cs.IT↗
Compare source metadata on this page
WorkPublishedSource identifierSource
Almost Sharp Equivalence between Approximate Message Passing and Low-Degree Polynomials2026-10-162609.06988arxiv
Conditional Fisher-Information Central Limit Theorems under Log-Concavity with Information-Theoretic Consequences2026-09-072609.07150arxiv
Efficient computation of the asymptotics of extensive-rank HCIZ integrals2026-09-072609.07771arxiv
A sharp version of Talagrand's selector process conjecture, with applications to rounding fractional covers and Bernoulli Sudakov minoration2026-09-062412.03540arxiv
Convergent Stochastic Training of Multi-Headed Attention and Understanding LoRA2026-09-062605.07959arxiv
Beyond Worst-Case Coreset Bounds for $k$-Clustering via Determinantal Sampling2026-09-062609.06394arxiv
From Tsallis to KL: Convergence and Error Estimates for Tsallis-Regularized Optimal Transport2026-09-062609.06432arxiv
Rate of convergence of a fully discrete structure-preserving midpoint scheme for the stochastic Landau--Lifshitz--Gilbert equation2026-09-062609.06459arxiv
A discontinuous Galerkin approximation of the Dean--Kawasaki equation2026-09-062609.06681arxiv
Numerical approximation to the invariant measure of McKean-Vlasov stochastic differential equations2026-09-052401.02878arxiv
Hit-and-Run Mixes as Fast as the Ball Walk2026-09-052608.13487arxiv
Exact affine conditioning beyond Gaussians: a unique characterization of the ensemble Kalman update2026-09-042510.00158arxiv
An Euler scheme for BSDEs via the Wiener chaos decomposition2026-09-042512.16418arxiv
Deep belief networks are exact2026-09-042609.05572arxiv
Optimal mixing of the systematic scan dynamics via approximate tensorization of entropy2026-09-042609.05750arxiv
Moments of crosscorrelation demerit factors of binary sequences2026-09-042609.05771arxiv
On the Equality of the ELBO to a Sum of Entropies at Stationary Points of Learning2026-09-032209.03077arxiv
Entropy and Distributed Source Coding of Connected Soft Random Geometric Graphs2026-09-032605.04703arxiv

These are bibliographic comparisons, not experimental rankings. Follow the original document for methods and conditions.