arXiv subjects

Alexander Falk

Publications and source records attributed to Alexander Falk.

5 recordsLinked to original sources

arXiv2026

Time-Inhomogeneous Preconditioned Langevin Dynamics

Langevin sampling from distributions of the form $p(x) \propto \exp(-\Psi(x))$ faces two major challenges: (global) mode coverage and (local) mode exploration. The first challenge is particularly relevant for multi-modal distributions with disjoint modes, whereas the second arises when the potential $\Psi$ exhibits diverse and ill-conditioned local mode geometry. To address these challenges, a common approach is to precondition Langevin dynamics with problem-specific information, such as the sample covariance or the local curvature of $\Psi$. However, existing preconditioner choices inherently involve a trade-off between global mode coverage and local mode exploration, and no prior method resolves both simultaneously. To overcome this limitation, we propose the TIPreL, which introduces a time- and position-dependent preconditioner. This design effectively addresses both challenges mentioned above within a single framework. We establish convergence of the resulting dynamics in the Wasserstein-2 distance both in continuous time and for a tamed Euler discretization. In particular, our analysis extends the existing state of the art by proving convergence under time- and space-dependent diffusion coefficients, and only locally Lipschitz drifts, which has not been covered by prior work. Finally, we experimentally compare TIPreL with competing preconditioning schemes on a two-dimensional, severely ill-posed example and on a Bayesian logistic regression task in higher dimensions, confirming the efficiency of the proposed method.

math.ST↗

arXiv2025

Accelerated Sampling with the Inertial Langevin Algorithm

We consider the \emph{inertial Langevin algorithm} (ILA), a simple momentum-based method for sampling from Gibbs distributions of the form $\pi(x) \propto \exp(-U(x))$. ILA augments the unadjusted Langevin algorithm with an inertia term and a matching noise rescaling, yielding a sampling analogue of Polyak's heavy-ball method from optimization. This modification provably accelerates convergence. For Gaussian targets, ILA attains Wasserstein-2 accuracy $\delta$ in $\tilde{\mathcal O (\sqrt{\kappa}/\sqrt\delta)$ iterations, where $\kappa = L/m$ denotes the condition number and $\tilde{\mathcal O}$ hides logarithmic factors, thus reaching the ballistic $\sqrt{\kappa}$ complexity known from accelerated optimization and proven to be a lower bound for sampling from Gaussians. Moreover, we show that the method's bias can be fully removed and, thus, complexity reduced to $\tilde \Oc(\sqrt{\kappa})$ by considering the sequence consisting of the average of ever two consecutive ILA iterates, which is shown to be equivalent to the well-known BAOAB splitting scheme in the linear setting. Beyond Gaussians, for $L$-smooth potentials with sufficient growth at infinity, we prove geometric ergodicity of ILA and of its continuous-time analogue, the underdamped Langevin dynamics, together with convergence of the discretization bias to zero as the step size decreases. These guarantees hold under considerably simpler parameter restrictions than previously available in the literature, in particular, not imposing a lower bound on the friction, which is conjectured to be crucial for acceleration. We underpin our theoretical findings with numerical experiments covering ill-conditioned Gaussian distributions, total variation image denoising, and the challenging task of maximum likelihood learning of an energy-based model for molecular structure generation.

math.NA↗

arXiv2025

Diffusion at Absolute Zero: Langevin Sampling using Successive Moreau Envelopes [journal paper]

We propose a method for sampling from Gibbs distributions of the form $\pi(x)\propto\exp(-U(x))$ by considering a family $(\pi^{t})_t$ of approximations of the target density which is such that $\pi^{t}$ exhibits favorable properties for sampling when $t$ is large, and $\pi^{t} \to \pi$ as $t \to 0$. This sequence is obtained by replacing (parts of) the potential $U$ by its Moreau envelope. Through the sequential sampling from $\pi^{t}$ for decreasing values of $t$ by a Langevin algorithm with appropriate step size, the samples are guided from a simple starting density to the more complex target quickly. We prove the ergodicity of the method as well as its convergence to the target density without assuming convexity or differentiability of the potential $U$. In addition to the theoretical analysis, we show experimental results that support the superiority of the method in terms of convergence speed and mode-coverage of multi-modal densities to current algorithms. The experiments range from one-dimensional toy-problems to high-dimensional inverse imaging problems with learned potentials.

math.OC↗

arXiv2025

Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]

In this article we propose a novel method for sampling from Gibbs distributions of the form $\pi(x)\propto\exp(-U(x))$ with a potential $U(x)$. In particular, inspired by diffusion models we propose to consider a sequence $(\pi^{t_k})_k$ of approximations of the target density, for which $\pi^{t_k}\approx \pi$ for $k$ small and, on the other hand, $\pi^{t_k}$ exhibits favorable properties for sampling for $k$ large. This sequence is obtained by replacing parts of the potential $U$ by its Moreau envelopes. Sampling is performed in an Annealed Langevin type procedure, that is, sequentially sampling from $\pi^{t_k}$ for decreasing $k$, effectively guiding the samples from a simple starting density to the more complex target. In addition to a theoretical analysis we show experimental results supporting the efficacy of the method in terms of increased convergence speed and applicability to multi-modal densities $\pi$.

math.OC↗

arXiv2024

FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transforms

Medical image segmentation plays an important role in accurately identifying and isolating regions of interest within medical images. Generative approaches are particularly effective in modeling the statistical properties of segmentation masks that are closely related to the respective structures. In this work we introduce FlowSDF, an image-guided conditional flow matching framework, designed to represent the signed distance function (SDF), and, in turn, to represent an implicit distribution of segmentation masks. The advantage of leveraging the SDF is a more natural distortion when compared to that of binary masks. Through the learning of a vector field associated with the probability path of conditional SDF distributions, our framework enables accurate sampling of segmentation masks and the computation of relevant statistical measures. This probabilistic approach also facilitates the generation of uncertainty maps represented by the variance, thereby supporting enhanced robustness in prediction and further analysis. We qualitatively and quantitatively illustrate competitive performance of the proposed method on a public nuclei and gland segmentation data set, highlighting its utility in medical image segmentation applications.

cs.CV↗