arXiv ScienceSearch

arXiv subjects

Gabriel Stoltz

Publications and source records attributed to Gabriel Stoltz.

At least 19 recordsLinked to original sources

The narrow escape problem in arbitrary dimension

The narrow escape problem is a prototypical example for studying entropic metastability, motivated by the analysis of biological and chemical systems. The problem concerns the determination of the exit time and position of a Brownian particle trapped in a domain with a reflecting boundary pierced by narrow holes. Our goal is to investigate this problem in a general domain in any dimension (greater than or equal to two), using the quasi-stationary distribution approach to metastability. In particular, we derive the asymptotic expansion of the mean exit time and the law of the exit position in the limit where the hole sizes tend to zero. Our analytical predictions are illustrated by numerical simulations, using dedicated Monte Carlo techniques.

math.AP

Approximating committor functions: Objective functions and training data sampling

Many molecular dynamics simulations aim at studying transitions between two states (from reactants to products). In this context, the committor function (which gives for a given molecular configuration the probability to reach the product state before the reactant state) is a pivotal quantity, in particular because it is the optimal importance function for rare event simulation methods such as importance sampling or splitting techniques. These methods are used to sample the reactive path ensemble, and estimate for example the transition rate. However, learning such a function is generally a challenging task due to the high dimensionality of the configuration space. In this work, after reviewing the existing methodologies to construct approximate committor functions, a new loss function based on the application of It\={o}'s formula is proposed to learn the committor function with a minimization procedure on the parameters of a neural network. After comparing this novel approach to existing procedures on the M\"uller--Brown potential, we introduce a coupling strategy with the Adaptive Multilevel Splitting method to better approximate the committor function using a better sampling of the reactive trajectories. This methodology in which the committor function is iteratively learned only requires initially the knowledge of the reactant and product states.

physics.chem-ph

On the diffusive-mean field limit of a kinetic weakly interacting particle system

We study the joint diffusive-mean field limit for a system of weakly interacting kinetic Langevin dynamics, extending the results of Delgadino, Gvalani and Pavliotis (Arch. Ration. Mech. Anal., 2021) to the hypoelliptic/hypocoercive case. We show that, in the absence of phase transitions, the two limits commute, and we calculate the covariance matrix of the limiting Brownian motion using the Green-Kubo/Kipnis-Varadhan formula. However, at low temperatures, and in the presence of phase transitions, the two limits may not commute. We demonstrate our findings by providing a detailed analysis of the diffusive-mean field limit for the $O(2)$ model in a magnetic field. Our analysis is based on the systematic use of recently developed hypocoercivity techniques, together with an appropriate linearization of the mean field McKean-Vlasov-Fokker-Planck partial differential equation.

math.AP

Mathematical analysis and numerical methods for the computation of transport coefficients in molecular dynamics

We review various numerical approaches to compute transport coefficients in molecular dynamics. These approaches can be broadly classified into three groups: (i) nonequilibrium methods based on applying an external driving field to the system, measuring the average response in the system, and evaluating the related linear response coefficient; (ii) approaches reformulating the transport coefficient of interest through a time correlation function for the equilibrium dynamics (the most popular instances being Green--Kubo and Einstein formulas); (iii) transient techniques, where the transport coefficient can be computed by monitoring the return to the steady state of a dynamics perturbed off its stationary distribution. For all three classes of methods, we provide elements of numerical analysis, allowing to estimate or at least quantify the level of numerical errors in the estimator of the transport coefficient; and also briefly present recent attempts to more efficiently compute transport coefficients with variance reduction approaches such as control variates, importance sampling and coupling methods. The computation of transport coefficients remains nonetheless challenging and will continue requiring research efforts in the foreseeable future.

math.NA

Efficient Monte Carlo sampling of metastable systems using non-local collective variable updates

Monte Carlo simulations are widely used to simulate complex molecular systems, but standard approaches suffer from metastability. Lately, the use of non-local proposal updates in a collective-variable (CV) space has been proposed in several works. Here, we generalize these approaches and explicitly spell out an algorithm for non-linear CVs and underdamped Langevin dynamics. We prove reversibility of the resulting scheme and demonstrate its performance on several numerical examples, observing a substantial performance increase compared to methods based on overdamped Langevin dynamics as considered previously. Advances in generative machine-learning-based proposal samplers now enable efficient sampling in CV spaces of intermediate dimensionality (tens to hundreds of variables), and our results extend their applicability toward more realistic molecular systems.

cond-mat.stat-mech

Shape optimization of metastable states

The definition of metastable states is an ubiquitous task in the design and analysis of molecular simulations, and is a crucial input in a variety of acceleration methods for the sampling of long configurational trajectories. Although standard definitions based on local energy minimization procedures can sometimes be used, these definitions are typically suboptimal, or entirely inadequate when entropic effects are significant, or when the lowest energy barriers are quickly overcome by thermal fluctuations. In this work, we propose an approach to the definition of metastable states, based on the shape-optimization of a local separation of timescale metric directly linked to the efficiency of a family of accelerated molecular dynamics algorithms. To realize this approach, we derive analytic expressions for shape-variations of Dirichlet eigenvalues for a class of operators associated with reversible elliptic diffusions, and use them to construct a local ascent algorithm, explicitly treating the case of multiple eigenvalues. We propose two methods to make our method tractable in high-dimensional systems: one based on dynamical coarse-graining, the other on recently obtained low-temperature shape-sensitive spectral asymptotics. We validate our method on a benchmark biomolecular system, showcasing a significant improvement over conventional definitions of metastable states.

physics.comp-ph

Generative modeling of conditional probability distributions on the level-sets of collective variables

Given a probability distribution $μ$ in $\mathbb{R}^d$ represented by data, we study in this paper the generative modeling of the corresponding conditional probability distributions on the level-sets of a collective variable $ξ:\mathbb{R}^d \rightarrow \mathbb{R}^k$, where $1 \le k<d$. We propose a general and efficient learning approach that can learn generative models on different level-sets of $ξ$ simultaneously. To improve the learning quality on level-sets in low-probability regions, we also propose a data enrichment strategy by utilizing data from enhanced sampling techniques. We demonstrate the effectiveness of our proposed learning approach through concrete numerical examples. The proposed approach is potentially useful for the generative modeling of molecular systems in biophysics.

stat.ML

Periodically forced pinned anharmonic atom chains

Recent works proved a hydrodynamic limit for periodically forced atom chains with harmonic interaction and pinning, together with momentum flip. When energy is the only conserved quantity, one would expect similar results in the anharmonic case, as conjectured for the temperature profile and energy flux in arXiv:2212.00093. However, outside the harmonic case, explicit computations are generally no longer possible, thus making a rigorous proof of this hydrodynamic limit difficult. Consequently, we numerically investigate the plausibility of this limit for the particular case of a chain with $β$-FPUT interactions and harmonic pinning. We present our simulation results suggesting that the conjectured PDE for the limiting temperature profile and Green--Kubo type formula for the limiting energy current conjectured in arXiv:2212.00093 are correct. We then use this Green--Kubo type formula to investigate the relationship between the energy current and period of the forcing. This relationship is investigated in the case of significant rate of momentum flip, small rate of momentum flip and no momentum flip. We compare the relationship observed in the anharmonic case to that of the harmonic case for which explicit formulae are available.

cond-mat.stat-mech

Adaptive Momentum and Nonlinear Damping for Neural Network Training

Momentum Stochastic Gradient Descent (mSGD) relies on a fixed momentum coefficient shared across all parameters, failing to account for the heterogeneous structure of modern loss landscapes. In this work, we adopt a continuous-time formulation to introduce individual, adaptive momentum coefficients regulated by the kinetic energy of each model parameter. This mechanism automatically adjusts to evolving training dynamics to maintain stability without sacrificing convergence speed. We demonstrate that this adaptive friction is inextricably linked to cubic damping, a suppression mechanism from structural dynamics. We additionally introduce two optimization schemes by augmenting the continuous dynamics of mSGD and Adam with a cubic damping term. Empirically, our methods demonstrate robustness and match or outperform Adam on training ViT, BERT, and GPT2 tasks where mSGD typically struggles. We further provide theoretical results establishing the exponential convergence of the proposed schemes.

cs.LG

How to construct decay rates for kinetic Fokker--Planck equations?

We study time averages for the norm of solutions to kinetic Fokker--Planck equations associated with general Hamiltonians. We provide fully explicit and constructive decay estimates for systems subject to a confining potential, allowing fat-tail, sub-exponential and (super-)exponential local equilibria, which also include the classic Maxwellian case. The key step in our estimates is a modified Poincaré inequality, obtained via a Lions--Poincaré inequality and an averaging lemma.

math.AP

Improving sampling by modifying the effective diffusion

Markov chain Monte Carlo samplers based on discretizations of (overdamped) Langevin dynamics are commonly used in the Bayesian inference and computational statistical physics literature to estimate high-dimensional integrals. One can introduce a non-constant diffusion matrix to precondition these dynamics, and recent works have optimized it in order to improve the rate of convergence to stationarity by overcoming entropic and energy barriers. However, the introduced methodologies to compute these optimal diffusions are generally not suited to high-dimensional settings, as they rely on costly optimization procedures. In this work, we propose to optimize over a class of diffusion matrices, based on one-dimensional collective variables (CVs), to help the dynamics explore the latent space defined by the CV. The form of the diffusion matrix is chosen in order to obtain an efficient effective diffusion in the latent space. We describe how this class of diffusion matrices can be constructed and learned during the simulation. We provide implementations of the Metropolis--Adjusted Langevin Algorithm and Riemann Manifold (Generalized) Hamiltonian Monte Carlo algorithms, and discuss numerical optimizations in the case when the CV depends only on a few degrees of freedom of the system. We illustrate the efficiency gains by computing mean transition durations between two metastable states of a dimer in a solvent.

math.NA

Explicit convergence rates of underdamped Langevin dynamics under weighted and weak Poincaré--Lions inequalities

We study the long-time behavior of the underdamped Langevin dynamics, in the case of so-called \emph{weak confinement}. Indeed, any $\mathrm{L}^\infty$ distribution (in position and velocity) relaxes to equilibrium over time, and we quantify the convergence rate. In our situation, the spatial equilibrium distribution does not satisfy a Poincaré inequality. Instead, we assume a weighted Poincaré inequality, which allows for fat-tail or sub-exponential potential energies. We provide constructive and fully explicit estimates in $\mathrm{L}^2$-norm for $\mathrm{L}^\infty$ initial data. A key-ingredient is a new space-time weighted Poincaré--Lions inequality, entailing, in turn, a weak Poincaré--Lions inequality.

math.PR

Dynamical reweighting for estimation of fluctuation formulas

We propose a variance reduction method for calculating transport coefficients in molecular dynamics using an importance sampling method via Girsanov's theorem applied to Green--Kubo's formula. We optimize the magnitude of the perturbation applied to the reference dynamics by means of a scalar parameter~$α$ and propose an asymptotic analysis to fully characterize the long-time behavior in order to evaluate the possible variance reduction. Theoretical results corroborated by numerical results show that this method allows for some reduction in variance, although rather modest in most situations.

math.NA

Transient subtraction: A control variate method for computing transport coefficients

In molecular dynamics, transport coefficients measure the sensitivity of the invariant probability measure of the stochastic dynamics at hand with respect to some perturbation. They are typically computed using either the linear response of nonequilibrium dynamics, or the Green--Kubo formula. The estimators for both approaches have large variances, which motivates the study of variance reduction techniques for computing transport coefficients. We present an alternative approach, called the \emph{transient subtraction technique} (inspired by early work by Ciccotti and Jaccucci in 1975), which amounts to simulating a transient dynamics started off equilibrium and relaxing towards the equilibrium state, from which we subtract a sensibly coupled equilibrium trajectory, resulting in an estimator with smaller variance. We present the mathematical formulation of the transient subtraction technique, give error estimates on the bias and variance of the associated estimator, and demonstrate the relevance of the method through numerical illustrations for various systems.

math.NA

Optimizing the diffusion coefficient of overdamped Langevin dynamics

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian inference. By varying the diffusion coefficient, there are in fact infinitely many overdamped Langevin dynamics which are reversible with respect to the target probability measure at hand. This suggests to optimize the diffusion coefficient in order to increase the convergence rate of the dynamics, as measured by the spectral gap of the generator associated with the stochastic differential equation. We analytically study this problem here, obtaining in particular necessary conditions on the optimal diffusion coefficient. We also derive an explicit expression of the optimal diffusion in some appropriate homogenized limit. Numerical results, both relying on discretizations of the spectral gap problem and Monte Carlo simulations of the stochastic dynamics, demonstrate the increased quality of the sampling arising from an appropriate choice of the diffusion coefficient.

math.NA

Quantitative low-temperature spectral asymptotics for reversible diffusions in temperature-dependent domains

We derive novel low-temperature asymptotics for the spectrum of the infinitesimal generator of the overdamped Langevin dynamics. The novelty is that this operator is endowed with homogeneous Dirichlet conditions at the boundary of a domain which depends on the temperature. From the point of view of stochastic processes, this gives information on the long-time behavior of the diffusion conditioned on non-absorption at the boundary, in the so-called quasistationary regime. Our results provide precise estimates of the spectral gap and principal eigenvalue, extending the Eyring-Kramers formula. The phenomenology is richer than in the case of a fixed boundary and gives new insight into the sensitivity of the spectrum with respect to the shape of the domain near critical points of the energy function. Our work is motivated by--and is relevant to--the problem of finding optimal hyperparameters for accelerated molecular dynamics algorithms.

math.AP

Neural network approaches for variance reduction in fluctuation formulas

We propose a method utilizing physics-informed neural networks (PINNs) to solve Poisson equations that serve as control variates in the computation of transport coefficients via fluctuation formulas, such as the Green--Kubo and generalized Einstein-like formulas. By leveraging approximate solutions to the Poisson equation constructed through neural networks, our approach significantly reduces the variance of the estimator at hand. We provide an extensive numerical analysis of the estimators and detail a methodology for training neural networks to solve these Poisson equations. The approximate solutions are then incorporated into Monte Carlo simulations as effective control variates, demonstrating the suitability of the method for moderately high-dimensional problems where fully deterministic solutions are computationally infeasible.

math.NA

Machine learning assisted canonical sampling (MLACS)

The acceleration of material property calculations while maintaining ab initio accuracy (1 meV/atom) is one of the major challenges in computational physics. In this paper, we introduce a Python package enhancing the computation of (finite temperature) material properties at the ab initio level using machine learning interatomic potentials (MLIP). The Machine-Learning Assisted Canonical Sampling (MLACS) method, grounded in a self-consistent variational approach, iteratively trains a MLIP using an active learning strategy in order to significantly reduce the computational cost of ab initio simulations. MLACS offers a modular and user-friendly interface that seamlessly integrates Density Functional Theory (DFT) codes, MLIP potentials, and molecular dynamics packages, enabling a wide range of applications, while maintaining a near-DFT accuracy. These include sampling the canonical ensemble of a system, performing free energy calculations, transition path sampling, and geometry optimization, all by utilizing surrogate MLIP potentials, in place of ab initio calculations. This paper provides a comprehensive overview of the theoretical foundations and implementation of the MLACS method. We also demonstrate its accuracy and efficiency through various examples, showcasing the capabilities of the MLACS package.

cond-mat.mtrl-sci