arXiv subjects

Dallas Foster

Publications and source records attributed to Dallas Foster.

4 recordsLinked to original sources

arXiv2026

Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentials

Machine learning interatomic potentials (MLIPs) enable efficient and accurate atomistic simulations but depend critically on the quality and diversity of the training data. We introduce Stein kernelized molecular dynamics (SKMD), an enhanced sampling method that uses interacting particle dynamics to acquire informative training configurations for the active learning and fine-tuning of MLIPs. SKMD corresponds to a stochastic variant of Stein variational gradient descent that is adapted for molecular dynamics by incorporating asynchronous particle updates and a kernel of global atomic descriptors, which provides a symmetry-aware measure of configurational similarity. Unlike other enhanced samplers used in molecular dynamics, SKMD preserves the Boltzmann distribution as the asymptotic distribution of the dynamics. This property enforces a balance between the exploration of diverse configurations and attraction toward high-probability regions of the energy landscape. We further propose an approach to efficient online data acquisition using an adaptive stopping criterion that selects non-redundant training data over the course of simulation. We demonstrate SKMD for the active learning of a neural network model of the M\"uller-Brown potential and the fine-tuning of a MACE interatomic potential for alanine dipeptide. Compared to active learning baselines, our method achieves higher model accuracy in fewer training iterations with the same number of acquired training samples.

cs.LG↗

arXiv2025

MoWE : A Mixture of Weather Experts

Data-driven weather models have recently achieved state-of-the-art performance, yet progress has plateaued in recent years. This paper introduces a Mixture of Experts (MoWE) approach as a novel paradigm to overcome these limitations, not by creating a new forecaster, but by optimally combining the outputs of existing models. The MoWE model is trained with significantly lower computational resources than the individual experts. Our model employs a Vision Transformer-based gating network that dynamically learns to weight the contributions of multiple "expert" models at each grid point, conditioned on forecast lead time. This approach creates a synthesized deterministic forecast that is more accurate than any individual component in terms of Root Mean Squared Error (RMSE). Our results demonstrate the effectiveness of this method, achieving up to a 10% lower RMSE than the best-performing AI weather model on a 2-day forecast horizon, significantly outperforming individual experts as well as a simple average across experts. This work presents a computationally efficient and scalable strategy to push the state of the art in data-driven weather prediction by making the most out of leading high-quality forecast models.

cs.LG↗

arXiv2020

A Bayesian approach to regional decadal predictability: Sparse parameter estimation in high-dimensional linear inverse models of high-latitude sea surface temperature variability

Stochastic reduced models are an important tool in climate systems whose many spatial and temporal scales cannot be fully discretized or underlying physics may not be fully accounted for. One form of reduced model, the linear inverse model (LIM), has been widely used for regional climate predictability studies - typically focusing more on tropical or mid-latitude studies. However, most LIM fitting techniques rely on point estimation techniques deriving from fluctuation-dissipation theory. In this methodological study we explore the use of Bayesian inference techniques for LIM parameter estimation of sea surface temperature (SST), to quantify the skillful decadal predictability of Bayesian LIM models at high latitudes. We show that Bayesian methods, when compared to traditional point estimation methods for LIM-type models, provide better calibrated probabilistic skill, while simultaneously providing better point estimates due to the regularization effect of the prior distribution in high-dimensional problems. We compare the effect of several priors, as well as maximum likelihood estimates, on (1) estimating parameter values on a perfect model experiment and (2) producing calibrated 1-year SST anomaly forecast distributions using a pre-industrial control run of the Community Earth System Model (CESM). Finally, we employ a host of probabilistic skill metrics to determine the extent to which a LIM can forecast SST anomalies at high latitudes. We find that the choice of prior distribution has an appreciable impact on estimation outcomes, and priors that emphasize physically relevant properties enhance the model's ability to capture variability of SST anomalies.

stat.ME↗

arXiv2018

Gradient Sensing via Cell Communication

Experimental evidence lends support to the conjecture that the ability of chains of cells to sense the gradient of an external chemical concentration could rely on cell-to-cell communication. This is the basis for the gradient sensing nature of a specific model type of the Local Excitation, Global Inhibition (LEGI) principle, wherein the strength of the external chemical field is sensed through a comparison between a local exciting species and a global inhibitor that is shared via intra-cellular reactions in the cell chain. In this study we generalize the nearest neighbor communication mechanism in the above-mentioned LEGI model in order to explore how the chemical sensing characteristics depend on the parameterization of the communication itself, cell size, and the radius of influence of neighboring cells. It was found that the radius of influence was less important than the approximating model for communication. Higher order approximations to the communication mechanism were better able to sense an external gradient. However, an analysis of the signal to noise ratio established that higher order models for communication were more prone to noise and thus have a lower signal to noise ratio. The generalization as well as the tools used in the analysis of the dynamics can be extended to more heterogeneous networks and can thus prove useful in using models and observations in the process of understanding chemical gradient via LEGI models with a communication component.

q-bio.QM↗