arXiv ScienceSearch

arXiv subjects

Tommer D. Keidar

Publications and source records attributed to Tommer D. Keidar.

9 recordsLinked to original sources

Localization Delocalization Transition in Diffusion with Adaptive Resetting

Stochastic resetting can localize diffusion and generate nonequilibrium steady states, but the conditions under which spatially dependent resetting produces localization remain unclear. Here, we establish a general classification for diffusion under adaptive resetting, where the resetting rate $r(x)$ depends on position. For rates with the asymptotic scaling $r(x)\sim |x|^\lambda$, we identify a sharp threshold at $\lambda=-2$. For $\lambda>-2$, the steady state is localized and exhibits stretched-exponential tails, whereas for $\lambda<-2$, resetting is asymptotically too weak to localize the particle. Precisely at the marginal scaling $r(x)\sim |x|^{-2}$, a qualitatively new regime emerges: the steady state develops power-law tails with a temperature-dependent exponent and exhibits a finite-temperature delocalization transition. Thus, inverse-square resetting plays the role of the logarithmic potential in equilibrium, establishing a nonequilibrium counterpart of the temperature-driven delocalization seen there.

cond-mat.stat-mech

Stochastic Resetting: A Non-Equilibrium Framework for Prediction, Inference and Design

Stochastic resetting has evolved from a simple model of diffusive search acceleration into a general framework for predicting, inferring, and controlling stochastic dynamics far from equilibrium. Its defining features, i.e., the creation of non-equilibrium steady states and the acceleration of first-passage kinetics, are increasingly relevant across physical chemistry, from biological restart mechanisms to molecular simulations and colloidal experiments. We review the renewal theory underlying stochastic resetting and show how it enables prediction of reset dynamics from properties of the underlying process, while also allowing the latter to be inferred from the resetting-accelerated dynamics. We then discuss applications to state preparation, enhanced sampling, kinetic inference, and training and sampling of machine learning models. Finally, we review recent advances in adaptive resetting, environmental feedback, many-body dynamics, and thermodynamic costs of resetting. These developments establish new opportunities for controlling stochastic dynamics with resetting across theory, simulations, and experiments.

physics.chem-ph

More Bang for the Buck: Improving the Inference of Large Language Models at a Fixed Budget using Reset and Discard (ReD)

The performance of large language models (LLMs) on verifiable tasks is usually measured by pass@k, the probability of answering a question correctly at least once in k trials. At a fixed budget, a more suitable metric is coverage@cost, the average number of unique questions answered as a function of the total number of attempts. We connect the two metrics and show that the empirically-observed power-law behavior in pass@k leads to a sublinear growth of the coverage@cost (diminishing returns). To solve this problem, we propose Reset-and-Discard (ReD), a query method of LLMs that increases coverage@cost for a given budget, regardless of the pass@k form. Moreover, given a pass@k, we can quantitatively predict the savings in the total number of attempts using ReD. If pass@k is not available for the model, ReD can infer its power-law exponent. Experiments on three LLMs across coding (HumanEval), math (GSM8K), and reasoning (MMLU-Pro) benchmarks demonstrate that ReD substantially reduces the required attempts, tokens, and USD cost to reach a desired coverage, while also offering an efficient way to measure inference power-laws. ReD's advantage is maintained for imperfect verifiers and outperforms the tested allocation baselines.

cs.LG

First-Passage Approach to Optimizing Perturbations for Improved Training of Machine Learning Models

Machine learning models have become indispensable tools in applications across the physical sciences. Their training is often time-consuming, vastly exceeding the inference timescales. Several protocols have been developed to perturb the learning process and improve the training, such as shrink and perturb, warm restarts, and stochastic resetting. For classifiers, these perturbations have been shown to result in enhanced speedups or improved generalization. However, the design of such perturbations is usually done ad hoc by intuition and trial and error. To rationally optimize training protocols, we frame them as first-passage processes and consider their response to perturbations. We show that if the unperturbed learning process reaches a quasi-steady state, the response at a single perturbation frequency can predict the behavior at a wide range of frequencies. We employ this approach to a CIFAR-10 classifier using the ResNet-18 model and identify a useful perturbation and frequency among several possibilities. We demonstrate the transferability of the approach to other datasets, architectures, optimizers and even tasks (regression instead of classification). Our work allows optimization of perturbations for improving the training of machine learning models using a first-passage approach.

cs.LG

Universal Linear Response of First-Passage Kinetics: A Framework for Prediction and Inference

First-passage processes are pervasive across numerous scientific fields, yet a general framework for understanding their response to external perturbations remains elusive. While the fluctuation-dissipation theorem offers a complete linear response theory for systems in steady-state, it fails to apply to transient first-passage processes. We address this challenge by focusing on rare - rather than weak - perturbations. Surprisingly, we discover that the linear response of the mean first-passage time (MFPT) to such perturbations is universal. It depends solely on the first two moments of the unperturbed first-passage time and the mean completion time following perturbation activation, without any assumptions about the underlying system's dynamics. To demonstrate the utility of our findings, we analyze the MFPT response of drift-diffusion processes in two scenarios: (i) stochastic resetting with information feedback, and (ii) an abrupt transition from a linear to a logarithmic potential. In both cases, our approach bypasses the need for explicit determination of the perturbed dynamics, unraveling a highly non-trivial response landscape with minimal effort. Finally, we show how our framework enables a new type of experiment - inferring molecular-level fluctuations from bulk measurements, a feat previously believed to be impossible. Overall, the newly discovered universality reported herein offers a powerful tool for predicting the impact of perturbations on kinetic processes - and, remarkably, for extracting hidden single-molecule fluctuations from accessible bulk measurements.

cond-mat.stat-mech

Adaptive Resetting for Informed Search Strategies and the Design of Non-equilibrium Steady-states

Stochastic resetting, the procedure of stopping and re-initializing random processes, has recently emerged as a powerful tool for accelerating processes ranging from queuing systems to molecular simulations. However, its usefulness is severely limited by assuming that the resetting protocol is completely decoupled from the state and age of the process that is being reset. We present a general formulation for state- and time-dependent resetting of stochastic processes, which we call adaptive resetting. This allows us to predict, using a single set of trajectories without resetting and via a simple reweighing procedure, all key observables of processes with adaptive resetting. These include the first-passage time distribution, the propagator, and the steady-state. Our formulation enables efficient exploration of informed search strategies and facilitates the prediction and design of complex non-equilibrium steady states, eliminating the need for extensive brute-force sampling across different resetting protocols. Finally, we develop a general machine learning framework to optimize the adaptive resetting protocol for an arbitrary task beyond the current state of the art. We use it to discover efficient protocols for accelerating molecular dynamics simulations.

cond-mat.stat-mech

Smart Resetting: An Energy-Efficient Strategy for Stochastic Search Processes

Stochastic resetting, a method for accelerating target search in random processes, often incurs temporal and energetic costs. For a diffusing particle, a lower bound exists for the energetic cost of reaching the target, which is attained at low resetting rates and equals the direct linear transportation cost against fluid drag. Here, we study ``smart resetting," a strategy that aims to beat this lower bound. By strategically resetting the particle only when this benefits its progress toward the target, smart resetting leverages information to minimize energy consumption. We analytically calculate the energetic cost per mean first passage time and show that smart resetting consistently reduces the energetic cost compared to regular resetting. Surprisingly, smart resting achieves the minimum energy cost previously established for regular resetting, irrespective of the resetting rate. Yet, it fails to reduce this cost further. We extend our findings in two ways: first, by examining nonlinear energetic cost functions, and second, by considering smart resetting of drift-diffusion processes.

cond-mat.stat-mech

Accelerating Molecular Dynamics through Informed Resetting

We present a procedure for enhanced sampling of molecular dynamics simulations through informed stochastic resetting. Many phenomena, such as protein folding and crystal nucleation, occur over time scales that are inaccessible in standard simulations. We recently showed that stochastic resetting can accelerate molecular simulations that exhibit broad transition time distributions. However, standard stochastic resetting does not exploit any information about the reaction progress. For a model system and chignolin in explicit water, we demonstrate that an informed resetting protocol leads to greater accelerations than standard stochastic resetting in molecular dynamics and Metadynamics simulations. This is achieved by resetting only when a certain condition is met, e.g., when the distance from the target along the reaction coordinate is larger than some threshold. We use these accelerated simulations to infer important kinetic observables such as the unbiased mean first-passage time and direct transit time. For the latter, Metadynamics with informed resetting leads to speedups of 2-3 orders of magnitude over unbiased simulations with relative errors of only ~35-70%. Our work significantly extends the applicability of stochastic resetting for enhanced sampling of molecular simulations.

physics.chem-ph

Resetting as a swift equilibration protocol in an anharmonic potential

We present and characterize a method to accelerate the relaxation of a Brownian object between two distinct equilibrium states. Instead of relying on a deterministic time-dependent control parameter, we use stochastic resetting to guide and accelerate the transient evolution. The protocol is investigated numerically, and its thermodynamic cost is evaluated with the tools of stochastic thermodynamics. Remarkably, we show that stochastic resetting significantly accelerates the relaxation to the final state. This stochastic protocol exhibits energetic and temporal characteristics that align with the scales observed in previously investigated deterministic protocols. Moreover, it expands the spectrum of stationary states that can be manipulated, incorporating new potential profiles achievable through experimentally viable protocols.

cond-mat.stat-mech