arXiv subjects

Xuehao Ding

Publications and source records attributed to Xuehao Ding.

7 recordsLinked to original sources

arXiv2026

Self-Supervised Learning of Local Predictive Directions as a Neural Computation

Natural sensory dynamics are globally nonlinear but often exhibit simple local geometry, with nearby trajectories evolving preferentially along a small number of predictive directions. We ask how neural circuits could discover this geometry directly from temporal experience. We introduce Local Predictive Directions (LPD), a self-supervised framework that learns local directions whose projections maximally predict near-future trajectory evolution. LPD applies past-future canonical correlation analysis to temporal differences, making the learned representation invariant to translations of the underlying state while avoiding estimation of equilibria or a global dynamical model. To represent systems with multiple predictive regimes, we introduce a non-negative similarity-matching objective, with offline and online algorithms, that partitions trajectory segments into predictive domains, each associated with a distinct local predictive direction. The online algorithm admits a natural neural-network interpretation: the resulting activities provide soft domain assignments, while synaptic weights encode the corresponding local predictive filters. On stochastic nonlinear dynamical systems, LPD recovers the local predictive geometry and partitions trajectories into distinct dynamical regimes. On naturalistic sensory streams, the online algorithm produces center-surround spatial receptive fields and ON/OFF sustained and transient temporal filters resembling those of early visual neurons. Our results suggest that predictive learning can provide a self-supervised mechanism by which neural circuits discover the local geometry of environmental dynamics and represent it in receptive fields.

q-bio.NC↗

arXiv2026

Local Koopman modes of saddle-point diffusions: exact singular functions and a data-driven estimator

Coherent sets-regions of phase space that resist mixing-organize transport in stochastic dynamical systems and are encoded in the leading singular functions of the stochastic Koopman operator. These are typically computed numerically and globally; a local, analytic theory near a fixed point has been missing, although fixed points and the transitions between them organize the flow. We supply the local theory for a saddle, the transition state through which probability flows between basins. Naively the construction fails-probability escapes along unstable directions, the invariant measure is non-normalizable, the singular functions leave $L^2$, and singular values exceed one. We show that conditioning on non-escape (a Doob's $h$-transform) repairs this; that the required $h$ is the unique stabilizing solution of an algebraic Riccati equation; and that the resulting slow modes decay at the escape rate along the unstable manifold. We obtain these modes in closed form-products of Hermite polynomials in canonical coordinates times the $h$-function-and use their unitary structure to derive a data-driven estimator: canonical correlation analysis on conditioned trajectories. When a single unstable direction dominates, the leading mode is the reaction coordinate, locally recovering the stable manifold and committor of transition-path theory. The construction connects coherent sets to transition-path theory, to the stabilizing Riccati solution of linear control, and to the time-reversed dynamics of generative diffusion models.

math.DS↗

arXiv2026

Stochastic Thermodynamics of Score Matching in Diffusion Models

Score-based diffusion models are a powerful class of generative AI systems capable of sampling from complex, high-dimensional probability distributions. Their dynamics consist of a forward diffusion process that transforms data into noise and a learned reverse process that reconstructs data by reversing the probability flow. Here, we develop a stochastic thermodynamic framework for diffusion models and their score-matching objective. We introduce a trajectory-dependent quantity, time-asymmetry entropy production (TAEP), defined from the forward and reverse diffusion dynamics, and show that it obeys exact fluctuation theorems. Remarkably, Hyvärinen's implicit score-matching kernel emerges naturally as a fluctuating component of TAEP, while the average TAEP is exactly proportional to the score-matching objective. We further show that fluctuations of TAEP quantify sampling unevenness and provide a thermodynamic measure of data-manifold coverage. These results yield a quantitative explanation for the superior sampling diversity of diffusion models and reveal a thermodynamic mechanism by which stochastic gradient descent favors flatter, more generalizable solutions. By uncovering the entropic nature of score matching, our work establishes fundamental statistical-mechanical principles underlying diffusion-based generative AI.

cond-mat.dis-nn↗

arXiv2025

Neurons as Detectors of Coherent Sets in Sensory Dynamics

We model sensory streams as observations from high-dimensional stochastic dynamical systems and conceptualize sensory neurons as self-supervised learners of compact representations of such dynamics. From prior experience, neurons learn coherent sets-regions of stimulus state space whose trajectories evolve cohesively over finite times-and assign membership indices to new stimuli. Coherent sets are identified via spectral clustering of the stochastic Koopman operator (SKO), where the sign pattern of a subdominant singular function partitions the state space into minimally coupled regions. For multivariate Ornstein-Uhlenbeck processes, this singular function reduces to a linear projection onto the dominant singular vector of the whitened state-transition matrix. Encoding this singular vector as a receptive field enables neurons to compute membership indices via the projection sign in a biologically plausible manner. Each neuron detects either a predictive coherent set (stimuli with common futures) or a retrospective coherent set (stimuli with common pasts), suggesting a functional dichotomy among neurons. Since neurons lack access to explicit dynamical equations, the requisite singular vectors must be estimated directly from data, for example, via past-future canonical correlation analysis on lag-vector representations-an approach that naturally extends to nonlinear dynamics. This framework provides a novel account of neuronal temporal filtering, the ubiquity of rectification in neural responses, and known functional dichotomies. Coherent-set clustering thus emerges as a fundamental computation underlying sensory processing and transferable to bio-inspired artificial systems.

q-bio.NC↗

arXiv2019

Local Label Propagation for Large-Scale Semi-Supervised Learning

A significant issue in training deep neural networks to solve supervised learning tasks is the need for large numbers of labelled datapoints. The goal of semi-supervised learning is to leverage ubiquitous unlabelled data, together with small quantities of labelled data, to achieve high task performance. Though substantial recent progress has been made in developing semi-supervised algorithms that are effective for comparatively small datasets, many of these techniques do not scale readily to the large (unlaballed) datasets characteristic of real-world applications. In this paper we introduce a novel approach to scalable semi-supervised learning, called Local Label Propagation (LLP). Extending ideas from recent work on unsupervised embedding learning, LLP first embeds datapoints, labelled and otherwise, in a common latent space using a deep neural network. It then propagates pseudolabels from known to unknown datapoints in a manner that depends on the local geometry of the embedding, taking into account both inter-point distance and local data density as a weighting on propagation likelihood. The parameters of the deep embedding are then trained to simultaneously maximize pseudolabel categorization performance as well as a metric of the clustering of datapoints within each psuedo-label group, iteratively alternating stages of network training and label propagation. We illustrate the utility of the LLP method on the ImageNet dataset, achieving results that outperform previous state-of-the-art scalable semi-supervised learning algorithms by large margins, consistently across a wide variety of training regimes. We also show that the feature representation learned with LLP transfers well to scene recognition in the Places 205 dataset.

cs.CV↗

arXiv2018

Measurement driven single temperature engine

A four stroke quantum engine which alternately interacts with a measurement apparatus and a single heat bath is discussed in detail with respect to the average work and heat as well as to the fluctuations of work and heat. The efficiency and the reliability of such an engine with a harmonic oscillator as working substance are analyzed under different conditions such as different speeds of the work strokes, different temperatures of the heat bath and various strengths of the energy supplying measurement. For imperfect thermalization strokes of finite duration also the power of the engine is analyzed. A comparison with a two-temperature Otto engine is provided in the particular case of adiabatic work and ideal thermalization strokes.

cond-mat.stat-mech↗

arXiv2017

Fluctuation Theorems Containing Information for Autonomous Maxwell's Demon-assisted Machines

In this article, we introduce two kinds of Fluctuation Theorems (FT) containing information for autonomous Maxwell's demon-assisted machines. Using Jensen's Inequality, we obtain Landauer's principle formulation of the second law for the whole process of the machine. Finally we make use of our results to analyze a new information device. \pacs{05.70.Ln, 05.40.-a, 89.70.Cf}

cond-mat.stat-mech↗