arXiv ScienceSearch

arXiv subjects

Datong Zhou

Publications and source records attributed to Datong Zhou.

12 recordsLinked to original sources

Mean-field theory via dissociated arrays for particle systems interacting through noisy weights

We study a mean-field limit for a $N$-particle system in which each particle follows a diffusion and interacts with other particles through a weight on each directed edge. Each weight evolves according to its own nonlinear SDE driven by a Brownian motion, with coefficients involving the states of the two endpoint particles of the edge. The initial vertex and edge variables are assumed to have a dissociated Aldous--Hoover form. We construct the limiting nonlinear SDE by averaging the interaction over an independent neighbor and an edge input, prove its well-posedness, and show that the dissociated vertex-edge structure is propagated by the dynamics. This propagation property is an analogue of propagation of chaos in the case where the weight of each edge may remain correlated with the states of the two endpoint particles. Under either a bounded-observable assumption or a sub-Gaussian edge-input condition, the finite system converges to this limit through quantitative coupling estimates for a typical particle and a typical edge. We also prove the convergence of the empirical measure of particle's state pairs and their interaction weights.

math.PR

Non-exchangeable mean-field theory for adaptive weights: propagation of dissociatedness and graphon sampling lemma

We develop a mean-field theory for large, non-exchangeable particle (agent) systems where the states and interaction weights co-evolve in a coupled system of SDEs. A first main result is the establishment of the propagation of dissociatedness, a conceptual generalization of the classical propagation of chaos that accommodates the intrinsic local correlations between particles and their weights. The limiting McKean-Vlasov process is characterized by an Aldous-Hoover representation on a filtered probability space, beyond the standard one-particle law (or a family thereof). Paralleling the classical equivalence between propagation of chaos and the convergence of empirical measures to the one-particle law, we show that the propagation of dissociatedness corresponds to the convergence of the empirical structure under a distance unifying the Wasserstein distance for particles and the cut distance for weights. This quantitative stability is grounded in an adaptation of the sampling lemma from dense graph theory, analogous to the classical concentration results for empirical measures in the Wasserstein distance.

math.PR

A deterministic particle method for the porous media equation

This paper deals with the deterministic particle method for the equation of porous media (with p = 2). We establish a convergence rate in the Wasserstein-2 distance between the approximate solution of the associated nonlinear transport equation and the solution of the original one. This seems to be the first quantitative rate for diffusion-velocity particle methods solving diffusive equations and is achieved using a novel commutator estimate for the Wasserstein transport map.

math.AP

Coupling and Tensorization of Kinetic Theory and Graph Theory

We study a non-exchangeable multi-agent system and rigorously derive a strong form of the mean-field limit. The convergence of the connection weights and the initial data implies convergence of large-scale dynamics toward a deterministic limit given by the corresponding extended Vlasov PDE, at any later time and any realization of randomness. This is established on what we call a bi-coupling distance defined through a convex optimization problem, which is an interpolation of the optimal transport between measures and the fractional overlay between graphs. The proof relies on a quantitative stability estimate of the so-called observables, which are tensorizations of agent laws and graph homomorphism densities. This reveals a profound relationship between mean-field theory and graph limiting theory, intersecting in the study of non-exchangeable systems.

math.AP

Dense networks of integrate-and-fire neurons: Spatially-extended mean-field limit of the empirical measure

The dynamics of spatially-structured networks of $N$ interacting stochastic neurons can be described by deterministic population equations in the mean-field limit. While this is known, a general question has remained unanswered: does synaptic weight scaling suffice, by itself, to guarantee the convergence of network dynamics to a deterministic population equation, even when networks are not assumed to be homogeneous or spatially structured? In this work, we consider networks of stochastic integrate-and-fire neurons with arbitrary synaptic weights satisfying a $O(1/N)$ scaling condition. Borrowing results from the theory of dense graph limits, or graphons, we prove that, as $N\to\infty$, and up to the extraction of a subsequence, the empirical measure of the neurons' membrane potentials converges to the solution of a spatially-extended mean-field partial differential equation (PDE). Our proof requires analytical techniques that go beyond standard propagation of chaos methods. In particular, we introduce a weak metric that depends on the dense graph limit kernel and we show how the weak convergence of the initial data can be obtained by propagating the regularity of the limit kernel along the dual-backward equation associated with the spatially-extended mean-field PDE. Overall, this result invites us to reinterpret spatially-extended population equations as universal mean-field limits of networks of neurons with $O(1/N)$ synaptic weight scaling.

math.PR

The mean-field Limit of sparse networks of integrate and fire neurons

We study the mean-field limit of a model of biological neuron networks based on the so-called stochastic integrate-and-fire (IF) dynamics. Our approach allows to derive a continuous limit for the macroscopic behavior of the system, the 1-particle distribution, for a large number of neurons with no structural assumptions on the connection map outside of a generalized mean-field scaling. We propose a novel notion of observables that naturally extends the notion of marginals to systems with non-identical or non-exchangeable agents. Our new observables satisfy a complex approximate hierarchy, essentially a tree-indexed extension of the classical BBGKY hierarchy. We are able to pass to the limit in this hierarchy as the number of neurons increases through novel quantitative stability estimates in some adapted weak norm. While we require non-vanishing diffusion, this approach notably addresses the challenges of sparse interacting graphs/matrices and singular interactions from Poisson jumps, and requires no additional regularity on the initial distribution.

math.PR

Discretizing advection equations with rough velocity fields on non-cartesian grids

We investigate the properties of discretizations of advection equations on non-cartesian grids and graphs in general. Advection equations discretized on non-cartesian grids have remained a long-standing challenge as the structure of the grid can lead to strong oscillations in the solution, even for otherwise constant velocity fields. We introduce a new method to track oscillations of the solution for rough velocity fields on any graph. The method in particular highlights some inherent structural conditions on the mesh for propagating regularity on solutions.

math.AP

Wasserstein-Fisher-Rao Document Distance

As a fundamental problem of natural language processing, it is important to measure the distance between different documents. Among the existing methods, the Word Mover's Distance (WMD) has shown remarkable success in document semantic matching for its clear physical insight as a parameter-free model. However, WMD is essentially based on the classical Wasserstein metric, thus it often fails to robustly represent the semantic similarity between texts of different lengths. In this paper, we apply the newly developed Wasserstein-Fisher-Rao (WFR) metric from unbalanced optimal transport theory to measure the distance between different documents. The proposed WFR document distance maintains the great interpretability and simplicity as WMD. We demonstrate that the WFR document distance has significant advantages when comparing the texts of different lengths. In addition, an accelerated Sinkhorn based algorithm with GPU implementation has been developed for the fast computation of WFR distances. The KNN classification results on eight datasets have shown its clear improvement over WMD.

cs.LG

A Bayesian Perspective on Residential Demand Response Using Smart Meter Data

The widespread deployment of Advanced Metering Infrastructure has made granular data of residential electricity consumption available on a large scale. Smart meters enable a two way communication between residential customers and utilities. One field of research that relies on such granular consumption data is Residential Demand Response, where individual users are incentivized to temporarily reduce their consumption during periods of high marginal cost of electricity. To quantify the economic potential of Residential Demand Response, it is important to estimate the reductions during Demand Response hours, taking into account the heterogeneity of electricity users. In this paper, we incorporate latent variables representing behavioral archetypes of electricity users into the process of short term load forecasting with Machine Learning methods, thereby differentiating between varying levels of energy consumption. The latent variables are constructed by fitting Conditional Mixture Models of Linear Regressions and Hidden Markov Models on smart meter readings of a Residential Demand Response program in the western United States. We observe a notable increase in the accuracy of short term load forecasts compared to the case without latent variables. We then estimate the reductions during Demand Response events conditional on the latent variables, and discover a higher DR reduction among users with automated smart home devices compared to those without.

eess.SY

Residential Demand Response Targeting Using Machine Learning with Observational Data

The large scale deployment of Advanced Metering Infrastructure among residential energy customers has served as a boon for energy systems research relying on granular consumption data. Residential Demand Response aims to utilize the flexibility of consumers to reduce their energy usage during times when the grid is strained. Suitable incentive mechanisms to encourage customers to deviate from their usual behavior have to be implemented to correctly control the bids into the wholesale electricity market as a Demand Response provider. In this paper, we present a framework for short term load forecasting on an individual user level, and relate nonexperimental estimates of Demand Response efficacy, i.e. the estimated reduction of consumption during Demand Response events, to the variability of user consumption. We apply our framework on a data set from a residential Demand Response program in the Western United States. Our results suggest that users with more variable consumption patterns are more likely to reduce their consumption compared to users with a more regular consumption behavior.

eess.SY

Building Model Identification during Regular Operation - Empirical Results and Challenges

The inter-temporal consumption flexibility of commercial buildings can be harnessed to improve the energy efficiency of buildings, or to provide ancillary service to the power grid. To do so, a predictive model of the building's thermal dynamics is required. In this paper, we identify a physics-based model of a multi-purpose commercial building including its heating, ventilation and air conditioning system during regular operation. We present our empirical results and show that large uncertainties in internal heat gains, due to occupancy and equipment, present several challenges in utilizing the building model for long-term prediction. In addition, we show that by learning these uncertain loads online and dynamically updating the building model, prediction accuracy is improved significantly.

eess.SY

Model Comparison of a Data-Driven and a Physical Model for Simulating HVAC Systems

Commercial buildings are responsible for a large fraction of energy consumption in developed countries, and therefore are targets of energy efficiency programs. Motivated by the large inherent thermal inertia of buildings, the power consumption can be flexibly scheduled without compromising occupant comfort. This temporal flexibility offers opportunities for the provision of frequency regulation to support grid stability. To realize energy savings and frequency regulation, it is of prime importance to identify a realistic model for the temperature dynamics of a building. We identify a low- dimensional data-driven model and a high-dimensional physics- based model for different spatial granularities and temporal seasons based on a case study of an entire floor of Sutardja Dai Hall, an office building on the University of California, Berkeley campus. A comparison of these contrasting models shows that, despite the higher forecasting accuracy of the physics-based model, both models perform almost equally well for energy efficient control. We conclude that the data-driven model is more amenable to controller design due to its low complexity, and could serve as a substitution for highly complex physics- based models with an insignificant loss of prediction accuracy for many applications. On the other hand, our physics-based approach is more suitable for modeling buildings with finer spatial granularities.

eess.SY